so i've been occasionally evaluating chatgpt performance on information extraction tasks that i find genuinely difficult and would like assistance in

yep, still garbage

i'm not sure what i expected

i think relying on chatgpt for information extraction tasks is borderline delusional; only in any way seemingly reasonable because search engines got progressively worse to the point where they're mostly noise

even then i prefer to get skilled in extracting what little value the noise has

@whitequark my own test is "What does make -t do?" and all LLMs spewed utter garbage despite that information being in POSIX and multiple man pages available online.