✧✦Catherine✦✧so i've been occasionally evaluating chatgpt performance on information extraction tasks that i find genuinely difficult and would like assistance in
yep, still garbage
i think relying on chatgpt for information extraction tasks is borderline delusional; only in any way seemingly reasonable because search engines got progressively worse to the point where they're mostly noise
even then i prefer to get skilled in extracting what little value the noise has
Skand Hurkat@whitequark These chat bots are so confident that it's easy to be fooled unless you have good information to the contrary. I asked chatgpt to summarize my research paper, and it came up with plausible bullshit that could have passed preliminary review by someone else in my field. https://masto.ai/@skandhurkat/110353247176503558
Skand Hurkat (@[email protected])
Attached: 1 image I'm late to the ChatGPT party, but this is both funny and insightful. The conversation starts off with me asking ChatGPT to summarize one of my papers. The summary generated is passable even to someone in the computer architecture community, but as the author, I know that it is just wrong. Perhaps this is a deeper insight into how all papers sound the same?