✧✦Catherine✦✧so i've been occasionally evaluating chatgpt performance on information extraction tasks that i find genuinely difficult and would like assistance in
yep, still garbage
i think relying on chatgpt for information extraction tasks is borderline delusional; only in any way seemingly reasonable because search engines got progressively worse to the point where they're mostly noise
even then i prefer to get skilled in extracting what little value the noise has
Internet Hedgehog 🦔@whitequark it completely fails when i try to make it do anything even slightly wacky and uncharacteristic
to anthropomorphize chatgpt for a moment, it's a total dweeb that hates fun
i feel like the main use i get from it is having it write out a tiny bit of code in a mainstream language, and only with stuff i already know but can't be bothered to write out manually.
@whitequark like i can't overstate how much of a dweeb chatgpt is. today i asked it to write some automation code for mac os using hammerspoon and it was like "you can't do this because this uses private apis"
of course i could easily do it and the hammerspoon documentation had exactly what i needed.