Facebook (sorry: Meta) AI: Check out our "AI" that lets you access all of humanity's knowledge.

Also Facebook AI: Be careful though, it just makes shit up.

This isn't even "they were so busy asking if they could" --- but rather they failed to spend 5 minutes asking if they could.

#AL #ML #MathyMath #Bullshit #NLP #NLProc #AIhype

Using a large language model as a search engine was a bad idea when it was proposed by a search company. It's still a bad idea now that it's being proposed by a social media company. Fortunately, Chirag Shah and I already wrote the paper laying out all the ways in which this is a bad idea.

https://dl.acm.org/doi/10.1145/3498366.3505816

#AL #ML #MathyMath #Bullshit #NLP #NLProc #AIhype

Situating Search | Proceedings of the 2022 Conference on Human Information Interaction and Retrieval

ACM Conferences

@emilymbender Perhaps I'm misunderstanding something, but this feels a bit like a strawman. AI generated results will have issues with "relevance, usefulness, and trustworthiness" but no one's saying they won't. None of these products are being presented as infallible oracles.

Some people, when the products are more well polished and no longer have the GIANT DISCLAIMERS they currently have, will over-trust, but answers from people also have these problems, right?

@williamgunn How about reading the paper that I linked to (or bare minimum the popular press coverage of it in the next post) before arguing with me?

@emilymbender Sorry, I thought you'd have noticed that I quoted from your paper in my response. I have more than an academic interest here. My company is using AI models to do these things & I'm genuinely interested in good criticism.

Maybe it was the ethics angle that didn't work for me. Who else is writing good criticisms?

@williamgunn My consulting fee is $1200 per hour. And if the ethics angle doesn't work for you, then that's definitely a company I wouldn't work for.