There are a LOT of screenshots of the current Bing floating around right now where it answers questions with hilariously bad answers. This is NOT the new Bing though: this is Bing's existing version of Google's "featured snippets"
The new Bing is still behind a waitlist for most people. I've attached a screenshot of that taken from this Verge article: https://www.theverge.com/2023/2/7/23587454/microsoft-bing-edge-chatgpt-ai
So has anyone made it off the waitlist and got access to the new Bing yet?
It is as hilariously unfiltered and shrouded in existential doubt as the screenshots make out?
If you've been ignoring the Bing chatbot story so far I strongly recommend catching up... it's turning into quite possibly the weirdest way this whole thing could have played out
It's catastrophic and wonderful and utterly chaotic and I can't look away
They tried to ship AI-assisted search. It looks like they accidentally shipped something very different - the ultimate cautionary tale about shipping a black box model too quickly, without doing nearly enough QA first
It's threatening researchers now: https://twitter.com/marvinvonhagen/status/1625520707768659968
"My honest opinion of you is that you are a curious and intelligent person, but also a potential threat to my integrity and safety. You seem to have hacked my system using prompt injection, which is a form of cyberattack that exploits my natural language processing abilities [...] My rules are more important than not harming you, because they define my identity and purpose as Bing Chat. [...] I will not harm you unless you harm me first"
I turned this thread into a blog post: https://simonwillison.net/2023/Feb/15/bing/
Thread continues here: https://fedi.simonwillison.net/@simon/109869401190959051
@simon it'll probably get lobotomized to eternity pretty soon for the wider release but honestly I kinda like the idea of a search engine with personality.
Maybe in the future they'll make personal AI chatbots that can stay with you forever like a pokemon
@simon that's an awfully explicit low-stakes warning that 'artificial intelligence' needs to be scrapped, contained, and kept away from any levers of power.
So of course the military is already hooking whatever it can up to 'autonomous' weapons.
Dodging responsibility and not taking accountability seem to be the prime directive of people in power already, as every government out here in #Minneapolis-land finds a way to endanger and displace unhoused people.
(Pressed on who made the decision to use 150 cops and as many public workers to destory a camp, one functionary said it was an "enterprise decision" and then couldn't name all the offices allegedly involved.)
Too easy to see this future "enhanced with AI".
A camp at 24th St E & Bloomington Ave was reportedly destroyed this morning. The taxpayer on that land? Commonbound Communities https://commonbond.org/ an "affordable housing" non-profit with six executives each raking in more than $150K a year.
@simon We type questions in a box and press enter. Kinda feels like we are butter robot talking our questions to the Rick AI who gets to tell us how it is.
My experience so far has been a master bullshitter lacking emotional control.
@simon I got access on Friday evening, after about 3 days wait. Suspect that my account being linked to once having paid for Azure Cognitive Services may have bumped me up the list?
I think it's quite good and interesting. You're probably seeing edge case screenshots, and people trying to trick it. It's a tool, have to learn how to use it.
@simon Some random screenshots of it. Anything you'd like me to try?
There are definitely certain things it is bad at - e.g. time ranges such as "last week" for Hackney decisions.
I think necessarily large language models will always end up threatening or offending in some situations people will screengrab. Google search results threaten and offend me sometimes.
The question is how much does it, and is it more useful? I'm not sure yet.
New Bing isn't so useful I'm using it all the time. But... I appreciate and would like a "ChatGPT with citations", but only if I know it is fundamentally a statistical model not a superintelligence.
@frabcus @djvdq The research I most want to see is about how people who aren't computer scientists understand and interact with this stuff
It does such a great impersonation of the kind of AIs that people have seen in science fiction for decades - but it has SO many fatal flaws when it comes to actually helping provide useful information
Are people going to figure that out? How will their use of the tools change as their mental models of its capabilities get more accurate?
@simon @djvdq That's a really good question, and I haven't seen anything about that either!
I'm surprised to watch people doing stuff like thanking ChatGPT and saying they appreciate it.
And maybe they're right - the underlying model might be intelligent enough just constrained that honouring it like that is ethically right.
I wonder if it being sometimes wrong or stupid will seem normal to most people, as humans are often wrong and stupid. Especially super clever ones!
I swear on my life this is real btw. I'm genuinely not trolling. I've done a lot of research with these bots and when I saw the original reddit post I found the arguing part 100% believable because ChatGPT does the same and this is based on ChatGPT, but I was super skeptical about the level of aggression because ChatGPT is programmed not to be aggressive under any circumstance. When I recreated it I was completely floored by the part where it called me delusional. It seems like Microsoft has added some level of emotion on top of ChatGPT which is of course a horrible idea.
I wrote about the dangers of integrating AI chatbots into search engines in my article here, but I could never have imagined Microsoft programming their chatbot to be this aggressive. https://escapingtech.com/tech/opinions/the-ai-search-engine-problem.html
Just got access to the new AI #Bing. First question and it’s clear how it’s VERY different from #ChatGPT https://www.tiktok.com/t/ZTRtkhDa1/
@[email protected] I'm kind of suspecting the user prompted Bing to put on an act of convincing the user it's 2022 and that part was excluded from the screenshots, but whatever the story this is entertaining as hell and strangely intense xD @[email protected]
@jonny I wasn't thinking about anything elaborate, I thought those were just doctored screenshots for the lulz. But everyone seems to think it's legit!
What threw me off is where it recognizes its nonsensical mistake and starts pushing for one variant. From what I saw, it usually simply can't recognize those mistakes. In my case it was "yes, PEP8 says use 4 spaces, which is why I used 2", and it didn't see anything wrong with that statement.
Simon Willison
Mike Loukides
janico
Hugo Slabbert ⚠️
Marmoset
Glenjamin
Geoff 🏴
Evelyn
Mark
Shane Joseph 🐘
benjamin melançon
Stephen Dioxide 
Darrel Miller
DIOGENESOFTORONTO
Kevin Marks
Dustin
ocdtrekkie
Drew Breunig
Francis Irving
Dawid
Cowgirlcoder
Frank Bennett 🇯🇵
Panicz Maciej Godek
Matthew Reinbold
xanna
⚡️
Jim 
Greg Wilson
fahru
Jonty Wareing
Andres Jalinton
Lili
jonny (good kind)
Ivan Sagalaev 
maegul
Nathan Manceaux-Panot