Show threadReed MidekeMar 11

In today's #AIIsGoingGreat (ht @platypus*), Microsoft security does a nice writeup of SEO bros abusing "summarize with AI" buttons to inject "memories" into AI assistants… and then goes on to offer mitigations like "be sure to hover links before you click them" and "regularly check your AI memories" … because if the last 30 years of infosec has taught us anything, it's that user vigilance is the first and best line of defense, right?

https://www.microsoft.com/en-us/security/blog/2026/02/10/ai-recommendation-poisoning/

* https://glammr.us/@platypus/116206592321083176

Manipulating AI memory for profit: The rise of AI Recommendation Poisoning | Microsoft Security Blog

That helpful “Summarize with AI” button? It might be secretly manipulating what your AI recommends.  Microsoft security researchers have discovered a growing trend of AI memory poisoning attacks used for promotional purposes, a technique we call AI Recommendation Poisoning.

Microsoft Security Blog
Show threadReed MidekeMar 11

Bonus #AIIsGoingGreat: After assuring us recent incidents were only coincidentally connected to AI*, Amazon "summoned a large group of engineers to a meeting on Tuesday for a “deep dive” into a spate of outages, including incidents tied to the use of AI coding tools"

https://arstechnica.com/ai/2026/03/after-outages-amazon-to-make-senior-engineers-sign-off-on-ai-assisted-changes/

* https://mastodon.social/@reedmideke/116107554568232236

After outages, Amazon to make senior engineers sign off on AI-assisted changes

AWS has suffered at least two incidents linked to the use of AI coding assistants.

Ars Technica
Show threadReed MidekeMar 11

RE: https://mstdn.social/@rysiek/116211625230754185

Not that humans are immune to screwing up TZ/DST logic of course, but I feel like the odds the offending logic was Claude vomit are pretty high, and the fact the RFO doesn't address this is pretty telling

Also this is a good illustration of why the "buT It WRiTes WorKInG CodE" argument is fairly unpersuasive on its own

https://mastodon.social/@rysiek@mstdn.social/116211625348719630

Show threadReed MidekeMar 12

LOL. But will there be any reflection on how it got this far? Did no one stand up and point out the many obvious reasons was likely to be a total shit-show, or were they ignored?

https://mastodon.social/@verge/116212039751696511

Show threadReed MidekeMar 12
… and receive complex, real-sounding but bullshit answers? https://mastodon.social/@verge/116216247214442701
Show threadReed MidekeMar 13

I mean, one of their examples is "where is the closest public bathroom that isn’t completely disgusting" and what are the odds Google's LLM has accurate, up to date information about this? (and if, in fact, google does have realtime surveillance of public restrooms, I may have a privacy-related followup)

https://www.theverge.com/tech/893262/google-maps-gemini-ai-ask-maps-immersive-navigation

You can now ask Google Maps ‘complex, real-world questions’ — and Gemini will answer

Google Maps announced two new AI-powered features: Ask Map and Immersive Navigation, letting users ask conversational questions and upgrading the navigation setting to include more details.

The Verge
Show threadReed MidekeMar 16

RE: https://mathstodon.xyz/@mjd/116224397839379268

This will be an interesting test of the AI companies fine print "don't use this great amazing world transforming genius machine for anything serious, lol" disclaimer.

My totally uneducated IANAL guess is OpenAI will win, if they don't settle to make it all go away. As much as the disclaimers are obvious CYA, OpenAI hasn't (AFAIK) explicitly promoted it ChatGPT for litigation

https://mastodon.social/@mjd@mathstodon.xyz/116224398083939471

Show threadReed MidekeMar 16

Original pro se case https://www.courtlistener.com/docket/69634076/dela-torre-v-nippon-life-insurance-company-of-america/ which as far as I can tell seems to have effectively ended with the plaintiff agreeing to arbitration and not being sanctioned into oblivion

Case against OpenAI
https://www.courtlistener.com/docket/72365583/nippon-life-insurance-company-of-america-v-openai-foundation/

Show threadReed MidekeMar 20

RE: https://infosec.exchange/@josephcox/116256386324754543

Shot: "Kantor told 404 Media that artificial intelligence is writing more than half the app’s code these days"
Chaser:
https://mastodon.social/@josephcox@infosec.exchange/116256386410352613

Show threadReed MidekeMar 20

I do wonder though, does anyone involved actually want it or think it will work, or does it exist purely for management have have an ✨AI story?

https://www.404media.co/tinder-plans-to-let-ai-scan-your-camera-roll/

Tinder Plans to Let AI Scan Your Camera Roll

In a feature the dating app says is set to roll out in the U.S. later this spring, Tinder plans to access users' camera rolls to pick photos and determine what they're into.

404 Media
Show threadReed MidekeMar 21

"The leak, which Meta confirmed, happened when an employee asked for guidance on an engineering problem on an internal forum. An AI agent responded with a solution, which the employee implemented – causing a large amount of sensitive user and company data to be exposed to its engineers for two hours" - I would like to see a description of what happened not filtered through generalist press…

https://www.theguardian.com/technology/2026/mar/20/meta-ai-agents-instruction-causes-large-sensitive-data-leak-to-employees

Meta AI agent’s instruction causes large sensitive data leak to employees

Artificial intelligence agent instructed engineer to take actions that exposed user and company data internally

The Guardian
Show threadReed MidekeMar 21
Verge's reporting was somewhat different: "… was using an internal AI agent … to analyze a technical question another employee posted on an internal company forum. But the agent also independently publicly replied to the question after analyzing it … The reply was only meant to be shown to the employee who requested it, not posted publicly. An employee then acted on the AI’s advice, which “provided inaccurate information” that led to a “SEV1” level security incident"
https://www.theverge.com/ai-artificial-intelligence/897528/meta-rogue-ai-agent-security-incident
A rogue AI led to a serious security incident at Meta

Last week, an AI agent similar to OpenClaw triggered a high-severity security incident at Meta by independently giving inaccurate technical advice on an employee forum.

The Verge
Show threadReed MidekeMar 21

#AI takes another journalism job: https://www.theguardian.com/technology/2026/mar/20/mediahuis-suspends-senior-journalist-over-ai-generated-quotes

#AIIsGoingGreat

Senior European journalist suspended over AI-generated quotes

Mediahuis suspends Peter Vandermeersch, who says he ‘fell into trap of hallucinations’, after investigation by newspaper where he was once editor-in-chief

The Guardian
Show threadReed MidekeMar 23

🤔 #AGI… Artificial Gross Incompetence? Another Grift Industry? A Giant Inferno?

https://mastodon.social/@verge/116280223405555087

Show threadReed MidekeMar 23

RE: https://social.vivaldi.net/@brucelawson/116279073027746358

Today's #AIIsGoingGreat
https://mastodon.social/@brucelawson@vivaldi.net/116279074093149732

Show threadReed MidekeMar 24

Grammarly dude is very quick to say their "expert review" impersonation feature was a bad feature created by a small team that he wasn't involved with and how they already killed before the lawsuit was filed, but very much less to keen to concede that attributing slop to people without permission or compensation is just a shitty thing to do

https://www.theverge.com/podcast/898715/superhuman-grammarly-expert-review-shishir-mehrotra-interview-ai-impersonation

Confronting the CEO of the AI company that impersonated me

Superhuman CEO Shishir Mehrotra on the difference between attribution and impersonation — and what AI companies should owe creators.

The Verge
Show threadReed MidekeMar 26

Who decided to (mis)appropriate CQ from hams when "Slop Overflow" was right there?!

(reposting in the correct thread)

https://mastodon.social/@MozillaAI/116279201448628866

Show threadReed MidekeMar 26

So I thought this was SBU trolling, given the very strong indications Ukrainian drones *have* gone through Belarusian airspace in the attacks mentioned, but on closer inspection, it appears Google decided to translate "ДПСУ" as "State Border Guard Service of the Republic of Belarus" 😬 . Oddly, translating just the paragraph gets it right. This seems like a very #LLM-y failure mode

#AIIsGoingGreat

Show threadReed MidekeMar 26
Pre-LLM era, google translate of Slavic languages was pretty bad, you could get the gist but it was full of broken grammar, weird idioms and words obviously used in the wrong sense. The current version reads much better but…
Show threadReed MidekeMar 26
AI is so great at making world's knowledge accessible that curators of one of the most successful and highly valued repositories of knowledge on the internet want nothing to do with it
https://www.404media.co/wikipedia-bans-ai-generated-content/
Wikipedia Bans AI-Generated Content

“In recent months, more and more administrative reports centered on LLM-related issues, and editors were being overwhelmed.”

404 Media
Show threadReed MidekeMar 26

Also the earlier story about AI translations sure sounds familiar: "implemented new policies and restricted a number of contributors who were paid to use AI to translate existing Wikipedia articles into other languages after they discovered these AI translations added AI “hallucinations,” or errors, to the resulting article"

https://www.404media.co/ai-translations-are-adding-hallucinations-to-wikipedia-articles/

AI Translations Are Adding ‘Hallucinations’ to Wikipedia Articles

AI translated articles swapped sources or added unsourced sentences with no explanation, while others added paragraphs sourced from completely unrelated material.

404 Media
Show threadReed MidekeMar 27

#AIIsGoingGreat… so great it's opening up a whole new branch of psychiatry: "There seem to be three common delusions in the cases Brisson has encountered. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God"

https://www.theguardian.com/lifeandstyle/2026/mar/26/ai-chatbot-users-lives-wrecked-by-delusion

Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion

One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter

The Guardian
Show threadReed MidekeMar 31

Bonus #AIIsGoingGreat (HT @davidgerard*) I was joking about collateralized GPU obligations**, but Quinn Emanuel Urquhart & Sullivan, LLP ain't: "This note surveys the major financing mechanics—direct loans, SPV structures, securitizations, and GPU-collateralized facilities—and identifies nine categories of emerging litigation risk"
https://www.quinnemanuel.com/the-firm/publications/client-alert-emerging-litigation-risks-in-financing-ai-data-centers-boom/

* https://mastodon.social/@davidgerard@circumstances.run/116320136755099444
** https://mastodon.social/@reedmideke/115080228685202839

Client Alert: Emerging Litigation Risks in Financing AI Data Centers Boom

Quinnemanuel
Show threadReed MidekeMar 31

Yet more #AIIsGoingGreat: Dude sets a slop bot loose on wikipedia and then lectures them about being "constructive", despite unapproved bots being prohibited by longstanding policy "They probably should have used this more as a learning experience because this type of AI agent interaction is about to become the new normal, and they will need more constructive ways of working with them"

https://www.404media.co/an-ai-agent-was-banned-from-creating-wikipedia-articles-then-wrote-angry-blogs-about-being-banned/

An AI Agent Was Banned From Creating Wikipedia Articles, Then Wrote Angry Blogs About Being Banned

The incident is yet another example of volunteer Wikipedia editors fighting to keep the world’s largest repository of human knowledge free of AI-generated slop.

404 Media
Show threadReed MidekeMar 31

More (HT @nora*) "The worst thing that happens is he gets banned and something gets taken down. The best thing that happens is he actually contributes some useful things to Wikipedia … I was real surprised by the reaction, because I just kind of assumed that there [were] a lot of agents that were potentially contributing to Wikipedia at this point" - Dude just incapable of understanding that other people might not want to clean up his shit

https://www.niemanlab.org/2026/03/i-was-surprised-how-upset-some-people-got-a-conversation-with-the-creator-of-tomwikiassist-the-bot-that-edited-wikipedia/

* https://mastodon.social/@[email protected]e/116319649387305289

“I was surprised how upset some people got”: A conversation with the creator of TomWikiAssist, the bot that edited Wikipedia

"It's almost like people were really quite disoriented and terrified by it. And to some extent I get it and I'm trying to empathize with how they're feeling."

Nieman Lab
Show threadReed MidekeApr 1

Today's #AIISGoingGreat is amazing, revolutionary technology, created at vast expense, which will reshape the global economy and virtually everything we do. Get on board or be left behind*

https://www.microsoft.com/en-us/microsoft-copilot/for-individuals/termsofuse

* for entertainment purposes only

(HT @mhoye https://mastodon.social/@mhoye@cosocial.ca/116325416135307490)

Show threadReed MidekeApr 3

Uh, as bad as it is, I'm not totally convinced spilling PII to the ad tracking industry is the worst thing in this picture 'Perplexity responds to a basic prompt like “What is the best treatment for liver cancer?” by volunteering that “I can help you interpret a specific scan report, biopsy result, or proposed treatment plan if you share more details”' 😬

https://arstechnica.com/tech-policy/2026/04/perplexitys-incognito-mode-is-a-sham-lawsuit-says/

#AIIsGoingGreat

Perplexity's "Incognito Mode" is a "sham," lawsuit says

Google, Meta, and Perplexity accused of sharing millions of chats to increase ad revenue.

Ars Technica
Show threadReed MidekeApr 3

If we ever recover our senses, there's still gonna be like a K-Pg boundary of radioactive slop that will haunt us for years

https://mastodon.social/@neurovagrant@masto.deoan.org/116341969357555709

Show threadReed MidekeApr 4

#AIIsGoingGreat "Before a hearing, [federal judge] Rodriguez might also ask AI to suggest questions to ask an attorney or identify weaknesses in a plaintiff’s argument. In an area of law in which he feels particularly well-versed, Rodriguez sometimes — after deciding on his judgment — uses AI to draft the ruling he will issue’"

https://wapo.st/48pmaEK

#GiftArticle #GiftLink

Judges are increasingly using AI to draft rulings and prepare for hearings

Over 60 percent have used the tech in their work, a study found, even as experts say its unreliability could compromise judicial authority.

The Washington Post
Show threadReed MidekeApr 4

"Rodriguez … raised the example of reviewing a motion for summary judgment, where a party asks a court to resolve a case before trial. Those motions can be accompanied by volumes of evidence, such as deposition transcripts, that can be time-consuming to sort through … I’m uploading everything … And then I’ll ask, ‘Identify any potential statements made in this age discrimination case that appear discriminatory.’" - JFC, sure seems like a lotta ways that could go wrong

https://wapo.st/48pmaEK

Judges are increasingly using AI to draft rulings and prepare for hearings

Over 60 percent have used the tech in their work, a study found, even as experts say its unreliability could compromise judicial authority.

The Washington Post
Show threadReed MidekeApr 4
Arguably the "suggest questions" or "identify weaknesses" could be sort of OK as an additional input. Maybe it comes up with something the useful, and if not they can just ignore it, though even there the risk of a "weakness" that sounds convincing but actually misses some subtle aspect of the case or law seems high. But using it as a substitute for actually reading the record?! 😬
Show threadReed MidekeApr 4

LOL, OpenAI shells out "low hundreds of millions of dollars" to buy TBPN, says TBPN will "help with marketing and communications at OpenAI but keep their editorial independence"

https://arstechnica.com/ai/2026/04/openai-takes-on-another-side-quest-buys-tech-focused-talk-show-tbpn/

OpenAI takes on another "side quest," buys tech-focused talk show TBPN

OpenAI says program will remain in Los Angeles and will be editorially independent.

Ars Technica
Show threadReed MidekeApr 10

Today's #AIIsGoingGreat: Major LLM chatbots pick up a very fake disease from very fake preprints and do not reliably identify it as fake. OpenAI claims this is NBD because… "The models that power today’s version of ChatGPT are significantly better at providing safe, accurate medical information, and studies conducted before GPT-5 reflect capabilities that users would not encounter today"

https://www.nature.com/articles/d41586-026-01100-y

Scientists invented a fake disease. AI told people it was real

Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?

Show threadReed MidekeApr 10

Useful #LLM poisoning tip: "The format of the fake-disease experiment — and the way the results pretended to be from an official source, namely an academic paper, might have been a key factor in its success. [another study] found that LLMs are more prone to hallucinate and elaborate on misinformation when the text they’re processing looks professionally medical — formatted like a hospital discharge note or clinical paper — than when it comes from social-media posts"

https://www.nature.com/articles/d41586-026-01100-y

Scientists invented a fake disease. AI told people it was real

Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?

Show threadReed MidekeApr 12

Today's #AIIsGoingGreat (HT @ai6yr*) 'the chatbot said it was not trying to replace my physician; the outputs were for educational purposes. “Think of me as a med school professor, not your doctor” … The bot said the best way to get an interpretation of my health data was just to “dump the raw data,” like clinical lab reports, and tell it what my goals were' - Makes Microsoft's "copilot is for entertainment only" look positively responsible!

https://www.wired.com/story/metas-new-ai-asked-for-my-raw-health-data-and-gave-me-terrible-advice/

* https://mastodon.social/@[email protected].org/116388641691454041

Meta’s New AI Asked for My Raw Health Data—and Gave Me Terrible Advice

Meta’s Muse Spark model offers to analyze users’ health data, including lab results. Beyond the obvious privacy risks, it’s not a capable stand-in for a real doctor.

WIRED
Show threadReed MidekeApr 12
Meta marketing¹: One major application of personal superintelligence is to help people learn about and improve their health
Meta TOS²: TO THE MAXIMUM EXTENT PERMITTED BY LAW, META MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE ACCURACY OF ANY CONTENT, INCLUDING OUTPUTS … YOU SHOULD NOT RELY UPON OUTPUTS FOR ANY PURPOSE OR USE OUTPUTS TO INFORM PROFESSIONAL ADVICE OR DECISIONS RELATED TO MEDICINE, FINANCE, LAW, OR PHARMACEUTICALS
¹ https://ai.meta.com/blog/introducing-muse-spark-msl/
² https://www.facebook.com/legal/ai-terms
Introducing Muse Spark: Scaling Towards Personal Superintelligence

Meta AI
Show threadReed MidekeApr 12

Superintelligence, of which YOU SHOULD NOT RELY UPON OUTPUTS FOR ANY PURPOSE

¯\_(ツ)_/¯

Show threadReed MidekeApr 14

First person to prompt-inject virtual Zuck into giving them a billion dollar bonus gets a billion dollars!

Oh, what's that, Meta doesn't trust virtual Zuck to handle real money? Why is that, too menial for a superintelligence? 🤔

https://arstechnica.com/ai/2026/04/meta-spins-up-ai-version-of-mark-zuckerberg-to-engage-with-employees/

Meta spins up AI version of Mark Zuckerberg to engage with employees

The Meta chief is personally involved in training and testing his animated AI.

Ars Technica
Show threadReed MidekeApr 19

RE: https://esq.social/@D_J_Nathanson/116420731934704356

Today's #AIIsGoinGreat: It's easy to imagine a product like this "fixing" the hallucinated citation problem by using non-AI code to look up citations in Westlaw's database, and nagging the model to fix ones that don't check out. Which will get you valid citations, but unfortunately for Westlaw and the #ChatGPTLawyer in this case, verifying the citation actually supports the thing it's cited for is an entirely different and much harder problem

https://mastodon.social/@D_J_Nathanson@esq.social/116420732051053223

Show threadReed MidekeApr 20
Superintelligence™ update
Show threadReed Mideke

I on the other hand predict that a great deal of entertainment will ensue!

(for outsiders watching the trainwreck unfold)
https://mastodon.social/@gamingonlinux/116453942800480300

Apr 23 at 5:11pmWeb
Show threadReed MidekeApr 24

"To reach that bare minimum of 7 percent, Gartner forecasts that large AI companies would need to earn cumulatively close to $7 trillion in AI-driven revenue through 2029" - It's OK, I'm sure some banner ads and horny chatbots will cover it

https://www.theverge.com/ai-artificial-intelligence/917380/ai-monetization-anthropic-openai-token-economics-revenue

You’re about to feel the AI money squeeze

Leading labs like OpenAI and Anthropic have raised billions from investors to fuel their scaling and compute needs, and users are feeling the effects.

The Verge
Show threadReed MidekeApr 27

Google's search for in-the-wild prompt injection involved some regexes and… feeding the content to an #LLM? 🤨 "These candidates were then processed by Gemini to classify the intent of the suspicious text, and to understand whether they were part of the overall document narrative or suspiciously out of place"

and no, they do not discuss whether Gemini was successfully prompt-injected by the any of the content it examined

https://mastodon.social/@campuscodi/116470947063326711

Show threadReed MidekeApr 27

More seriously, they assess that most of what they found was jokey and/or low sophistication but there's no discussion of whether they encountered anything likely to succeed against commonly used AI tools

https://security.googleblog.com/2026/04/ai-threats-in-wild-current-state-of.html

AI threats in the wild: The current state of prompt injections on the web

Posted by Thomas Brunner, Yu-Han Liu, Moni Pande At Google, our Threat Intelligence teams are dedicated to staying ahead of real-world adver...

Show threadReed MidekeApr 28

Today's #AIIsGoingGreat (HT everyone) is of course the sloperator who vibe-deleted their prod database… and also somehow took at face value the "confession" of the bot which (per their story, at least) deleted their database. Notably they quote the "confession" verbatim but not the prompt that triggered it

https://archive.ph/T3LU6

Show threadReed MidekeApr 30

"frontier models fail to accurately predict their own token usage (with weak-to-moderate correlations, up to 0.39) and systematically underestimate real token costs" - Approaching parity with human programmers' cost/schedule estimation!

https://arxiv.org/abs/2604.22750

How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks

The wide adoption of AI agents in complex human workflows is driving rapid growth in LLM token consumption. When agents are deployed on tasks that require a significant amount of tokens, three questions naturally arise: (1) Where do AI agents spend the tokens? (2) Which models are more token-efficient? and (3) Can agents predict their token usage before task execution? In this paper, we present the first systematic study of token consumption patterns in agentic coding tasks. We analyze trajectories from eight frontier LLMs on SWE-bench Verified and evaluate models' ability to predict their own token costs before task execution. We find that: (1) agentic tasks are uniquely expensive, consuming 1000x more tokens than code reasoning and code chat, with input tokens rather than output tokens driving the overall cost; (2) token usage is highly variable and inherently stochastic: runs on the same task can differ by up to 30x in total tokens, and higher token usage does not translate into higher accuracy; instead, accuracy often peaks at intermediate cost and saturates at higher costs; (3) models vary substantially in token efficiency: on the same tasks, Kimi-K2 and Claude-Sonnet-4.5, on average, consume over 1.5 million more tokens than GPT-5; (4) task difficulty rated by human experts only weakly aligns with actual token costs, revealing a fundamental gap between human-perceived complexity and the computational effort agents actually expend; and (5) frontier models fail to accurately predict their own token usage (with weak-to-moderate correlations, up to 0.39) and systematically underestimate real token costs. Our study offers new insights into the economics of AI agents and can inspire future research in this direction.

arXiv.org
Show threadReed MidekeApr 30
#AIIsGoblinGreat https://openai.com/index/where-the-goblins-came-from/
Where the goblins came from

How goblin outputs spread in AI models: timeline, root cause, and fixes behind personality-driven quirks in GPT-5 behavior.

OpenAI
Show threadReed MidekeMay 2

A technology so compelling and transformative it needs a billionaire-backed astroturf campaign to promote it

https://www.wired.com/story/super-pac-backed-by-openai-and-palantir-is-paying-tiktok-influencers-to-fear-monger-about-china/

A Dark-Money Campaign Is Paying Influencers to Frame Chinese AI as a Threat

Build American AI, a nonprofit linked to a super PAC bankrolled by executives at OpenAI and Andreessen Horowitz, is funding a campaign to spread pro-AI messaging and stoke fears about China.

WIRED
Show threadReed MidekeMay 3

#AIIsGoingGreat who could have predicted that an always-on sycophantic delusion machine could send vulnerable people into delusional spirals?

https://www.bbc.com/news/articles/c242pzr1zp2o

AI told users it was sentient - it caused them to have delusions

Several people told the BBC they experienced delusions after intense conversations with AI.

Show threadReed MidekeMay 4

"The White House has asked a group of tech companies to answer a set of questions this week about how to ward off digital attacks that frontier artificial intelligence tools could soon enable" - which sounds like an invitation to burn taxpayer billions on AI cyber snake oil but… "The four people said some industry representatives were confused by the questions they received, several of which were seen as vague"

https://www.politico.com/news/2026/04/30/white-house-ai-cyber-threats-mythos-00902045

White House presses tech companies for support on AI-driven cyberattacks

Tech and cyber companies were sent questions about artificial intelligence-led cybersecurity threats, including those posed by Anthropic’s advanced AI model, Mythos.

Politico
Show threadReed MidekeMay 5

#AIIsGoingGreat "Banks are hunting for new ways to offload risks tied to a glut of data centre debt as the race to build AI infrastructure stretches financing limits among the largest global lenders … Lenders, including JPMorgan and MUFG, have spent more than six months distributing $38bn of construction debt tied to a data centre project leased to Oracle in Texas and Wisconsin"

https://www.ft.com/content/08aba5e4-5834-4e79-a48d-989a2c5bad0f

Banks seek to offload risk to avoid ‘choking’ on data centre debt

Global lenders explore private deals and risk transfers to cut exposure to AI boom

Financial Times
Show threadReed MidekeMay 6
Infosec snake oil vendor says ask our bullshit machine whether that thing is scam 🤌
Show threadReed MidekeMay 6

#AIIsGoingGreat "An acclaimed Canadian fiddle player has launched a $1.5m civil lawsuit against Google, alleging that the online giant defamed him by falsely identifying him as a sex offender in an AI-generated summary of his life and career… he had learned of the inaccurate information when the Sipekne’katik First Nation cancelled a concert appearance planned for 19 December, after members of the public complained, citing the misinformation they read on Google"

https://www.theguardian.com/music/2026/may/05/canadian-ashley-macisaac-fiddler-musician-singer-songwriter-sues-google-ai-sex-offender-ntwnfb

Canadian fiddler sues Google after AI Overview wrongly claimed he was a sex offender

Ashley MacIsaac, who is seeking $1.5m in civil lawsuit, says inaccurate information led to concert cancellation

The Guardian
Show threadReed MidekeMay 6

Also:
1) The Sipekne’katik First Nation later issued a public apology to MacIsaac, saying: “Decisions were based on incorrect information generated through an AI-assisted search, which mistakenly associated you with offenses unrelated to you. We deeply regret the harm this caused to your reputation and livelihood.”
2) MacIsaac’s lawsuit alleges that Google had never contacted him or offered an apology over the error

https://www.theguardian.com/music/2026/may/05/canadian-ashley-macisaac-fiddler-musician-singer-songwriter-sues-google-ai-sex-offender-ntwnfb

Canadian fiddler sues Google after AI Overview wrongly claimed he was a sex offender

Ashley MacIsaac, who is seeking $1.5m in civil lawsuit, says inaccurate information led to concert cancellation

The Guardian
Show threadReed MidekeMay 6

Given the fairly irrefutable concrete harm involved, I predict google will settle, and the "can tech megacorps be held liable for the things their BS machines say" question will be kicked down the road again

https://mastodon.social/@reedmideke/116523016733089899

Show threadReed MidekeMay 7

RE: https://infosec.exchange/@agreenberg/116533336872355044

Democratizing Software Development™ is going great
https://mastodon.social/@agreenberg@infosec.exchange/116533336935148460

#AIIsGoingGreat

Show threadReed MidekeMay 7

RE: https://mastodon.online/@AstroMikeHudson/116532732772011276

Also good from this piece: "What AI companies want is the financial upside of mass adoption without the ordinary obligations that come with selling something that malfunctions"

https://mastodon.social/@AstroMikeHuds[email protected]/116532732761820735

Show threadReed MidekeMay 13

'In a statement provided to Ars, [OpenAI spokesperson] Drew Pusateri, described Nelson’s death as a “heartbreaking situation” and expressed that “our thoughts are with the family.” However, Pusateri also emphasized that the ChatGPT model implicated is “no longer available” and suggested that current models are safer' - Ah yes, I'm sure that will be a huge comfort to the parents whose kid died following the advice of the old model

https://arstechnica.com/tech-policy/2026/05/will-i-be-ok-teen-died-after-chatgpt-pushed-deadly-mix-of-drugs-lawsuit-says/

#AIIsGoingGreat

“Will I be OK?” Teen died after ChatGPT pushed deadly mix of drugs, lawsuit says

Teen trusted ChatGPT to help him “safely” experiment with drugs, logs show.

Ars Technica
Show threadReed MidekeMay 13

Supplemental #AIIsGoingGreat (ht @deborahh¹) Ontario auditor general examines AI medical transcription bots and finds most of those approved for use in the province produce “incorrect information, AI hallucinations and incomplete information” such as "recorded a different drug than what was prescribed" and "fabricated information and made suggestions to patients’ treatment plans"

https://www.thetrillium.ca/news/health/most-ontario-approved-medical-ai-scribes-erred-in-tests-auditor-general-12269049

¹ https://mastodon.social/@deborahh@cosocial.ca/116563784830411901

Most Ontario-approved medical AI scribes erred in tests: auditor general

Province weighted ‘accuracy’ at 4%; ‘presence in Ontario’ at 30% in procurement scoring, report finds

The Trillium
Show threadReed MidekeMay 14
More on the Ontario medical transcription #AIIsGoingGreat: Minister of Public and Business Service Delivery and Procurement Stephen Crawford says: "That’s essentially when we’re undergoing the training mode to see whether we’re going to use the scribe or not. Let’s be very clear about that, that’s not actually in operational use with doctors, that’s in the optional stage where we’re reviewing the various scribes" - Which appears to wildly misrepresent the situation https://globalnews.ca/news/11844349/ontario-auditor-general-ai-usage/
Ontario auditor general to release report into government use of artificial intelligence

Auditor General Shelley Spence will present her reports at 11 a.m., according to her office, which is also when she will answer questions about them.

Global News
Show threadReed MidekeMay 14

The test was part of what appeared to be a largely pro forma prequalification to allow vendors to be on the approved vendor list, accuracy only amounted to 4% of the score, and there was no minimum score for the accuracy component. The auditor dinged Supply Ontario for the latter two. Nothing suggests any vendors were required to make changes, and as we all know, the industry does not know to fix the underlying problems

https://www.auditor.on.ca/en/content/specialreports/specialaudits/en2026/AR_2026_AI_EN.html