Apple Intelligence in 15.1 just flagged a phishing email as “Priority” and moved it to the top of my Inbox. This seems… bad
(If you’re at Apple, by using the wild new 'Rate Your Experiences’ feedback system I apparently filed a bug on this: FB14656882)

In a hilarious follow-up, my dad forwarded me a phishing email just to check with me if it was legitimate. I wrote back and said “Definitely not!”. He wrote back and explained, "I got suspicious.”

This is how Apple Intelligence summarized my dad’s emai

@cabel the call is coming from inside the house!

@cabel … your dad is running the beta?

Or does intelligence show summaries for outbound?

@jason @cabel summaries for inbound. He sent me the email that said “I got suspcious” and this was my summary.
@cabel 🤦🏼‍♂️🤦🏼‍♂️🤦🏼‍♂️
@cabel AI, whether Apple “Intelligence” or whatever is just so bad. So not ready for prime time. This will tank APPL when it launches.
@cabel Absolutely terrifying.
@cabel Hey, it's probably a priority for somebody!
@cabel “AI” isn’t ready. And if it can fool a person, it’s certainly gonna fool a 1 year old after an extreme training regimen of 1 month.
@cabel Apple Intelligence is recognizing those words as an important account notification.
Apple Wisdom is knowing not to click on it.
@SasquatcherGeneral @cabel And I'm rolling an Apple Dexterity check to get the Magic Mouse to right click on it. (Oooh, critical fail! It's off in a Space of its own now.)
@cabel How does this kind of thing not get tested?!
@michaelgemar @cabel that's the problem with AIs: by definition, they can't be tested entirely, because nobody really knows what they will reply to a given request. They only give replies based on some probabilities ("predictions") that have been computed from data before.
@Deuchnord @cabel Right, but these issues crop up *so* quickly after their release — are they not testing at all, or at least some obvious edge cases? I feel like no one is internally “red teaming” these models.
@michaelgemar @cabel well, at least, we're speaking about a feature expected to be available for iOS 15.1, in October-November 2024. I suppose Apple will try to fix that, even though it will be hard...
@Deuchnord @cabel I would have hoped these highly-publicized features would be more fully baked before even releasing them as betas.
@cabel How is no one else in this thread not talking about your frequent pork bun issues that need attention?!
@patc Hahahahah Ramp really needs me to provide my Pork Bun receipts —Normal Work Sentence
@cabel Is it easy to turn off the AI stuff? 😨
@aegir Fortunately, yes! Which is great. It’s one checkbox:

@cabel @aegir Thanks, I’ve been wondering about this ever since WWDC!

Does it turn off Siri too? In other words, is Apple Intelligence now a hard requirement for continuing to use Siri? Just curious.

@cabel so intelligent.  

Do not want 

@cabel Guess that’s not really a surprise to anyone. Has anyone found a use case or implementation of AI that couldn’t be done better without it?
@cabel and humanity is burning down the rainforests for this smdh
@cabel The spam filter is also broken for a few months now (and sadly still not fixed) :/ (what the frick is Apple's mail team doing?)
@cabel I would never ever rely on it
@cabel what if its a plot by apple so people think microsoft is a scam
@cabel @ismh86
Okay, I am not sad anymore for (initially?) missing out on these features due to living in the EU…
/cc @gruber
@cabel This has been my experience with AI in a nutshell: it’s always going to be slightly bad enough to be horribly wrong.
@cabel answers the question of “if AI is so good why do I still get spam”
@cabel it is Not ready for public release yet, obviously. Oh wait it’s also Beta.
Isn’t that the purpose of Beta software?
@iVeryAm yep! That’s why I’m posting.
@cabel I guess that’s why it’s a beta.
@cabel can you disable Apple intelligence from working in specified apps?
@danielinoa It doesn’t appear so. All or nothing.
@cabel Apple is pretty shit, their UI sucks and is buggy. And they often have code issues like those, or worse. I don't understand why people still uses and pays them...
@cabel We’re moving quickly towards an AI vs AI world. Soon you won’t be able to trust anyone who isn’t standing right in front of you.
@cabel if you are a security researcher / spam blocker this _may_ be on your priority list.
@cabel I’ve found the iMessage notification summaries to be laughably bad too. Misinterprets some part of the message like a quarter of the time maybe? Hard to tell because it stands out so clearly compared to the times it does it well.
@cabel just return back me the dumb af simple inbox as it was in 1990's and I can sort it out. No apples, no pears, no windows :)
@cabel as someone who is also asked to verify the legitimacy of emails, I hope this tool improves or it’ll exacerbate an already big problem with phishing email attacks
@cabel @designatednerd If you have Feedback assistant, I’ve been asked to supply more context on how it’s doing in Feedback assistant for summarization.

@cabel so far on my end it almost seems like somebody accidentally left a negative value in the proverbial "target priority" variable lol.

... on a serious note though, given what we know about LLMs... how could they ever be actually good at junk mail parsing ???

*unless* you really did prompt...

"everything *you* gauge to be a priority goes straight to junk and all the stuff you were junking before gets flagged."