I downloaded a scientific paper of great interest to me. It is of typical length, about 15 pages in the PDF. I opened it in Acrobat, and got this message highlighted at the top of the page next to an AI sparkle icon: "This appears to be a long document. Save time by reading a summary." I cannot put into words how much this enrages me. First, this is not a long document. Have you met documents? Second, and more important, telling someone to not read a thing they want to read??! Fuck you, Adobe.
@annaleen not only that, but the summary has probably a 50% likelihood of being wrong
@carolannie @annaleen But...but... maybe glue really *does* work to keep toppings on pizza!
@jmccyoung @carolannie @annaleen
I bet it does. The requirements for that answer didn't say the result had to be edible. Well, not explicitly. I think. That was a while ago, wasn't it?
@bjb @carolannie @annaleen I was thinking it was ages ago but it was just last May, less than a year! Time flies when the this-is-fine meme is reality. https://www.businessinsider.com/google-ai-glue-pizza-i-tried-it-2024-5
Google AI said to put glue in pizza, so I put glue in pizza

Google's AI Overviews suggested adding glue to pizza sauce. I tried it. And ate it. Here's what all this tells us about the future of the web.

Business Insider

@jmccyoung @carolannie @annaleen
"(Since I know you're wondering, yes, I did eat paste as a kid. I loved it. It was minty. I stopped only because of shame from the other first graders. But now I'm an adult and can't be shamed for eating glue pizza.)"

Oh my.

@carolannie @annaleen Your estimate seems a bit low for an LLM trying to parse a scientific paper.
@carolannie @annaleen was about to ask if you tried it. Am curious about real-world experience.

@ruedigergad @carolannie @annaleen I expects it will be abysmal. I tried on several very well known, very documented short texts (article, short essay). Really, things like "the tyranny of structurlessness". The AI (all of the common ones I tested: Claude, ChatGPT, Gemini, local ollama/deepseek...) gave extremely deep sounding and assured summaries, which were also horrible results, missing extremely important, often foundational nuances to the point of misinterpretation.
For things they must have been trained on.

So, AI (llm) summary is the same silver bullet than llm for defending your case in court. Worse than useless

@ruedigergad @carolannie @annaleen I haven't tried the one in Acrobat, but generally ChatGPT or Gemini do a good work at summarising. I don't think hallucinations are a big problem honestly (for summarisation , they are a big problem for other things) I maybe haven't used them extensively but I don't recall seeing any obvious errors when summarising a document. It's the critical evaluation that is probably a bit more limited, but again if you want a quick summary, probably you're not looking for that either, and the tool does the job.

Honestly, aside fron the initial "oh that's cool" novelty-item moment I would say that mostly it's faster and more efficient to quickly scan papers manually yourself but there are other uses.

@nicolaromano Hmmm, your experience is different from mine. Discussing generically, summaries seem to be either useless because too vague, or inaccurate. But I usually look at articles in botany or ecology and can spot errors easily.
@carolannie @annaleen also, does it know that an abstract already exists?

@annaleen this is the second time I've posted this meme today. I hate how often it's relevant.

https://sfba.social/@jamesmarshall/113919196349111364

James M. (@[email protected])

Attached: 1 image @[email protected]

SFBA.social
@annaleen also: I know how to skim a scientific paper myself, dammit! Read the abstract, look at the figures, and decide if any more of it is worth reading.

@kajord

Just goes to show you’re not dumb enough for Adobe AI… but they can help you with that… if you’ll only give them a chance. (joke) 🙂

@kajord @annaleen

Oh, come on.

You're just too lazy to let AI read the abstract for you.

@kajord @annaleen this is why my advisor taught me to put all the important points of the paper into the figure captions.

@annaleen

If an "Executive Summary" was appropriate the authors would have written one.

@the5thColumnist @annaleen
They have. It's the abstract right at the top.
@annaleen and scientific papers literally begin with an abstract!
@annaleen Wow, you are mad at Adobe. But in this time, making everyone dumber is the name of the game.
@annaleen Adobe can fuck right off. Any modern operating system can natively open PDFs, and even create them. So can your web browser, and probably a few other apps you already have installed on your device.
@RockyC @annaleen Your web browser probably includes an AI tool also.
@RockyC @annaleen I use Sumatra PDF as well as Firefox integrated PDF viewer. What is the best non-Adobe to fill out forms? I ran into this "click here to use AI" thing when I was using Adobe on a virtual machine to fill out tax forms. Adobe is generally a pain where you have to click through a lot of marketing garbage to get it to do the basic thing you want, so a replacement would be nice.

@mike805 “PDF forms” is a mess that includes several incompatible “standards”.

Firefox can be used to fill out at least some of those (the most common ones), but I think it can’t be used to e.g. create legal “e-signatures” (which seems to be even more of a mess than the forms, and I doubt even Acrobat supports all of those).

@annaleen I deal with a lot of land survey plans (eg diagrams) there is no real way for even humans to summarise them that’s useful and yet it keeps offering

@joannaholman @annaleen A book publisher tells me that they now have to provide alt text for all illustrations.

Which seems bonkers. If whatever-it-was could be adequately described by text then that's what the publisher would insist on, they wouldn't go to all the hassle of dealing with the illustration.

@annaleen Next up, the ereader: This is a very long book. Would you like a summary?
Hell no, Lord of the Rings is supposed to be long and all 3 books must be read.
#LOTR #AISucks
@alexblock @annaleen on the other hand, I might have paid for an AI video edit of the hobbit movie trilogy down to the critical 90 minutes.
@dplattsf @alexblock @annaleen I think it could be further shortened to a ninety second summary which allows you more time to get on with important things; like prompting AI with further prompts.
@Billybobbell @alexblock @annaleen the „how it should have ended“ crew have you covered. https://m.youtube.com/watch?v=JrKXH1CeXck
How The Hobbit Should Have Ended

YouTube

@alexblock @annaleen

"The most critical reader of all, myself, now finds many defects, minor and major, but being fortunately under no obligation either to review the book or to write it again, he will pass over these in silence, except one that has been noted by others: the book is too short."

@annaleen Evince. Free, Open Source, reads PDFS. Much faster than Acrobat. I use Acrobat myself, but I don't read documents in it.
@annaleen Ur post 2 long. Want AI sumry?
#SCNR
@newstik @annaleen has anyone tried a dictionary run through AI. I would guess it would go from Aard-vark (AI=Aardvark) to Zymotic (AI=Zymotic).
@annaleen Agree. Absolutely insulting every time it happens.

@annaleen What's even worse is when you work your way through creating a document and you export a .PDF of it only to be asked, "Would you like a summary of this document?"

It drives a person to new expletives.

@annaleen also scientific papers have an abstract! That the authors put a lot of care and thought into!
@jimbob @annaleen That was the first thing I thought: What if this thing skips the abstract and creates its own? Isn't that artificial stupidity?
@tasket @jimbob @annaleen can stupidity be artificial? Every sturidity is natural, even artificial 🤔

@annaleen sad thing is, I've met a PhD student who was literally doing this for his summaries for his thesis prep.

I was aghast, and he was proud of the laziness

@annaleen There was a time when, as a Linux user, I envied Acrobat Reader's UI responsiveness. That was a long time ago, and now I'll open a PDF in any browser before using the app when I'm using Windows at work. They keep making it worse!
@annaleen How are we supposed to teach students to read research papers when this garbage automatically pops up.? This is making everything 100x harder 🙅
@annaleen I don't say "they are the worst" solely for my own amusement.
@annaleen

How is it that so many non-tech people have Adobe Reader/Acrobat on their computers?

And I don't mean "why aren't they using Okular:" I know that most people aren't aware noncommercial software exists, let alone how to find the best.

What I mean is why aren't most Windows users using Edge? I thought modern Windows recommends Edge as the default PDF reader? A majority of Windows users also have Chrome installed. Edge and Chrome's PDF readers are far from perfect, but they were leagues better than Adobe even before the whole AI summary nonsense.

So how is it that so many non-tech folks seem to have ignored the perfectly functional PDF reader that is the
default on their system and installed a much worse one?

@2something @annaleen if I were to guess;

  • funkier pdf forms and "advanced" pdf features don't work in browser pdf viewers
  • browsers being able to open pdfs reliably is relatively new
  • corporate it installed it for them
@2something @annaleen We’re not just using it as a reader. My university requires us to electronically submit forms that must be done in Acrobat with all the supplemental material appended to the form document
@annaleen @briankrebs One of the many reason why I switched to FoxIt Reader. It also has AI features, but they are very easy to disable (IIRC, there was a hint in the program when I started it for the first time).
@annaleen I hate marketing hype, therefore I HATE AI. Mostly.
@annaleen This is why I use Okular. It's free, open source, and has all the PDF editing tools I need without any of the AI nonsense or bloat. In fact, most of the PC software I use is from @kde.
@annaleen plus, summary likely to be nonsense.
@annaleen
Hmm, so stop using Adobe? There are a lot of alternatives!
@annaleen boycott acrobat. Get a Mac and use Preview. No AI junk there. And what AI there is can be turned off (for now at least)
@SimonCHulse @annaleen Apple is a little behind, but trying to install Apple Intelligence everywhere.
@EricFielding @annaleen yes, but it can be turned off, you just opt out of it when you upgrade to the system that contains it/start a new computer/iOS device with it.