I am begging AI researchers trying to study human impact to get very rapidly better at methodology so I don't constantly read halfway through these papers only to find some ridiculous experiment design that will throw the conclusions into the air.

@mttaggart
It's so annoying. The study you linked has soooo many problems:

1. small sample size
2. online replication with an even smaller sample size, not included in the results for reasons unspecified
3. study questions were not published, so they cannot be reviewed
4. declaring that "cognitive surrender" is different from cognitive offloading with no formal explanation of how and why
5. does not talk about research in 2011 and 2018 regarding the "google effect" of reduced working memory when you know a search engine is available, something you would think woukd be obvious prior work to cite
6. does not do a study group of JUST chatbots taking the test to compare against the human + chatbot group
7. subjective self assessment
8. "fast," "medium" and "slow" used without definitions

and that's just from skimming it...