Growl

YouTube

Can thinking aloud accurately capture how we decide?

Nisbet & Wilson's 1977 paper famously suggested it can't.

But #NLP and #AI methods may indicate that it can:
- https://escholarship.org/uc/item/4sb936m3
- https://openreview.net/forum?id=1Tny4KgGO2

#cogSci #psychology #philosophy #surveyMethods #thinkAloud #LLM

How do #pharmacists think about #prescription checking?

This #thinkAloud study recorded their thoughts as they checked!

The default strategy was pattern matching, with more reflective thinking in atypical situations.

https://doi.org/10.1016/j.rcsop.2025.100569

#medicine #cogSci #metacognition

Can we think aloud without disrupting stream of #consciousness?

Two studies (Ns > 100) extended our results suggesting that we can — this time for DOZENS of aspects of thought!

Scientists are running out of good reasons to not use #thinkAloud protocols: https://doi.org/10.1016/j.concog.2025.103815

What else can #psychology's #thinkAloud studies do? Design #AI!

Recording people think out loud inspired distinctions between three different types of questions: surface, testing, and deep.

So they made a series of modules (QASA) corresponding to each type: associative selection, rationale generation, and systematic composition.

The results? QASA "outperform[ed] the state-of-the-art #InstructGPT by a big margin."

https://openreview.net/forum?id=5ud0h8OXwD

#ML #LLM #processTracing #computerScience #cogSci

QASA: Advanced Question Answering on Scientific Articles

Reasoning is the crux of intellectual thinking. While question answering (QA) tasks are prolific with various computational models and benchmark datasets, they mostly tackle factoid or shallow QA...

OpenReview

Hey #survey #methods colleagues,

What survey instrument or test would you be interested in testing/validating/calibrating using #thinkAloud protocols?

We can quickly and easily train people to read and think all of their (conscious) thoughts aloud and then record them take an #onlineSurvey (which automatically transcribes their speech into text).

This can reveal alot about the order, accessibility, and articulability of what they're thinking during our surveys (e.g., https://www.researchgate.net/publication/341131477_Tell_Us_What_You_Really_Think_A_think_aloud_protocol_analysis_of_the_verbal_cognitive_reflection_test).