Brendan Nyhan

Friends don't let friends ruin their experiments by dropping participants who fail manipulation checks - new illustration in JEPS https://tinyurl.com/3zxt6u6w

See our AJPS - How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It
https://tinyurl.com/yz4dbbuw

Jul 5, 2023 at 12:31pmElk
Show threadCDR Sir Samuel VimesJul 5, 2023
@brendannyhan Pscience!
Show threadMike BabyakJul 5, 2023

@brendannyhan Occurs to me you might find this forum of interest. Some of the best minds in design and analysis hang out here.

https://discourse.datamethods.org/

Datamethods Discussion Forum

This is a place for discussions and Q&A about data-related issues and quantitative methods including study design, data analysis, and interpretation.

Datamethods Discussion Forum
Show threadTom StaffordJul 10, 2023
@brendannyhan surely this should be ..."by dropping participants who fail [post-treatment] manipulation checks"?
Show threadBrendan NyhanJul 10, 2023
@tomstafford for sure. by definition, manipulation checks have to be post-treatment! (unless you have space-time powers I do not...)
Show threadTom StaffordJul 10, 2023
@brendannyhan sorry - my bad! In my head I read "attention checks", which can be pre treatment. Apologies