CorrieNov 16, 2022
Michael Frank

Developmentalists: have you been wondering if online experiments with young children are comparable to in-lab studies? Here's our new meta-analysis suggesting that overall they are!

https://psyarxiv.com/qc6fw - work by Aaron Chuey, @[email protected] and @[email protected]

Nov 16, 2022 at 1:31amWeb
Show threadYael NivNov 16, 2022

@mcxfrank Thank you! this is great to know (and be able to cite)!

Is Cate Hartley on here?

Show threadMichael FrankNov 16, 2022
@Yael thanks! on here meaning on mastodon or on the paper?
Show threadYael NivNov 16, 2022
@mcxfrank on mastodon :)
Show threadKate NussenbaumNov 16, 2022
@Yael @mcxfrank Cate and our Hartley Lab twitter account have not yet made the mastodon leap. This looks great and in line with our observations in older kids and teens.
Show threadjepustoNov 17, 2022
@mcxfrank looks really interesting. Have y’all looked at how size of method effects (online - lab) might vary by magnitude of primary effect?
Show threadMichael FrankNov 17, 2022
@jepusto great point. We haven’t… for better or worse all the effects we looked at were positive. Some had magnitudes that weren’t obviously interpretable and wouldn’t have been included in a standard MA (eg a single measure of some phenomenon) but we converted them to ES based on comparison with norms so that we could compare the difference in this meta regression… that might complicate things…
Show threadjepustoNov 17, 2022
@mcxfrank yeah that seems like it would complicate things (but perhaps could look at the primary ES for a subset of studies where this was less of an issue?). The reason I ask is that there’s evidence that ES heterogeneity increases with average ES magnitude, so I wonder whether these sort of method/platform could be more apparent with stronger primary effects.