Nick Byrd, Ph.D.How can researchers overcome #AcquiescenceBias?
In a #questionnaire, acquiescence is a tendency to agree with statements or answer affirmatively regardless of survey content.
Alvarado-Leiton et al. report simple ways to mitigate it.
Do professors with less PC views self-censor?
Clark et al. reported only the linear relationship: the less PC their view, the more reluctant professors were to share it. Kudos to Clark et al. for publishing their data so Luke could detect a better-fitting non-linear, non-unified explanation: most professors were not self-censoring; they were either uncertain or else unreluctant to share.
https://doi.org/10.31234/osf.io/ab34v
#edu #higherEd #psychMethods #logic #replicability #manyAnalysts #metaScience
Surprised this conclusion survived #peerReview: a "program succeeded in promoting positive attitudes and beliefs" about "#implicitBias #education ...among ...police" (N = 145).
The 1st survey was online, but the 2nd was in-person. And the 1st survey's questions weren't about the same trainings as the 2nd survey's.
So any differences in answers are as explainable by differences between the surveys as they are by one #education program.
When people ask me how to estimate the sample size needed for their research question, my answers fall broadly into two buckets: power analysis and precision for planning analysis. But there seem to be other options as well.
What's your preferred method?
Preferred software? (Or software package?)
In research, how do you determine the ideal sample size?
Nick Byrd's answer: There are a few ways to estimate the sample size needed for a hypothesis, both of which require you to find out what kind of results you expect. 1. Power analysis. First, you need to figure out what effect size you expect to find (e.g., by looking at past research about the k...
Are you more likely to fall for trick (reflection test) questions on a smartphone or PC?
Turned out it didn't make a difference unless you let people self-select which device they used — and even that difference was better explained by gender and self-reported intuitive decision style.
Remember that "...WEIRDest people in the world" paper?
Now #xPhi has one: Of "171 experimental philosophy studies [from] 2017 [to] 2023 [including one of mine] most ...tested only Western populations but generalized beyond them without justification."
Incentives may be part of the issue: "studies with broader conclusions ...had higher citation impact."
"Deontological and absolutist moral dilemma judgments convey self-righteousness" in U.S., German-speaking, and British participants (N = 1254).
In the Journal of Experimental Social Psychology: https://doi.org/10.1016/j.jesp.2023.104505
#ProcessDissociation #DecisionScience #psychMethods #moralPsychology #xPhi
#Civicbase brings upvoting and downvoting to preference measurement—but with a budget.
Participants can select or agree or disagree buttons (up to 7 times) to allocate a limited voting credits (that carry over to future studies?).
May reveal priorities that Likert scales and ranked-choices cannot.
https://doi.org/10.1002/aaai.12103
Presumably, this could be used for all sorts of preferences (beyond civics/politics).
#measurement #PsychMethods #openSource #decisionScience #poliSci #cogSci #gamification
How do we know what participants thought when we presented our stimuli?
#ProcessTracing can reveal what people saw (e.g., eye-tracking), consciously thought (e.g., concurrent think-aloud), etc.
Combining those two methods revealed:
(1) thinking aloud didn't impact gaze or word count
(2) retrospective think-aloud left out thoughts that were mentioned concurrently
(3) retrospective think-aloud introduced thoughts unmentioned concurrently
Mark RubinPlanning a longitudinal study? Here’s four questions you should ask:
🔹 How should time be scaled?
🔹 How many assessments are needed?
🔹 How frequently should assessments occur?
🔹 When should assessments happen?
Hopwood et al. (2022). “Connecting theory to methods in longitudinal research”:
https://doi.org/10.1177/17456916211008407
Author on Mastodon: @aidangcw
#Stats
#Statistics
#Methodology
#Psychology
#PsychMethods
#ResearchDesign
#LongitudinalResearch
