I forgot to share the #mTurk data quality result that got scooped:
“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”
https://doi.org/10.1093/analys/anaf015
#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl
Across two studies--one using a sample of undergraduate students (N = 299) and one using a sample of #CloudResearch #Connect participants (N = 538)--we found consistent associations between the tendency to believe in conspiracy theories and a wide range of prejudicial beliefs.
Orca's cloud security research pod is hiring. Like I said on LinkedIn, they're a fantastic team doing important work. You'd probably be a good fit.
https://www.linkedin.com/feed/update/urn:li:activity:7041117727444336640/
What conclusion do you draw, if any, when all (and only) the people who wrote in "non-binary" to the question, "What is your gender?" failed a survey's attention check?
Why would someone who puts in the effort to write a (vs. select a pre-written) response have been inattentive earlier in the survey?
I doubt that people reporting non-binary gender are generally less attentive on surveys.
So was it most likely a fluke?
#mTurk #CloudResearch #researchMethods #demographics #dataQuality
#mTurk click farm fraud is mind-boggling!
I recently attended a #CloudResearch presentation about it. Rather than just block "fraudsters", they also studied and invited them to take surveys via #Zoom (to see inside their operation).
The "fraudsters" were often in computer labs with peers helping them complete the #survey. Although they exhibited a modicum of competence in English, they often typed bold-faced lies in the chat (e.g., answering "yes" to "Are you a sitting US Senator?") ON CAMERA!
Nick Byrd, Ph.D.
Cameron S. Kay
Neil Carpenter 
