I've sadly come to conclude that #qualtrics (my beloved survey platform started by some fresh-faced Mormon boys from BYU 20 years ago) has become kind of enshittified.

For almost 20 years the company has had requests to add pretty reasonable features like (definitely not an exhaustive list):

  • Vertical sliders
  • Text orientation in labels
  • non-numerical recodes (this has looked like it should for at least 15 years)
  • Parity in options between matrix, sliders, and side-by-side questions

Several others, too. Nope. At least a dozen highly reasonable feature requests still unaddressed for 15+ years. I got off the phone with customer service and their best answer for vertical sliders or CSS-rotated slider/matrix labels was "check our community help forums, though we don't support anything they say." It's the Google/Microsoft model: convince people to crowdsource their own workarounds to your product while you rake in the dough from tens of thousands of organizational contracts.

Qualtrics' revenue is close to $2B per year, and they are valued north of $15B.

The sad thing is that there seem to be so few viable alternatives.

#enshittification #surveys #surveyresearch #fuckthis

@guyjantic If this question is the only thing you have, it is difficult to make an argument to support ordered categories.

In #SurveyResearch you could do it via previous qualitative work, e.g., cognitive interviews; or quantitative work (e.g., ask people to indicate the order of such terms). If you have specific rating scale anchors (I doubt it exists for the ones you gave as examples πŸ˜‚ ), you could look for published work on them and at least argue that others have found these to be ordered.

Question for #SocialScience or #surveyresearch or #psychometrics or #statistics folks: How do I test the order of maybe-ordinal responses for some items in a survey?

I have done some scaling where the items are tested for ordered/monotonic properties (e.g., is item 1 really more of whatever than item 2?). However, this is a bit different, I think: I have been tasked with analyzing some items from a survey kind of like this:

I think pregnant women deserve the same rights as everyone else (choose one)
Absolutely
Hell yeah
Sure!
I don't know
Maybe
Nah
Nope

Is Absolutely actually more agreement than Hell yeah? Does a response of I don't know indicate more agreement than Maybe?

It's this kind of question. How do I test for the empirical order (if any) applied by about 800 participants?

#question #help #suggestion

πŸŽ‰ Our paper on predicting survey question quality with ML is accepted in Survey Research Methods!

Explore better survey design with the free Survey Quality Predictor (SQP 3.0) πŸ‘‡
https://sqp.gesis.org/

Thanks to Barbara Felderer, Wiebke Weber, Jonas Schweisthal & Ludwig Bothmann for this collaborative effort! πŸ™Œ

@GESIS
#SurveyResearch #QuestionDesign #DataQuality #SurveyMethodology #Measurement

SQP

🎀🍻 How do we measure alcohol consumption and binge drinking across Europe?

At the #MorgenAbendFestival in Frankfurt, I took the stage to slam about survey methodology & alcohol data from the #ESS.

Methodology can be bold and fun. πŸ€“

Science belongs in the public (sometimes even in pubs) β€” not just in publications.

#ScienceSlam #ScienceCommunication #SurveyResearch @GESIS

Thanks to the @boell and Sascha Vogel from Science Birds GmbH for making this possible!

πŸ“Š At this year’s #ESRA conference, exciting findings based on #FReDA were presented – among others by Dr. Andreas Ette (BiB) and Dr. Detlev LΓΌck (BiB). Many thanks for the great exchange! 🀝

#SurveyResearch #ESRA2025
@bib_bund

#jobs #stellenangebote #GESISjobs #jobfairy #SocialScienceJobs #PhDPosition #SurveyResearch #AcademicJobs

πŸŽ“ GESIS is hiring a Research Associate (PhD Candidate) in Questionnaire Development to join the Family Surveys team in Mannheim or Cologne, starting 01.09.2025.

Work on the FReDA panel and write your PhD in survey methodology or family sociology.

πŸ“… Apply by 24.07.2025
πŸ”— https://www.gesis.org/en/institute/career/jobs/details/research-associate-in-data-preparation-phd-candidate

Have 15-20 minutes to think about gender? Participate in my lab’s latest #surveyResearch on gender expression across contexts to help develop new, better assessments of ✨ diverse gender experiences ✨ https://illinois.qualtrics.com/jfe/form/SV_5tHUpQzMeXbICmq please boost for reach, thank you!
Contextualized Gender Variation Survey

The purpose of this research study is to improve our understanding of how people experience gender and improve the future assessment of gender in research. We hope to use this survey to understand how people experience gender across contexts, and to help identify more expansive ways of assessing gender expression beyond masculinity and femininity alone.

#request - does anyone know of any panel services that are affordable? I need some survey participants (200 would be lovely) and quick, because of [swear words while thinking of why]. I'm looking into #mechanicalturk but I don't know if I can get this to happen quickly enough; I have one week.

I need young adults, English speaking (native fluency). North American would be fine, but European is great, too. Maybe near East (e.g., India, Pakistan) if the language fluency is there. Region/nation is less important than the age range and the language ability.

I'd be paying for this out of pocket, and I don't have much money, so hoping I can find inexpensive services somewhere (<<$500 USD? Maybe closer to $200? realizing this might not be possible because I've never looked into this until now). Qualtrics has panels but they're far too expensive for me. I'm googling, but asking here first.

#Recommendations?

#research #survey #surveyresearch #panel #participants #help #lastminute