INSPECT-SR is a tool to address risks posed by untrustworthy randomized controlled trials:
https://www.cochrane.org/about-us/news/new-tool-detects-problematic-trials-they-distort-evidence

The focus is on use in #SysReviews, but I think it may offer opportunities for training in #RCT methods.

I'll find out - just registered for @jd_wilko 's webinar:
https://www.trybooking.com/uk/events/landing/94843

#ResearchWaste #ResearchIntegrity

New tool detects problematic trials before they distort evidence | Cochrane

The reporting guideline for #SysReviews of outcome measurement instruments offers great resources to support the planning and write-up of such reviews
https://link.springer.com/article/10.1007/s11136-024-03634-y

We invited response letters to support the discussion, the first 3 are published here:

1) https://rdcu.be/dNuyj

2) https://rdcu.be/dNuzs

3) https://link.springer.com/article/10.1007/s11136-024-03732-x

4) Response by the PRISMA-COSMIN team
https://rdcu.be/dNuz3

More letters to come, stay tuned!

#Psychometrics #AcademicWriting #ISOQOL

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024 - Quality of Life Research

Purpose Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024. Methods The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement. Results From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥ 67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review’s title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts. Conclusion PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. Note In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

SpringerLink

For more information about the project, additional materials, tip sheets, and other helpful resources, go to:

https://lab.research.sickkids.ca/enrich/research-projects/prisma-cosmin/

#PrismaCosmin #Psychometrics #SysReviews

PRISMA-COSMIN for Outcome Measurement Instruments

Evidence-based treatment and healthcare policy decision making rests on information collected in research studies. Health outcome measurements are only as good as the outcome measurement instruments (OMIs) used to make them. Yet, the use of OMIs with poor or unknown quality is widespread in clinical research,

EnRICH Team

🔥 Just out 🔥

#PrismaCosmin 2024

A #ReportingGuideline for reporting #SysReviews of outcome measurement instruments:
https://link.springer.com/article/10.1007/s11136-024-03634-y

It aims to improve the reporting of #SystematicReviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs.

It consists of two checklists, their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram.

#Psychometrics #SystematicReviews

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024 - Quality of Life Research

Purpose Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024. Methods The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement. Results From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥ 67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review’s title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts. Conclusion PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. Note In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

SpringerLink

Some #SysReviews make me wonder where the efforts of the "critical appraisal" modules go. And what we generally assume about #ScienceEditing and #PeerReview:

"For this study we only considered studies published in Q1 and Q2 journals in [ranking system], in order to guarantee intra-rater convergence."
[redacted from original]

#NightshiftEditor #ResearchAssessment

The article discusses the variety of time-tradeoff #TTO tasks employed to value health states:
https://link.springer.com/article/10.1007/s10198-013-0508-x

It highlights how factors in the TTO method may affect the elicited values and limit comparability of results from different studies.

It also offers a checklist when planning TTO tasks to enhance the comparability of health state values.

Accompany with a guide to conducting #Sysreviews and #MetaAnalysis of health state values:
https://rdcu.be/c6Uy7

#HRQL #HealthEconomics

Time trade-off: one methodology, different methods - The European Journal of Health Economics

There is no scientific consensus on the optimal specification of the time trade-off (TTO) task. As a consequence, studies using TTO to value health states may share the core element of trading length of life for quality of life, but can differ considerably on many other elements. While this pluriformity in specifications advances the understanding of TTO from a methodological point of view, it also results in incomparable health state values. Health state values are applied in health technology assessments, and in that context comparability of information is desired. In this article, we discuss several alternative specifications of TTO presented in the literature. The defining elements of these specifications are identified as being either methodological, procedural or analytical in nature. Where possible, it is indicated how these elements affect health state values (i.e., upward or downward). Finally, a checklist for TTO studies is presented, which incorporates a list of choices to be made by researchers who wish to perform a TTO task. Such a checklist enables other researchers to align methodologies in order to enhance the comparability of health state values.

SpringerLink

@flourn0
I have been myself inconsistent in this and cannot offer anything directly in the remit of your question, but eg. the 2nd supplement of this could be made a usual addition to any paper, testing invariance of measures in a given application:
https://royalsocietypublishing.org/doi/suppl/10.1098/rsos.211114

That would allow researchers planning for their projects or #SysReviews interested in psychometric properties at least to collate relevant information on such aspects.

#Psychometrics #HRQL
edited to add #COSMIN