Towards a more informed and balanced use of scientific performance metrics
#JaapJADenissen #KlaasSijtsma #metrics #ResearchAssessment #WilMPVanDerAalst
Towards a more informed and balanced use of scientific performance metrics
#JaapJADenissen #KlaasSijtsma #metrics #ResearchAssessment #WilMPVanDerAalst
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.html
The Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.info
The session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research
👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630
You can read more about #RESQUE and community responses in this excellent issue of #MetaPsychology
https://conferences.lnu.se/index.php/metapsychology/issue/view/297
Topic-specific expansion packs are developing, eg., a #PrePrint for #ClinicalPsychology and #PsychotherapyResearch
https://osf.io/preprints/psyarxiv/6gwr8_v1
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.info
Maybe of interest for other areas as well?
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
📣 When others talk about your work, you know it's making an impact:
🔹 Science Europe cited OSMI's frameworks in their position statement on Open Science & Research Assessment Reform
🔹 The French Open Science Barometer recognised OSMI's role in uniting nearly 200 members worldwide
🔹 Make Data Count referenced OSMI's landscape mapping in their blog
Curious to see who else is talking about us? 👉 https://open-science-monitoring.org/about/they-talk-about-osmi/
#OpenScience #OpenScienceMonitoring #OSMI #ResearchAssessment
New paper: The changing nature of social media and research impact
This was just published from a project with Katy Jordan and Ignacio Wyman:
The Research Excellence Framework (REF) is a national auditing exercise within UK higher education which periodically evaluates the research outputs of universities within the system. In the last two cycles, this has included case studies which aim to document the societal impact of research taking place within universities. In a previous paper, we analysed the role attributed to social media in the REF 2014 in these case studies, finding a significant tendency to draw on social media in claiming and documenting research impact. In this paper, we return to the REF in 2021 to explore how these trends have developed since our initial study. We find a substantial increase in references to social media within impact case studies, distributed unevenly across disciplinary groupings in a manner which highlights broader transformations in the landscape of our analysis. Our analysis draws attention to the broader interface between higher education and social platforms in which these practices of research evaluation (identifying, reporting, comparing, etc.) are embedded. We suggest that metrics in particular constitute a nexus through which this interface can be explored, enabling us to highlight political and practical challenges in a way that is empirically grounded yet conceptually rich.
Read hereIt follows on directly from this paper on the same question for the last REF: https://link.springer.com/article/10.1007/s42438-021-00269-x
#higherEducation #platformUniversity #ref #researchAssessment #researchImpact #universitiesOpenAIRE at The Future of Open Research: Reliable, Responsible, Equitable in Munich 🙌
Key discussions focused on a growing shift in research evaluation:
➡️ universities moving away from global rankings
➡️ towards more open, transparent, and equitable approaches
Work from #EOSCTrack also highlighted a key point:
open research needs open and transparent monitoring.