We evaluate science mostly through papers. But researchers report that up to 75% of project effort is data work — collecting, cleaning, documenting, and preparing datasets. A reminder that research outputs ≠ research work.
New paper in Research Evaluation: https://doi.org/10.1093/reseval/rvag008
#ResponsibleMetrics #OpenScience #DataCitation #ResearchEvaluation
Most research evaluation still rewards papers, not the work that makes them possible. Yet researchers say up to 75% of a project can be data work: collecting, cleaning, curating, documenting.
https://doi.org/10.1093/reseval/rvag008
Maybe it's time to stop pretending that publications alone represent research.
#OpenScience #ResearchEvaluation #DataCitation #ResponsibleMetrics #Scientometrics
New paper in Research Evaluation explores how researchers actually cite data. Key insight: data citations are far more complex than simple indicators of data reuse.
https://doi.org/10.1093/reseval/rvag008
They reflect scientific practice, community norms, attribution, and even reputation-building. A timely reminder: metrics alone cannot capture the real value of data work.
#OpenScience #DataCitation #ResearchEvaluation #ResponsibleMetrics #Scientometrics
Where do bibliometricians come from? 🤔 A new international study suggests a simple answer: mostly from academic libraries. Around 60% of people doing bibliometric work at universities are based there.
https://doi.org/10.1177/01655515261417634
The catch? Over 70% say they never had formal training in bibliometrics. People simply grow into the role while working with databases, indicators and research analytics.
#bibliometrics #scientometrics #researchmetrics #responsiblemetrics #openscience
At #ISSI2025, Mike Thelwall suggested that the Leiden Manifesto should be updated to reflect the rise of large language models (LLMs) in research assessment.
👉 https://issi2025.iiap.sci.am/proceedings/ (P. 71-80)
He proposed four new principles — calling for transparent prompts, awareness of #LLM instability, cost-benefit considerations, and a reminder that LLM scores are not evidence of scientific contribution.
#Scientometrics #ResponsibleMetrics #OpenScience #ImpactFactor
🇧🇷 vs 🇳🇱 in #ResearchEvaluation? A sharp comparative study shows how Brazil’s high-stakes, performance-based model contrasts with the Netherlands’ strategic, decentralized approach.
https://doi.org/10.1093/reseval/rvaf013
Takeaway: Evaluation isn’t one-size-fits-all - context matters.
#ResearchAssessment #SciencePolicy #HigherEducation #ResponsibleMetrics #AcademicEvaluation
Este #podcast con un análisis métricos sobre el uso excesivo de métricas para la toma de decisiones me parece que genera muy buenos elementos de discusión. Creo que es valioso escucharlo (me robé un par de ejemplos de allí) https://open.spotify.com/episode/70nf1LR0C02FmU16X2DtKo?si=FGpbC7m3QmK9hhYHL_78yw #ResponsibleMetrics
This #podcast on Metrics' use for decision making has really great ideas. It's wortwhile to listen it (I took a couple of examples from it) #responsiblemetrics
https://open.spotify.com/episode/70nf1LR0C02FmU16X2DtKo?si=FGpbC7m3QmK9hhYHL_78yw
Episode · Curiosity Porn · Part 2 of our discussion with Jerry Muller. Dr. Muller tells us a variety of ways that obsessing over measuring things leads to very bad outcomes - for schools, for healthcare, for policing, and more! Dr. Muller also tells us how metrics ruined Jordan Peterson (kind of).
this is a cool piece about the role of #ResearchMetrics:
Este es un muy buen texto sobre las métricas de la investigación y el impacto que han tenido en el sistema. Disfruté mucho su lectura:
https://heterodoxacademy.org/blog/managing-the-metrics-of-academic-publishing/
#ResearchAssessment #ResearchMetrics #ResponsibleAssessment #ResponsibleMetrics
Do you have success stories about universities implemmenting #responsiblemetrics in #ResearchAssessment? I want to build an inventory of such cases.
Thanks!! #AcademicChatter
"To help implement [research assessment] reforms, here we share a best practice Responsible Research(er) Recruitment Checklist for engaging with the principles of responsible research assessment in the writing of recruitment materials such as job adverts for research and academic roles."
#ResponsibleMetrics #Recruitment #ResearchCulture #ResearchAssessment #AcademicCareers #AcademicJobs #Checklists #OpenResearch
Serhii Nazarovets
César Pallares 
UKRIO