Why journal-based metrics should not be used in researcher assessment?
This
#CoARA ExPECT video explores the limitations of using journal-based metrics to assess researchers:
https://oulu.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=68c33a42-7c82-4c28-b8a1-b37f00bbd203 #CoARAssessment #ResearcherAssessment #Assessment #journalmetrics
Why Journal-Based Metrics Should Not Be Used in Researcher Evaluation
The video explores the limitations of using journal-based metrics—such as Impact Factor and national classification systems—to assess researchers. Originally designed to evaluate journals, these metrics fail to reflect the actual quality, relevance, and impact of individual research outputs. The video emphasizes how relying on such metrics can shift focus away from meaningful contributions and discourage diverse forms of research dissemination. It calls for a more responsible and holistic approach to research evaluation.
Why the H-index is inadequate for researcher assessment?
Check out the #CoARA ExPECT video to see how the H-index is calculated and to understand its limitations as a way of assessing researchers.
https://oulu.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=e4f0dfb6-3dc0-4a3c-9912-b37f00bc31ea
#CoARAssessment #ResearcherAssessment #Assessment #hindex
Why the h-index is inadequate for researcher evaluation
The video explains how the h-index is calculated and highlights its limitations as a tool for evaluating researchers. While widely used, the h-index oversimplifies scientific contributions, varies across disciplines, disadvantages early-career researchers, and differs between databases. It also fails to reflect broader societal impact. A more holistic approach is needed for fair and meaningful research assessment.
What I need to know about responsible research assessment
This introductory video in a new instructional series explains the fundamentals of responsible research assessment for peer reviewers, assessment boards, decision-makers, and researchers. It outlines why reform is essential, focusing on the limitations of traditional metrics like the Journal Impact Factor and H-index. These metrics often fail to reflect the true quality and impact of research, can distort priorities by encouraging quantity over quality, and may disadvantage those in certain disciplines or with contributions not easily measured by such indicators. Over-reliance on these metrics can also incentivise unethical behaviour and undermine diversity.
The video highlights the emergence of international reform movements, particularly DORA and CoARA, which advocate for a more holistic and qualitative approach to research evaluation. These initiatives promote the recognition of a broad range of research activities and outputs, including teaching, mentoring, and societal engagement, and stress the importance of transparency and fairness in assessment. The series will continue with practical guidance and examples of good practice, aiming to foster trust, fairness, and sustainability in research assessment.
Miki Kallio