Mastodawn

Why journal-based metrics should not be used in researcher assessment?

This #CoARA ExPECT video explores the limitations of using journal-based metrics to assess researchers:

https://oulu.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=68c33a42-7c82-4c28-b8a1-b37f00bbd203

#CoARAssessment #ResearcherAssessment #Assessment #journalmetrics

Why Journal-Based Metrics Should Not Be Used in Researcher Evaluation

The video explores the limitations of using journal-based metrics—such as Impact Factor and national classification systems—to assess researchers. Originally designed to evaluate journals, these metrics fail to reflect the actual quality, relevance, and impact of individual research outputs. The video emphasizes how relying on such metrics can shift focus away from meaningful contributions and discourage diverse forms of research dissemination. It calls for a more responsible and holistic approach to research evaluation.

Panopto

Miki Kallio Nov 26

Why the H-index is inadequate for researcher assessment?

Check out the #CoARA ExPECT video to see how the H-index is calculated and to understand its limitations as a way of assessing researchers.

https://oulu.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=e4f0dfb6-3dc0-4a3c-9912-b37f00bc31ea

#CoARAssessment #ResearcherAssessment #Assessment #hindex

Why the h-index is inadequate for researcher evaluation

The video explains how the h-index is calculated and highlights its limitations as a tool for evaluating researchers. While widely used, the h-index oversimplifies scientific contributions, varies across disciplines, disadvantages early-career researchers, and differs between databases. It also fails to reflect broader societal impact. A more holistic approach is needed for fair and meaningful research assessment.

Panopto

Miki Kallio Nov 12

What I need to know about responsible research assessment?

Watch the video produced by the #CoARA ExPECT project and find the answer:

https://oulu.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=7b2297e5-9cc2-4f29-bb1a-b37f00bcbd7a

#CoARAssessment #ResearchAssessment #Assessment

What I need to know about responsible research assessment

This introductory video in a new instructional series explains the fundamentals of responsible research assessment for peer reviewers, assessment boards, decision-makers, and researchers. It outlines why reform is essential, focusing on the limitations of traditional metrics like the Journal Impact Factor and H-index. These metrics often fail to reflect the true quality and impact of research, can distort priorities by encouraging quantity over quality, and may disadvantage those in certain disciplines or with contributions not easily measured by such indicators. Over-reliance on these metrics can also incentivise unethical behaviour and undermine diversity. The video highlights the emergence of international reform movements, particularly DORA and CoARA, which advocate for a more holistic and qualitative approach to research evaluation. These initiatives promote the recognition of a broad range of research activities and outputs, including teaching, mentoring, and societal engagement, and stress the importance of transparency and fairness in assessment. The series will continue with practical guidance and examples of good practice, aiming to foster trust, fairness, and sustainability in research assessment.

Panopto