Mastodawn

Steve Haroz (@sharoz on 🐤)Mar 15, 2023

New blog post!

What would you do as a reviewer if you suspected that the methods described in a paper weren't accurate?
Here, I walk through such a case and explain how access to the data allow me to test my suspicions.

http://steveharoz.com/blog/2023/why-open-data-is-critical-during-review-an-example-case/

#OpenScience #ieeevis

Show thread

Michael Kuhn Mar 25, 2023

@sharoz it's great that you insisted and caught this! Unfortunately, I think the most likely course of action is that the authors will submit it unchanged to another journal 😑 At least that has been my experience in cases where I rejected a paper due to concerns about the method. (In one case it even came out in the same journal, via the proceedings of a conference)

Show thread

Steve Haroz (@sharoz on 🐤)

@biocs I generally have had the same experience. Or the editor fails to understand the seriousness of the confound and just insists the authors mention it in the limitations section.