Stephen RoyleFirst two months of 2026 in #PeerReview
I've reviewed:
4 papers
3 grant applications
I've submitted:
1 paper
1 grant application
so I've “requested” ~6 reviews from the system.
So I'm in credit at the Bank of Peer Review so far.
Redish LabI think this is a good idea.
Anyone who wants a grant has to do at least 3 reviews for each submission. Anyone who wants to publish a paper has to do at least 2 reviews for each submission.
Not only would that help the review backlog, it would help limit the people who submit way too many grants and papers.
@adredish I also like this idea. Would stop the freeloaders who don't review, yet incur reviews on the system (I can't remember the name for them - I am partway through reading your book!).
I suppose though someone needs to validate whether a review was useful, to prevent freeloaders from simply turning in cursory reviews to submit their own grants/papers.
Hmmm might also require review activity to be centralised... can’t see that happening. But it is still a good idea IMO.
Björn BrembsI also like the idea, but controlling/policing it may become a nightmare.
MCDuncanLabNot a trivial issue.
I've now seen one AI-written paper with one AI-written review. Thankfully me, and another reviewer were not AI otherwise phew-it was a stinker and a review article at a big name review journal.
Ko-Fan Chen 陳克帆@steveroyle @adredish I think it is in operation now for the BBSRC Pioneer scheme this year
@kofanchen really? Wow I didn’t know that!
@steveroyle that was what my colleagues said that is a requirement for the scheme! You need to agree to review so your application would be considered
https://www.ukri.org/opportunity/bbsrc-pioneer-awards-2025-to-26-bioscience-discovery-research/
"
All proposals submitted to the BBSRC Pioneer Awards 2025/26 will undergo distributed peer review (DPR)...
By submitting a proposal, applicants agree to act as reviewers and to have their proposal reviewed by their peers. "
https://www.ukri.org/opportunity/bbsrc-pioneer-awards-2025-to-26-bioscience-discovery-research/
"
All proposals submitted to the BBSRC Pioneer Awards 2025/26 will undergo distributed peer review (DPR)...
By submitting a proposal, applicants agree to act as reviewers and to have their proposal reviewed by their peers. "
Ulrike Hahn@adredish @steveroyle @elduvelle there’s still an issue with the distribution of expertise, though, no?
Steve GisselbrechtRE: https://mastodon.social/@thetransmitter/116160208236254175
Near juxtaposed in my timeline:
https://mas.to/@thetransmitter@mastodon.social/116160208299669384
@stevegis_ssg @thetransmitter thanks, I just saw it as well. Need to read!
Nymnympseudonym@steveroyle The system begs for both gamification and monetization.
It *could* be done in functioning democracies with a bit of meta-review and a non-political oversight board.