Jessica Polka

@polka
985 Followers
298 Following
97 Posts
Open Science Advocate | Senior Program Lead, MIT Open Learning
Twitterhttps://twitter.com/jessicapolka
Websitehttps://www.jessicapolka.net/

Code sharing practices in biomedical research:
New study finds that approximately half of the analysed manuscripts did not share associated code.

Preprint evaluated on @prereview by @polka and and Stephen Gabrielson.

#OpenScience

https://sciety.org/articles/activity/10.1101/2023.07.31.551384?utm_source=mastodon&utm_medium=social&utm_campaign=sci_mastodon_2023_169

Analytical code sharing practices in biomedical research

Data-driven computational analysis is becoming increasingly important in biomedical research, as the amount of data being generated continues to grow. However, the lack of practices of sharing research outputs, such as data, source code and methods, affects transparency and reproducibility of studies, which are critical to the advancement of science. Many published studies are not reproducible due to insufficient documentation, code, and data being shared. We conducted a comprehensive analysis of 453 manuscripts published between 2016-2021 and found that 50.1% of them fail to share the analytical code. Even among those that did disclose their code, a vast majority failed to offer additional research outputs, such as data. Furthermore, only one in ten papers organized their code in a structured and reproducible manner. We discovered a significant association between the presence of code availability statements and increased code availability (p=2.71×10 −9 ). Additionally, a greater proportion of studies conducting secondary analyses were inclined to share their code compared to those conducting primary analyses (p=1.15*10 −07 ). In light of our findings, we propose raising awareness of code sharing practices and taking immediate steps to enhance code availability to improve reproducibility in biomedical research. By increasing transparency and reproducibility, we can promote scientific rigor, encourage collaboration, and accelerate scientific discoveries. We must prioritize open science practices, including sharing code, data, and other research products, to ensure that biomedical research can be replicated and built upon by others in the scientific community.

Sciety

Excellent post-mortem of peer-review.io - why is it so hard to disrupt peer review?

👥 social pressure to review
⚖️ need for moderation
🔑 reputational lock-in

Would love to see more scholcomm experiments report learnings like this! http://www.theroadgoeson.com/crowdsourcing-peer-review-probably-wont-work
ht Subbiah Arunachalam

Crowd Sourced Review Probably Can’t Replace the Journals

Two years ago, I started a journey into academic publishing. I imagined using a reputation system to replace the journals with crowd sourcing. The reputation system would match reviewers to papers, incentivize good faith review, and identify bad actors. It wasn’t clear whether it would work in practice, but I wanted to find out.

The Road Goes On, Thoughts and Essays by Daniel Bingham

COVID’s preprint bump set to have lasting effect on research publishing https://doi.org/10.1038/d41586-024-00401-4

In this piece by @Dalmeet our @cwts PhD candidate Narmin Rzayeva shares her reflections on our paper 'The experiences of COVID-19 preprint authors: a survey of researchers about publishing and receiving feedback on their work during the pandemic' https://doi.org/10.7717/peerj.15864.

@stephenpinfield @polka

After 8+ incredible years at @ASAPbio I am beginning a new chapter as Open Science Program Director at Astera Institute later this month. So, we're looking for new leadership: please share the posting with people passionate about open science! https://asapbio.org/job-posting-executive-director-of-asapbio-deadline-feb-19
Job posting: Executive Director of ASAPbio (deadline Feb 19)

Join us to make scholarly communication in the life sciences more open and efficient by catalyzing cultural change in scholarly communication, for instance around the use of preprints and other interim research products, transparent review, and other innovations! About ASAPbio ASAPbio is a 501(c)(3) nonprofit organization working toward a vision of a life sciences communication…

ASAPbio
Living Pixel (@LPixSoln) on X

@jessicapolka https://t.co/MkSwcQFQ7V

X (formerly Twitter)
@polka not a browser extension, but I noticed in x that you're thinking of recruitment support. I made JYUcite (oscsolutions.cc.jyu.fi/jyucite) : put in ORCID and after a while it lists person's papers ranked by field & time -normalized citation impact, excluding all journal names.

A browser extension that blocks journal names (on pubmed or the whole web) so researchers can focus on evaluating research itself without quality proxies

Does it exist? Is anyone working on this?

Just as not all preprint servers are suffixed w/ "Rxiv" not everything ending in "Rxiv" is a preprint server. Case in point - searchRxiv is a database for search strings! Interesting concept https://www.cabidigitallibrary.org/journal/searchrxiv

Meet your colleagues and discuss a new preprint over lunch during Cell Bio 2023 🥳

We’re pleased to announce preprint launch parties organized by ASAPbio during Cell Bio 2023 (Boston, MA, USA)! These lunch events are not formally affiliated with ASCB/EMBO, but will be held Monday and Tuesday, Dec 4 and 5, at a conference room at street level about a 10’ walk from the conference center.

To learn more and RSVP: https://docs.google.com/forms/d/e/1FAIpQLSc2qZ3jBUPDsCNy5yHjux44u0J67okwhYAwQBgHtSVQgv1jjQ/viewform?usp=sf_link

RSVP: Preprint launch parties during Cell Bio 2023

Meet your colleagues and discuss a new preprint over lunch during Cell Bio 2023 🥳 These lunch events are not formally affiliated with ASCB/EMBO, but will be held by the nonprofit organization ASAPbio Monday and Tuesday, Dec 4 and 5, at a conference room visible at street level about a 10’ walk from the conference center. Directions will be circulated to confirmed participants. Lunch will be provided. Attendance is capped at 8 people to ensure a highly interactive discussion. The event will kick off with introductions and a presentation from the preprint author. This will be followed by an interactive discussion about the preprint. Discussion points will be synthesized and posted as a comment on the preprint. Calendar invites, including event location, will be sent to confirmed participants on Dec 2.

Google Docs
Do you have 20'? Then you can make an impact on a funder proposal to center preprints & open review (and no APCs!) in publishing. Details here: https://asapbio.org/20-minute-action-provide-feedback-on-a-funder-proposal-that-would-support-preprints-open-review
20 minute action: provide feedback on a funder proposal that would support preprints & open review

Take cOAlition S’s survey by the November 29th deadline to support a new model of publishing cOAlition S, an initiative of more than 2 dozen national funders and charitable organizations, has recently released the “Towards Responsible Publishing” proposal. The two key features of this proposal, as stated in an introductory blog post, are: 1. Authors,…

ASAPbio