arXiv Implements Measures Against Unchecked AI-Generated Errors in Research Papers

๐Ÿ“ฐ Original title: A key science publishing platform is cracking down on AI slop

๐Ÿค– IA: It's not clickbait โœ…
๐Ÿ‘ฅ Users: It's not clickbait โœ…

View full AI summary: https://en.killbait.com/arxiv-implements-measures-against-unchecked-ai-generated-errors-in-research-papers.html?utm_source=mastodon_world&utm_medium=social&utm_campaign=killbait.mastodon_world

#science #researchintegrity #academicpublishing

arXiv Implements Measures Against Unchecked AI-Generated Errors in Research Papers

The preprint platform arXiv has introduced strict measures against papers containing AI-generated errors, implementing a one-year ban for authors whose submissions include unverified AI content. This decision responds to the increasing presence of AI-generated research, including hallucinated citationsโ€”references that do not exist. While AI-generated text itself is not inherently problematic, the concern lies in the low-quality work it enables, compounded by the traditional peer review system already under strain. arXiv publishes preprints that have often not undergone peer review, leaving it more vulnerable to AI-related issues. Critics argue that the one-year ban may be excessively harsh, especially for papers with multiple authors where only one may have introduced errors. Additionally, there are no similar sanctions for other forms of low-quality or misleading research, highlighting potential inconsistencies. Experts suggest that AI itself could aid in quality assurance, for example by verifying references or conducting preliminary checks of statistical analyses, rather than relying solely on punitive measures. The debate underscores a broader challenge in scientific publishing: balancing the use of AI to improve research efficiency with maintaining rigorous standards of accuracy and reliability.

KillBait

arXiv Implements Measures Against Unchecked AI-Generated Errors in Research Papers

๐Ÿ“ฐ Original title: A key science publishing platform is cracking down on AI slop

๐Ÿค– IA: It's not clickbait โœ…
๐Ÿ‘ฅ Users: It's not clickbait โœ…

View full AI summary: https://en.killbait.com/arxiv-implements-measures-against-unchecked-ai-generated-errors-in-research-papers.html?utm_source=mastodon_social&utm_medium=social&utm_campaign=killbait.mastodon_social

#science #researchintegrity #academicpublishing

arXiv Implements Measures Against Unchecked AI-Generated Errors in Research Papers

The preprint platform arXiv has introduced strict measures against papers containing AI-generated errors, implementing a one-year ban for authors whose submissions include unverified AI content. This decision responds to the increasing presence of AI-generated research, including hallucinated citationsโ€”references that do not exist. While AI-generated text itself is not inherently problematic, the concern lies in the low-quality work it enables, compounded by the traditional peer review system already under strain. arXiv publishes preprints that have often not undergone peer review, leaving it more vulnerable to AI-related issues. Critics argue that the one-year ban may be excessively harsh, especially for papers with multiple authors where only one may have introduced errors. Additionally, there are no similar sanctions for other forms of low-quality or misleading research, highlighting potential inconsistencies. Experts suggest that AI itself could aid in quality assurance, for example by verifying references or conducting preliminary checks of statistical analyses, rather than relying solely on punitive measures. The debate underscores a broader challenge in scientific publishing: balancing the use of AI to improve research efficiency with maintaining rigorous standards of accuracy and reliability.

KillBait

Digital identity in science is not unified by default. Tools like ORCID and database checks can reveal mismatches and missing affiliations that affect visibility and credit.

๐Ÿ”— https://www.nature.com/articles/d41586-025-04132-y

#ResearchIntegrity #ORCID #OpenScience #Bibliometrics #SciencePolicy

Researchers: hereโ€™s how to audit your fragmented digital identity

Services that track researcher profiles can splinter peopleโ€™s online identities โ€” but there are ways to keep them consistent.

ArXiv to Ban Researchers for a Year If They Submit AI Slop

ArXiv์€ AI๊ฐ€ ์ƒ์„ฑํ•œ ๋ถ€์‹คํ•œ ์—ฐ๊ตฌ ๋…ผ๋ฌธ ์ œ์ถœ์— ๋Œ€ํ•ด ์—„๊ฒฉํ•œ ์ œ์žฌ๋ฅผ ๋„์ž…ํ–ˆ๋‹ค. ๋ช…๋ฐฑํžˆ AI ์ƒ์„ฑ ๊ฒฐ๊ณผ๋ฅผ ๊ฒ€์ฆํ•˜์ง€ ์•Š์€ ๋…ผ๋ฌธ ์ œ์ถœ ์‹œ 1๋…„๊ฐ„ ์ œ์ถœ ๊ธˆ์ง€ ์ฒ˜๋ถ„์„ ๋‚ด๋ฆฌ๋ฉฐ, ์ดํ›„ ์ œ์ถœ์€ ํ‰ํŒ ์ข‹์€ ๋™๋ฃŒ ๊ฒ€ํ†  ์ €๋„์—์„œ ๋จผ์ € ์Šน์ธ๋ฐ›์•„์•ผ ํ•œ๋‹ค. ์ด๋Š” AI ์ƒ์„ฑ ์ฝ˜ํ…์ธ ๊ฐ€ ๊ณผํ•™ ์—ฐ๊ตฌ์˜ ์‹ ๋ขฐ์„ฑ์„ ํ•ด์น˜๋Š” ๋ฌธ์ œ์— ๋Œ€์‘ํ•˜๊ธฐ ์œ„ํ•œ ์กฐ์น˜๋‹ค.

https://www.404media.co/new-arxiv-rules-ai-generated-papers-ban/

#arxiv #aigeneratedcontent #researchintegrity #preprint #academicpublishing

ArXiv to Ban Researchers for a Year if They Submit AI Slop

The change comes as arXiv and others struggle to manage an influx of AI-generated materials masquerading as rigorous science.

404 Media

Another day, another excellent demonstration of why doing data analysis using #GenAI is not only unethical but also completely nonsensical: https://kucharski.substack.com/p/real-signals-or-artificial-stereotypes.

The author got Microsoft Copilot to analyse identical but randomly ordered datasets of textual responses assigned to different countries. Copilot produced a plausible-sounding summary of differences between the countries that are nothing less than textbook examples of country stereotypes.

Example curtsy of @BerLinguistin via LinkedIn.

#linguistics #ResearchIntegrity #bias #DataScience #research

New arXiv policy: 1-year ban for hallucinated references

arXiv๊ฐ€ ๋…ผ๋ฌธ ์ €์ž๊ฐ€ ๋…ผ๋ฌธ ๋‚ด์šฉ์— ๋Œ€ํ•ด ์ „์ ์ธ ์ฑ…์ž„์„ ์ง€๋„๋ก ํ•˜๋Š” ์ƒˆ๋กœ์šด ์ •์ฑ…์„ ๋„์ž…ํ•˜๋ฉฐ, ํ—ˆ์œ„ ์ธ์šฉ(ํ™˜๊ฐ๋œ ์ฐธ๊ณ ๋ฌธํ—Œ)์— ๋Œ€ํ•ด 1๋…„๊ฐ„ ์ œ์ถœ ๊ธˆ์ง€ ์กฐ์น˜๋ฅผ ์‹œํ–‰ํ•œ๋‹ค. ์ด ์ •์ฑ…์€ AI ์ƒ์„ฑ ์ฝ˜ํ…์ธ  ์ฆ๊ฐ€์— ๋”ฐ๋ฅธ ํ•™์ˆ ์  ์‹ ๋ขฐ์„ฑ ํ™•๋ณด๋ฅผ ์œ„ํ•œ ์กฐ์น˜๋กœ, ์—ฐ๊ตฌ์ž์™€ ๊ฐœ๋ฐœ์ž ๋ชจ๋‘์—๊ฒŒ ์ค‘์š”ํ•œ ๋ณ€ํ™”๋‹ค. AI ๊ธฐ๋ฐ˜ ๋…ผ๋ฌธ ์ž‘์„ฑ ์‹œ ์ธ์šฉ ๊ฒ€์ฆ๊ณผ ์ฑ…์ž„ ์†Œ์žฌ ๋ช…ํ™•ํ™”๊ฐ€ ๋”์šฑ ๊ฐ•์กฐ๋  ์ „๋ง์ด๋‹ค.

https://twitter.com/tdietterich/status/2055000956144935055

#arxiv #academicpolicy #hallucination #citation #researchintegrity

Thomas G. Dietterich (@tdietterich) on X

Attention @arxiv authors: Our Code of Conduct states that by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated. 1/

X (formerly Twitter)

An Italian researcher has been ordered to pay back approximately $51,000 in grants due to "massive" scientific misconduct in two of her published books.

https://www.plagiarismtoday.com/2026/05/13/researcher-ordered-to-repay-grants-over-alleged-plagiarism/

#Plagiarism #AcademicIntegrity #ResearchIntegrity #ScientificIntegrity

Researcher Ordered to Repay Grants Over Alleged Plagiarism

An Italian researcher has been ordered to pay back approximately $51,000 in grants due to โ€œmassiveโ€ scientific misconduct in two of her published books.

Plagiarism Today

TODAY: On a panel at the #UKRIO annual symposium https://ukrio.org/public-events/

Topic: research integrity as a driver of growth, knowledge, and innovation.

Things I will probably mention
- the UK Reproducibility Network! ukrn.org
- Wellcome's new report on Trust in Science "Britain Talks Trust in Science"
https://www.moreincommon.org.uk/our-work/research/britain-talks-trust-in-science/
- my experience of running partial randomisation for the SPA
https://researchonresearchinstitute.substack.com/p/bingo-partial-randomisation-for-emergency
- and maybe Juergen Wastl's post https://fosci.substack.com/p/the-goddesses-truth-and-trust

#ResearchIntegrity

Public events - UK Research Integrity Office

My research project, Writing With the Dead, has a fully funded PhD position available. Terribly excitingโ€”and also with very nice people involved.

Come to Copenhagen. Do Grundtvig stuff. Wisen up.

#PhD #Grundtvig #ResearchIntegrity

Do repost, please.

https://jobportal.ku.dk/alle-opslag/?show=160458

PhD scholarship in Grundtvig Studies at the Faculty of Theology