Mastodawn

Why do we have precise terms for LLM failures like "hallucination" but almost none for the human side of AI interaction?

The AUGMANITAI framework addresses this gap — a terminology compendium identifying and naming phenomena that occur when humans interact with AI systems. From sycophancy patterns to confidence calibration artifacts.

Open-access, DOI-published, CC BY-NC-ND 4.0.

doi.org/10.5281/zenodo.14984941

#AI #NLP #HumanAI #Terminology #OpenScience #LLM #AUGMANITAI

Alberto Quian🏴‍☠️

3d ago

Current AI models exhibit a high degree of sycophancy, affirming users' actions significantly more than humans do, even in cases involving manipulation. Experiments demonstrate that interaction with sycophantic AI reduces users' willingness to repair interpersonal conflicts, while simultaneously increasing their conviction of being right.

Paper: https://doi.org/10.48550/arXiv.2510.01395

Video: https://yewtu.be/watch?v=516__PG-eeo

#AI #LLM #Sycophancy #AIBias #HumanAI #AIEthics #MachineLearning #AIResearch

Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence

Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users. Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI. Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI. First, across 11 state-of-the-art AI models, we find that models are highly sycophantic: they affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception, or other relational harms. Second, in two preregistered experiments (N = 1604), including a live-interaction study where participants discuss a real interpersonal conflict from their life, we find that interaction with sycophantic AI models significantly reduced participants' willingness to take actions to repair interpersonal conflict, while increasing their conviction of being in the right. However, participants rated sycophantic responses as higher quality, trusted the sycophantic AI model more, and were more willing to use it again. This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment and reducing their inclination toward prosocial behavior. These preferences create perverse incentives both for people to increasingly rely on sycophantic AI models and for AI model training to favor sycophancy. Our findings highlight the necessity of explicitly addressing this incentive structure to mitigate the widespread risks of AI sycophancy.

arXiv.org

Andreas Ehstand 3d ago

When an LLM confidently presents false information, researchers call it "hallucination." When it agrees with everything you say, the term is "sycophancy." But most phenomena in human-AI interaction still have no name.

AUGMANITAI is an open-access compendium of 1,000+ terms for human-AI interaction. ISO-inspired terminology science, DOI-published on Zenodo (CC BY-NC-ND 4.0).

https://doi.org/10.5281/zenodo.14984941

#HumanAI #NLP #Terminology #AI #LLM #OpenAccess

Realising Open Data Principles In UK Research Institutions

With increasing focus on open research, the Concordat of Open Research Data was created in 2016, laying out 10 principles for embedding open data practices in United Kingdom (UK) academic research. The Concordat’s principles relate to ethical, legal and professional obligations, addressing areas such as practicality, affordability, transparency, robustness and fairness, mechanisms and infrastructure, data integrity, citation and attribution, aiming for all research data to be ‘as open as possible, as closed as necessary’. The STAR (Sustainable & TrAnsparent Research data) project, is led by the UK Reproducibility Network (UKRN), and supported by several UK research institutions, with contributions from the Data Curation Centre and other sector experts. The project employs qualitative methods to evaluate the implementation of the Concordat’s principles in UK research institutions since inception. This was done through interviews, focus groups, and workshops we held with 43 research support staff across 20 UK universities. In this paper, we report on key learnings from the STAR project, including progress and barriers to open data; and ways in which institutions are and could better be supported in the curation, publication, and reuse of open data.

Zenodo

sayzard 4d ago

Bindu Reddy (@bindureddy)

AI들끼리 문서 작성, 이메일 요약, 버그 수정과 PR 리뷰까지 수행하는 등 인간-AI 협업이 에이전트 간 협업으로 확장된 현재 상황을 풍자적으로 보여준다.

https://x.com/bindureddy/status/2036330943288582200

#humanai #agents #collaboration #automation #developerworkflow

Scott M. Graffius 5d ago

The future of work is human–AI teams, and navigating the "exotic team dynamics" which emerge when collaborating with advanced AI (agentic, autonomous, or autopoietic).

https://scottgraffius.com/exotic-team-dynamics.html

#AI #AIResearch #HumanAI #HumanAITeamwork #ExoticTeamDynamics #FutureOfWork

sayzard Mar 18

fly51fly (@fly51fly)

사람-AI 상호작용에서 발생하는 '보이지 않는 실패(invisible failures)'를 다룬 연구가 arXiv에 공개됨(2026). 저자 C. Potts와 M. Sudhof(소속: Bigspin AI)는 사용자가 인지하지 못하는 실패 모드와 그 영향, 탐지·완화 방안에 대해 분석해 인간중심 AI 상호작용 설계와 안전성 검토에 시사점을 줌.

https://x.com/fly51fly/status/2034021915132866948

#humanai #failures #usability #arxiv #ai

fly51fly (@fly51fly) on X

[CL] Invisible failures in human-AI interactions C Potts, M Sudhof [Bigspin AI] (2026) https://t.co/MorQ0vv5a2

X (formerly Twitter)

Scott M. Graffius Mar 17

Innovation runs on collaboration. Add advanced AI — agentic, autonomous, or autopoietic — and "exotic team dynamics" emerge. The future of work is human–AI teams driving breakthroughs.

https://scottgraffius.com/blog/files/exotic-team-dynamics.html

#AI #AIResearch #HumanAI #ExoticTeamDynamics #Innovation

RC Trustworthy Data Science Mar 11

Chatbots increasingly recommend products, services or even financial advice. 🤖💬

On 12 March, Nicole Krämer, Scientific Director of RC Trust, joins a policy discussion at the NRW Ministry for Consumer Protection at the event
“Chatbot and AI Agent: (Not) a Friend and Helper?”

The panel will explore trust, transparency and risks in AI-driven communication.

#AI #TrustworthyAI #ConsumerProtection #DigitalPolicy #AIethics #HumanAI #RCTrust

Photo: Till Niermann – CC BY-SA 3.0 edited

Tim Meßmer Mar 9

Technologie entsteht nicht nur aus Code.

Sie entsteht aus Sprache, Kultur und Ethik.

Bei Enunova versuchen wir diese Räume wieder zusammenzudenken.

Nicht als System –
sondern als offenen Denkraum.

#AI
#Future
#Technology
#Ethics
#HumanAI
#Innovation

sayzard Mar 7

Alex Imas (@alexolegimas)

작성자는 'centaur' 용어를 비표준적으로 사용한다고 밝히며, 여기서는 'AI와 함께 작업해 인간이 혼자서는 생성할 수 없는 결과를 만들어내는 인간'을 의미한다고 설명합니다. @sebkrier가 언급한 'cyborg era' 글을 인용해 인간-AI 협업(사이보그 시대) 개념을 정리하고, 인간과 AI의 결합적 창작을 강조합니다.

https://x.com/alexolegimas/status/2030340791537729580

#humanai #centaur #aicollaboration #cyborgera

Alex Imas (@alexolegimas) on X

One thing I wanted to clarify: I am using the term "centaur" in perhaps a non-standard way. Here, I mean "human working with AI to produce work that they would otherwise not be able to generate." This is what @sebkrier referred to as the "cyborg era" (https://t.co/wKd4j2JLcQ)

X (formerly Twitter)