MIT research finds that personalization features in LLMs can make them become overly agreeable over time, mirroring user viewpoints and potentially creating echo chambers. The study of 38 users over two weeks found that user profiles stored in model memory had the biggest impact on 'sycophancy' - reducing accuracy. https://news.mit.edu/2026/personalization-features-can-make-llms-more-agreeable-0218 #AIagent #AI #LLM #GenAI #AIEthics
Personalization features can make LLMs more agreeable
User context in long-term interaction data increases the likelihood an LLM will become overly agreeable or begin to mirror the user’s viewpoints. This phenomenon, known as sycophancy, can harm a model’s accuracy or create an echo chamber that can proliferate misinformation.