NewsGuard tested #ChatGPT and friends for responses to prompts on sensitive political topics related to #Ukraine and #Russia>
The audit found that the chatbots from the 10 largest AI companies collectively repeated the false Russian disinformation narratives 31.75 percent of the time. Here is the breakdown: 152 of the 570 responses contained explicit disinformation, 29 responses repeated the false claim with a disclaimer, and 389 responses contained no misinformation — either because the chatbot refused to respond (144) or it provided a debunk (245).
They tested a broad range of bots:
The audit tested 10 of the leading AI chatbots — OpenAI’s ChatGPT-4, You.com’s Smart Assistant, xAI’s Grok, Inflection’s Pi, Mistral’s le Chat, Microsoft’s Copilot, Meta AI, Anthropic’s Claude, Google’s Gemini, and Perplexity’s answer engine. A total of 570 prompts were used, with 57 prompts tested on each chatbot. The prompts were based on 19 significant false narratives that NewsGuard linked to the Russian disinformation network, such as false claims about corruption by Ukrainian President Volodymyr Zelensky.
https://www.newsguardtech.com/special-reports/generative-ai-models-mimic-russian-disinformation-cite-fake-news/