Read it here: https://solihullpublishing.com/blog/f/the-potential-for-ai-to-manipulate-elections
#AIandDemocracy #ElectionIntegrity #AIrisks #DigitalEthics
"Connect the Dots: Knowledge Graph-Guided Crawler Attack on Retrieval-Augmented Generation Systems"
Stealing attacks pose a persistent threat to the intellectual property of deployed AI systems. Retrieval-augmented generation (RAG) intensifies this risk by extending the attack surface beyond model weights. The authors formulate a new attack against RAG systems that can steal private or intellectual property data.

Stealing attacks pose a persistent threat to the intellectual property of deployed machine-learning systems. Retrieval-augmented generation (RAG) intensifies this risk by extending the attack surface beyond model weights to knowledge base that often contains IP-bearing assets such as proprietary runbooks, curated domain collections, or licensed documents. Recent work shows that multi-turn questioning can gradually steal corpus content from RAG systems, yet existing attacks are largely heuristic and often plateau early. We address this gap by formulating RAG knowledge-base stealing as an adaptive stochastic coverage problem (ASCP), where each query is a stochastic action and the goal is to maximize the conditional expected marginal gain (CMG) in corpus coverage under a query budget. Bridging ASCP to real-world black-box RAG knowledge-base stealing raises three challenges: CMG is unobservable, the natural-language action space is intractably large, and feasibility constraints require stealthy queries that remain effective under diverse architectures. We introduce RAGCrawler, a knowledge graph-guided attacker that maintains a global attacker-side state to estimate coverage gains, schedule high-value semantic anchors, and generate non-redundant natural queries. Across four corpora and four generators with BGE retriever, RAGCrawler achieves 66.8% average coverage (up to 84.4%) within 1,000 queries, improving coverage by 44.90% relative to the strongest baseline. It also reduces the queries needed to reach 70% coverage by at least 4.03x on average and enables surrogate reconstruction with answer similarity up to 0.699. Our attack is also scalable to retriever switching and newer RAG techniques like query rewriting and multi-query retrieval. These results highlight urgent needs to protect RAG knowledge assets.
AI Safety Leader Departs Major Firm, Citing Global Peril and Pursuing Poetry
https://newsletter.tf/ai-safety-leader-leaves-anthropic-poetry-danger/
An AI safety expert left his job at Anthropic, warning the world is in danger, and will now study poetry.
#AISafety, #Anthropic, #AIrisks, #FutureTech, #GlobalConcerns
AI Safety Leader Leaves Job, Says World is in Danger, Will Study Poetry
An AI safety expert named Mrinank Sharma has left his job at Anthropic. He said he feels the world is in danger and wants to study poetry now. This comes after Anthropic released a new AI model called Claude 4.6.
https://newsletter.tf/ai-safety-leader-leaves-anthropic-poetry-danger/
#AISafety, #Anthropic, #AIrisks, #FutureTech, #GlobalConcerns