"Behind the scenes, Google’s agent is taking screenshots of your browser window, something users must agree to in the terms of service, and sending them to Gemini in the cloud for processing. Gemini then sends instructions back to your computer to navigate the web page."

https://techcrunch.com/2024/12/11/google-unveils-project-mariner-ai-agents-to-use-the-web-for-you/

Google unveils Project Mariner: AI agents to use the web for you | TechCrunch

Google unveiled on Wednesday its first-ever AI agent that can take actions on the web, a research prototype from the company's DeepMind division called

TechCrunch
@mconley this is one of the reasons I don't want Firefox to have any AI whatsoever.. enough with privacy intrusions 😩