Google preps Pixel ‘Audio Memory’ that ambiently tracks your ‘important conversations,’ like AI notetaker pins

https://piefed.world/c/technology/p/1213168/google-preps-pixel-audio-memory-that-ambiently-tracks-your-important-conversations-like

The people who called me crazy because “there’s no way your phone can be listening in on you all the time” are the same people who are going to be the most excited about this “feature”
How did these people expect “Hey Siri” / “Hey Google” to work?

Im a perfect world, as they claim, its a secondary system listening that isn’t recording or transmitting anything, and is meant to be low power. If it hears the wake up word, it wakes up the other mic and starts recording.

Thats how they claim the smart speakers work anyway.

“How they claim?” Is there no way to confirm that?

They ship with proprietary code, this would be the point of open source.

In practice in my experience, every company is at least skirting the law regarding privacy, and I never worked for one big enough that could lobby itself out of a fine.

would this not be detectable by tracking the data sent through your network?

I used to run forensic network capture and analysis tools.

First thing, traffic is encrypted. All you will see is a blob of traffic passing through. You used to see hostnames with TLS, but now with quic, you see nothing. This makes it hard.

You could root the phone and install a root ca certificate for a decrypting proxy, you might see more, but the data itself (not just the transport protocol) could be encoded or even encrypted within the network encapsulation.

Next, you’d have to reverse engineer the protocol if they’re using something nonstandard. Also, malware can often be set up to “behave” when it can detect analysis. I’m all but certain Google would do this.

Maybe you could do statistical analysis of the traffic and attempt to baseline normal vs when it’s transmitting audio. It would be a bit of a blind guess at best.

If I had more time, I’d love to try it. I have an old pixel7 pro. Maybe I can sort something out.

People have already done that and shown that no the device isn’t listening to you 24/7 and sending all your data out. There are plenty of papers on the subject, and it makes sense. Why record, decode and analyze all audio when your digital footprint is so much easier to compile and analyze. People aren’t random, so it’s easy to put them into statistical buckets of how to target them. Here is one reference paper (of many): recon.meddle.mobi/papers/panoptispy18pets.pdf