@cirriustech
From what I can tell, Azure serverless in particular is well architected and avoids cross tenant infra sharing. However that’s not the case for other AI/ML cloud providers (DigitalOcean, Replicate, RunPod, Vast.ai, Heroku, are a few that come to mind) that rely on OS level containerization for isolation. Cross tenant access is a huge concern there; that’s a main reason why I chose this target!
Even in “good” setups like Azure, GPU compromise is still a concern for a few reasons.
For example supply chain attacks via compromised container images or malicious models (we’re already seeing examples of this happening!), a compromised data scienctist running untrusted workloads, or even GPU side channel attacks.