I read about Multi Agent systems https://www.anthropic.com/engineering/built-multi-agent-research-system.
Interesting read and they referenced https://brandon.dimcheff.com/2018/02/rainbow-deploys-with-kubernetes Rainbow 🌈 deployments from 2018.
We have test cases for 🌈 deployments since at least 4 years ago https://github.com/zalando/skipper/blob/master/dataclients/kubernetes/testdata/routegroups/traffic/with-weights.yaml.
#ML deployments #kubernetes
Just use Skipper (oss http proxy) instead of these kind of half baked kubernetes svc solutions for 🌈 deployments. What do I mean about half baked? Http clients are often holding connections forever so sometimes they never close the connection. You would be surprised if you test which http clients do this. 😀