David hernandez

@david2127
6 Followers
17 Following
30 Posts

Anyone has implemented gang scheduling for Ray clusters with per ray cluster granularity. I do not need ”fancy” borrowing or fairness. But I do want per Ray cluster not per let’s say namespace shared quota. Any tips?

#Ray #Kueue #Volcano

Anyone has implemented gang scheduling for Ray clusters with per ray cluster granularity. I do not need ”fancy” borrowing or fairness. But I do want per Ray cluster not per let’s say namespace shared quota. Any tips?

#Ray #Kueue #Volcano

@jmaupetit cool thanks for sharing.
But then you need to type on the tape all the commands that you need like running the server in the background? And vsh will actually run the command?

Anyone has experimented with spot VMs for celery workloads and set task_reject_on_worker_lost = ”True”?

#celery #python

It is possible to use cloud autoscaler alongside karpenter on the same cluster?

#k8s #karpenter

@Marcus maybe ignore differences of the application? https://argo-cd.readthedocs.io/en/stable/user-guide/diffing/
Diff Customization - Argo CD - Declarative GitOps CD for Kubernetes

Has anyone tried successfully the bpfman https://bpfman.io/main/ quick start on kind cluster where cilium was installed

I am not 100% sure but I think while trying to mount bpf fs it messes up with cilium bpf fs

bpfman

@alonshrestha thanks for the clarification
@alonshrestha but shouldn’t they be using the internal IPs from the overlay network, maybe this is why are you complaining on the first place. We also put a cap to the max number of pods per node, not sure if it is relevant on your environment
@alonshrestha hej, so with local IPs do you mean something like an overlay (internal IPs for pods) and maybe subnet IP is probably the IP of the node where egress traffic will come out from to for example other AWS services?. And I am also guessing that the error appeared at the creation time of the worker node not when you tried to reach another AWS service. PS I actually use Azure AKS but was just curious