vsochJul 8, 2024

If you are interested in scheduler design between #Kubernetes and #HPC, I put together a fun talk that overviews some of the high level design approaches that we see!

https://youtu.be/-36DlwrSPec

And I introduce a prototype for a new idea - application (container) level scheduling!

Pancake Elasticity: Scheduling to Application Containers in Kubernetes 🥞️

YouTube
Show threadvsochJul 8, 2024
Specifically, I discuss several levels to think about scheduling workloads in #Kubernetes, moving from the top level to custom plugins and controllers, scheduler ecosystems (#kueue and #volcanosh), and down to partition based scheduling. Are there gotchas in there? You bet! 😆
Show threadvsochJul 8, 2024
Along with talking about the #FluxFramework Operator (a partition-based strategy), I introduce a prototype to schedule to specific applications (brokers controlling a set of containers across pods) running in a Flux Framework #MiniCluster. I call this "pancake elasticity." 🥞
Show threadvsoch
I come to some conclusions about #Kubernetes and workload (gang) scheduling that you may agree or disagree with. Either way, these conclusions explain why this space is so exciting to work in. There are unsolved problems that we are still figuring out. There is fun work to do! 🥳
Jul 8, 2024 at 8:45pmWeb