vsoch

If you are interested in scheduler design between #Kubernetes and #HPC, I put together a fun talk that overviews some of the high level design approaches that we see!

https://youtu.be/-36DlwrSPec

And I introduce a prototype for a new idea - application (container) level scheduling!

Pancake Elasticity: Scheduling to Application Containers in Kubernetes 🥞️

YouTube
Jul 8, 2024 at 8:42pmWeb
Show threadvsochJul 8, 2024
Specifically, I discuss several levels to think about scheduling workloads in #Kubernetes, moving from the top level to custom plugins and controllers, scheduler ecosystems (#kueue and #volcanosh), and down to partition based scheduling. Are there gotchas in there? You bet! 😆
Show threadvsochJul 8, 2024
Along with talking about the #FluxFramework Operator (a partition-based strategy), I introduce a prototype to schedule to specific applications (brokers controlling a set of containers across pods) running in a Flux Framework #MiniCluster. I call this "pancake elasticity." 🥞
Show threadvsochJul 8, 2024
I come to some conclusions about #Kubernetes and workload (gang) scheduling that you may agree or disagree with. Either way, these conclusions explain why this space is so exciting to work in. There are unsolved problems that we are still figuring out. There is fun work to do! 🥳
Show threadvsochJul 8, 2024
Finally, I want to encourage others to share work early and often! We often wait for permission to give a talk at some venue, where talks might not be made public and are limited in time. While there is value in venues, I'm an advocate for speaking when you have something to say.
Show threadvsochJul 8, 2024

Here is the talk (and linked demo) for "Pancake Elasticity: Scheduling to Application Containers in #Kubernetes" 🥞

https://youtu.be/-36DlwrSPec

I made the slides last week, recorded in one shot on Saturday, and now am moving on to a next step! I love this work, and hope you do too.❤️

Pancake Elasticity: Scheduling to Application Containers in Kubernetes 🥞️

YouTube