Hacker NewsMay 18

Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

https://modal.com/blog/truly-serverless-gpus

#HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

How to achieve truly serverless GPUs

A deep dive on Modal's deep tech for fast boots.

Modal