Nix ❄️ is awesome!

Text Generation Inference (TGI) has some fast-moving dependencies that are expensive to compile. So, it can be hard to quickly set up a reproducible TGI dev environment.

We have packed up our dependencies as Nix derivations and made the TGI repo a flake. Thanks to Nix and @cachix you can now have a full, reproducible TGI dev environment in under 30 seconds with a single 'nix develop'.