brainlessMar 17

Unsloth Studio

https://unsloth.ai/docs/new/studio

Introducing Unsloth Studio | Unsloth Documentation

Run and train AI models locally with Unsloth Studio.

Show threadtrvz

Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.

This needs to go on homebrew or be a zip file with an app for manual download.

Mar 17 at 9:17pmWeb
Show threadDIVx0Mar 17
Agree with you, a slightly more maintainable way to use it now is with "uv" or mise. i've used `uv tool install unsloth` for this one.
Show threaddanielhanchenMar 17
Yep - uv is a better fit - and you get parallel downloads as well
Show threadsaagarjhaMar 18
It's not just uv, it also will drop an nvm install in your home directory :(
Show threadComputer0Mar 17
On my linux systems I use venv to not affect system packages, is that not an option for this situation?
Show threadbityardMar 17
I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.
Show threaddanielhanchenMar 17
Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically
Show threadmmis1000Mar 18
I think the website should probably mention those installation preset in unsloth pyproject.toml though. The website instruct you to install dependencies separately. But it turns out there are dedicated preset that install specific rocm/cuda/xpu version in the project.
Show threadanentropicMar 18
or `uv tool install unsloth` for a safe 'global' installation
Show threaddanielhanchenMar 17

Hey we're still working on making installation much better - appreciate the feedback!

We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!

Show threadmmis1000Mar 18

Uv helps you up though. Use a pyproject.toml and uv sync. Everything will be put into the venv only, nothing spread across the whole system.

The pyproject.toml can even handles build env for you, so you no longer need a setup.sh that installs 10 tool in specific order with specific flag to produce working environment. A single uv sync, and the job is done.

Plus the result is reproducible, so if this time uv sync work, then it also work next time.

Highly recommend if you are still on pip.

Note: Take a example that I used to install unsloth with rocm setup that based on unreleased git version dependencies and graphic card specific build flag, all of them can be handled with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...

[Feature] Windows AMD GPU Support · Issue #4280 · unslothai/unsloth

AMD has released beta ROCm builds for Windows, and I have tried for many hours to get Unsloth working with my RX 7900 XTX on Windows (and wsl) with no luck. Will there (in the foreseeable future) b...

GitHub