Taylor Arndt@twostraws I fine-tuned a language model on a MacBook Neo with 8GB of RAM.
Peak memory: 2.3 GB. Training time: 20 minutes. Cost: $0.
None of this works without MLX. Thank you to the MLX team for making local training actually accessible.
Full writeup on what I got wrong and what finally worked:
taylorarndt.substack.com/p/i-trained-an-llm-on-my-macbook-neo
#MLX #AppleSilicon #MacBookNeo #MachineLearning #FineTuning #LocalAI #Swift #Apple
Peak memory: 2.3 GB. Training time: 20 minutes. Cost: $0.
None of this works without MLX. Thank you to the MLX team for making local training actually accessible.
Full writeup on what I got wrong and what finally worked:
taylorarndt.substack.com/p/i-trained-an-llm-on-my-macbook-neo
#MLX #AppleSilicon #MacBookNeo #MachineLearning #FineTuning #LocalAI #Swift #Apple