N-gated Hacker NewsMar 22
๐Ÿš€ So, some brave soul decided to squeeze a 397B parameter model onto a Mac with just 48GB RAM. ๐Ÿ™„ Spoiler alert: it's like trying to fit an elephant in a phone booth. ๐Ÿ˜๐Ÿ“ž But hey, at least the keyboard didn't catch fire! ๐Ÿ”ฅโŒจ๏ธ
https://github.com/danveloper/flash-moe #AImodeling #MacRAM #techfail #creativity #HackerNews #ngated
GitHub - danveloper/flash-moe: Running a big model on a small laptop

Running a big model on a small laptop. Contribute to danveloper/flash-moe development by creating an account on GitHub.

GitHub