Hacker NewsSep 8, 2024
Serving AI from the Basement – 192GB of VRAM Setup
https://ahmadosman.com/blog/serving-ai-from-basement/
#ycombinator #Ahmad_Osman #Ahmad_M_Osman #Software_Engineer #Machine_Learning #Large_Language_Models #LLM #Homelab #AI_Server #Full_stack_web_development #Python_programming #Software_Developer_Blog #Data_Science #Home_Lab_Projects #Home_lab_setup_for_AI #Egyptian_in_the_US_software_engineer #Web_Development
Serving AI From The Basement: 192GB of VRAM Setup

Dedicated LLM server powered by 8x RTX 3090 Graphic Cards, boasting a total of 192GB of VRAM.

Osman's Odyssey: Byte & Build