Junk-box local AI server build log:
-Purchased 2 more 2080 Ti GPUs
-Industrial Chassis in hand
-32GB DDR3 in hand
-Mobo+CPU+PSU ordered.
-Intel Core i7-3930K (6 Cores / 12 Threads)
-Gigabyte GA-X79-UD5 (LGA 2011 Socket)
-32GB DDR3 (4 x 8GB Sticks, configured for Quad-Channel)
-3 x nVIDIA GeForce RTX 2080 Ti Blower Edition (11GB each / 33GB Total VRAM)
-Rosewill 80-Gold 1000W Power Supply
-Multiple SATA SSDs (RAID 0)
-Advantech Industrial Chassis
-Operating System: Ubuntu Linux 24.04 LTS
-Text Generation Frontend: Text Generation WebUI (Oobabooga)
-LLM Engine Backend: ExLlamaV2 (EXL2 model format)
-Image Generation Platform: ComfyUI
-Multi-GPU Orchestration: ComfyUI-MultiGPU (DisTorch 2.0)
-Networking & Remote Access: NetBird VPN (WireGuard)
EDIT: I found a quad 3.5" SATA backplane/rack and modded it in there for a factory fit! That replaced the IDE CDROM that was in there 😆
#LocalAI, #SelfHosted, #Homelab, #BudgetBuild, #ComfyUI, #HardwareHacking








