Homelab has paid for itself! (at least this is how I justify it...)

Tools 793 points 115 comments 5 days ago

Hey, I thought I'd do an update on my Homelab I posted a while back. I have it running on LLM experiments, which I wrote up here. Basically, it seems I may have discovered LLM Neuroanatomy, and am now using the server to map out current LLM's like the Qwen3.5 and GLM series (thats the partial 'Brain Scan' images here). Anyway, I have the rig power though a Tasmota, and log everything to Grafana. My power costs are pretty high over here in Munich, but calculating with a cost of about $3.50 per GH100 module per hour (*H100s range in price, but these have 480GB system RAM and 8TB SSD per chip, so I think $3.50 is about right*), I would have paid today $10,000.00 in on-demand GPU use. As I paid $9000 all up, and power was definitely less than $1000, I am officially ahead! Remember, stick to the story if my wife asks!

More from r/LocalLLaMA