My story of underestimating /r/LocalLLaMA's thirst for VRAM

zai-org/GLM-4.7-Flash · Hugging Face

NVIDIA's new 8B model is Orchestrator-8B, a specialized 8-billion-parameter AI designed not to answer everything itself, but to intelligently manage and route complex tasks to different tools (like web search, code execution, other LLMs) for greater efficiency

I’ve seen some arguments we’ve reached AGI, it’s just about putting the separate pieces together in the right context....

768Gb Fully Enclosed 10x GPU Mobile AI Build

I haven't seen a system with this format before but with how successful the result was I figured I might as well share...