Introducing Unsloth Studio: A new open-source web UI to train and run LLMs

Tools 905 points 145 comments 3 days ago

Hey r/LocalLlama, we're super excited to launch Unsloth Studio (Beta), a new open-source web UI to train and run LLMs in one unified local UI interface. GitHub: https://github.com/unslothai/unsloth Here is an overview of Unsloth Studio's key features: * Run models locally on **Mac, Windows**, and Linux * Train **500+ models** 2x faster with 70% less VRAM * Supports **GGUF**, vision, audio, and embedding models * **Compare** and battle models **side-by-side** * **Self-healing** tool calling and **web search** * **Auto-create datasets** from **PDF, CSV**, and **DOCX** * **Code execution** lets LLMs test code for more accurate outputs * **Export** models to GGUF, Safetensors, and more * Auto inference parameter tuning (temp, top-p, etc.) + edit chat templates Blog + everything you need to know: https://unsloth.ai/docs/new/studio Install via: pip install unsloth unsloth studio setup unsloth studio -H 0.0.0.0 -p 8888 In the next few days we intend to push out many updates and new features. If you have any questions or encounter any issues, feel free to make a GitHub issue or let us know here.

More from r/LocalLLaMA