Tools

Kitten TTS V0.8 is out: New SOTA Super-tiny TTS Model (Less than 25 MB)

Model introduction: New Kitten models are out. Kitten ML has released open source code and weights for three new tiny...

Thank you Chinese devs for providing for the community if it not for them we'll be still stuck at stable diffusion 1.5

Z.ai said they are GPU starved, openly.

Hugging Face Is Teasing Something Anthropic Related

Anthropic are the guys that make the Claude Models. I highly doubt this will be an Openweights LLM release. More likely...

A clear and boundless sky

No NVIDIA? No Problem. My 2018 "Potato" 8th Gen i3 hits 10 TPS on 16B MoE.

I’m writing this from Burma. Out here, we can’t all afford the latest NVIDIA 4090s or high-end MacBooks. If you have a...

So Colorfully 😾

Never forget…

Yann LeCun says the best open models are not coming from the West. Researchers across the field are using Chinese models. Openness drove AI progress. Close access, and the West risks slowing itself.

From Forbes on YouTube: Yann LeCun Gives Unfiltered Take On The Future Of AI In Davos: Video by vitrupo on 𝕏:

So dreamy🥰

How do I do this, but local?

Here it is boys, Z Base

Link: Comfy

I converted some Half Life 1/2 screenshots into real life with the help of Klein 4b!

I know that there are AI video generators out there that can do this 10x better and image generators too, but I was...

My story of underestimating /r/LocalLLaMA's thirst for VRAM

LTX-2 vs. Wan 2.2 - The Anime Series

Surgical masking with Wan 2.2 Animate in ComfyUI

Surgical masking lets you preserve the original scene’s performance and image quality, keeping everything intact while...

Tao of the Ring

I'm 100% convinced that it's the NFT-bros pushing all the openclawd engagement on X

I'm absolutely sure of it. The same usual suspects, the same language, the same who stole from whom the next million...

More quantization visualization types (repost)

Inspired by this post from u/VoidAlchemy a few months back: Intrusive thoughts had me try to reproduce and extend the...

I plugged a $30 radio into my Mac mini and told my AI "connect to this" — now I control my smart home and send voice messages over radio with zero internet

Hey r/LocalLLaMA, So I live in Ukraine during the war. Power goes out a lot here – russia regularly attacks our power...

PSA: DDR5 RDIMM price passed the point were 3090 are less expensive per gb..

Hello all, Just wanted to note that RDIMM prices are so wild.. Stacking rdimms starts to be as expensive as stacking...

KaniTTS2 — open-source 400M TTS model with voice cloning, runs in 3GB VRAM. Pretrain code included.

Hey everyone, we just open-sourced KaniTTS2 - a text-to-speech model designed for real-time conversational use cases....

Heretic 1.2 released: 70% lower VRAM usage with quantization, Magnitude-Preserving Orthogonal Ablation ("derestriction"), broad VL model support, session resumption, and more

Llamas and Gentlemen, Heretic ( is the leading software for removing censorship from language models. In the three...

The gap between open-weight and proprietary model intelligence is as small as it has ever been, with Claude Opus 4.6 and GLM-5'

GPT-OSS 120b Uncensored Aggressive Release (MXFP4 GGUF)

Hey everyone, made an uncensored version of GPT-OSS 120B. Quick specs: 117B total params, \~5.1B active (MoE with 128...

SWE-rebench Jan 2026: GLM-5, MiniMax M2.5, Qwen3-Coder-Next, Opus 4.6, Codex Performance

Hi all, I’m Anton from Nebius. We’ve updated the SWE-rebench leaderboard with our January runs on 48 fresh GitHub PR...

MiniMaxAI/MiniMax-M2.5 · Hugging Face

You can monitor quants begin to appear with this search:

UG student launches Dhi-5B (Trained from Scratch)

Hii everyone, I present Dhi-5B: A 5 billion parameter Multimodal Language Model trained compute optimally with just...

I restored a few historical figures, using Flux.2 Klein 9B.

So mainly as a test and for fun, I used Flux.2 Klein 9B to restore some historical figures. Results are pretty good....

MiniMaxAI MiniMax-M2.5 has 230b parameters and 10b active parameters

OpenHands reveals the model size in their announcement. Still waiting for the model to appear on HF.

Why do we allow "un-local" content

Title somewhat says it all. I get that it's related but if links to new models are being discussed shouldn't it be a...

Minimax M2.5 Officially Out

Only official webpages released now. But the bench looks very promising: SWE-Bench Verified 80.2% Multi-SWE-Bench 51.3%...

Unsloth just unleashed Glm 5! GGUF NOW!

#SaveLocalLLaMA

GLM-5 scores 50 on the Intelligence Index and is the new open weights leader!

DC Ancient Futurism Style 1

Trained with AI-Toolkit Using Runpod for 7000 steps Rank 32 (All standard flux klein 9B base settings) Tagged with...

GLM-5 Officially Released

We are launching GLM-5, targeting complex systems engineering and long-horizon agentic tasks. Scaling is still one of...

MiniMax M2.5 Released

GLM 5 Released

The realism that you wanted - Z Image Base (and Turbo) LoRA

Train MoE models 12x faster with 30% less memory! (<15GB VRAM)

Hey r/LocalLlama! We’re excited to introduce \~12x faster Mixture of Experts (MoE) training with >35% less VRAM and...

Kimi is so smart

Kimi > ChatGPT = Claude

Qwen-Image-2.0 is out - 7B unified gen+edit model with native 2K and actual text rendering

Qwen team just released Qwen-Image-2.0. Before anyone asks - no open weights yet, it's API-only on Alibaba Cloud...

MechaEpstein-8000

I know it has already been done but this is my AI trained on Epstein Emails. Surprisingly hard to do, as most LLMs will...

Do not Let the "Coder" in Qwen3-Coder-Next Fool You! It's the Smartest, General Purpose Model of its Size

Like many of you, I like to use LLM as tools to help improve my daily life, from editing my emails, to online search....

Only the OGs remember this.

Bad news for local bros

Qwen3.5 Support Merged in llama.cpp

I built a rough .gguf LLM visualizer

I hacked together a small tool that lets you upload a .gguf file and visualize its internals in a 3D-ish way (layers /...

Qwen3 Coder Next as first "usable" coding model < 60 GB for me

I've tried lots of "small" models < 60 GB in the past. GLM 4.5 Air, GLM 4.7 Flash, GPT OSS 20B and 120B, Magistral,...

PR opened for Qwen3.5!!

Looking at the code at src/transformers/models/qwen35/modelingqwen3_5.py, it looks like Qwen3.5 series will have VLMs...

I trained a 1.8M params model from scratch on a total of ~40M tokens.

Ok so I've been working & experimenting with my own simple architecture. I call it Strawberry Here's the repo for...

Prompt injection is killing our self-hosted LLM deployment

We moved to self-hosted models specifically to avoid sending customer data to external APIs. Everything was working...

Nemo 30B is insane. 1M+ token CTX on one 3090

Been playing around with llama.cpp and some 30-80B parameter models with CPU offloading. Currently have one 3090 and 32...

A top-downloaded OpenClaw skill is actually a staged malware delivery chain

Here we go! As expected by most of us here. Jason Meller from 1password argues that OpenClaw’s agent “skills” ecosystem...

GLM 5 Is Being Tested On OpenRouter

[Release] Experimental Model with Subquadratic Attention: 100 tok/s @ 1M context, 76 tok/s @ 10M context (30B model, single GPU)

Hey everyone, Last week I shared preliminary results on a new subquadratic attention mechanism ( Following up with the...

CPU-only, no GPU computers can run all kinds of AI tools locally

While it’s great that so many people on LocalLLaMA are pushing the envelope with what can be done locally with...

I am absolutely loving qwen3-235b

I installed qwen3-235b on my desktop system, and I had to join here to brag about it. It's such a careful model, the...

BalatroBench - Benchmark LLMs' strategic performance in Balatro

If you own a copy of Balatro, you can make your local LLM play it. I built tools to let LLMs play Balatro autonomously....

Google Research announces Sequential Attention: Making AI models leaner and faster without sacrificing accuracy

Qwen3-Coder-Next on RTX 5060 Ti 16 GB - Some numbers

About 2 weeks ago, I posted about running GLM-4.7-Flash on 16 GB of VRAM here...

mistralai/Voxtral-Mini-4B-Realtime-2602 · Hugging Face

Voxtral Mini 4B Realtime 2602 is a multilingual, realtime speech-transcription model and among the first open-source...

Bashing Ollama isn’t just a pleasure, it’s a duty

ACE-Step-1.5 has just been released. It’s an MIT-licensed open source audio generative model with performance close to commercial platforms like Suno

It’s already supported in Comfy. MIT license. HuggingFace Demo is also available! Pretty much the whole package - LoRAs...

The open-source version of Suno is finally here: ACE-Step 1.5

ACE-Step 1.5 is an open-source music model that can generate a full song in about 2 seconds on an A100, runs locally on...

Qwen3-Coder-Next

Qwen3-Coder-Next is out!

Qwen/Qwen3-Coder-Next · Hugging Face

GLM-5 Coming in February! It's confirmed.

Twitter Link:

How close are open-weight models to "SOTA"? My honest take as of today, benchmarks be damned.

Cline team got absorbed by OpenAI. Kilo is going full source available in response.

For those who used Cline with local models, heads up that the core team appears to have joined OpenAI's Codex group...

LingBot-World outperforms Genie 3 in dynamic simulation and is fully Open Source

The newly released LingBot-World framework offers the first high capability world model that is fully open source,...

Mistral CEO Arthur Mensch: “If you treat intelligence as electricity, then you just want to make sure that your access to intelligence cannot be throttled.”

GitHub trending this week: half the repos are agent frameworks. 90% will be dead in 1 week.

It this the js framework hell moment of ai?

Embark on a forest journey

Aurora Town

hallelujah.

still works though

Dream Relic 3

Z-Image + Qwen Image Edit 2511 + Wan 2.2 + MMAudio

A year ago, I never imagined I’d be able to generate a video like this on my own computer. (5070ti gpu) It’s still...

768Gb Fully Enclosed 10x GPU Mobile AI Build

I haven't seen a system with this format before but with how successful the result was I figured I might as well share...

Small lovely robotic critters

Examples of prompt: 1) Hyperreal macro photo of a robotic cockroach, oil-stained titanium plates with grime in the...

an artificial zombie apocalypse.

It's been one year since the release of Deepseek-R1

Unsloth GLM 4.7-Flash GGUF

GLM 4.7 Flash official support merged in llama.cpp

My gpu poor comrades, GLM 4.7 Flash is your local agent

I tried many MoE models at 30B or under and all of them failed sooner or later in an agentic framework. If z.ai is not...

Eldritch ruins... Midjourney really is something else, huh.

I specifically requested no meaningless or decorative details, no clutter. Sharp clarity and unified coherent lines...

🧠💥 My HomeLab GPU Cluster – 12× RTX 5090, AI / K8s / Self-Hosted Everything

After months of planning, wiring, airflow tuning, and too many late nights this is my home lab GPU cluster finally up...

zai-org/GLM-4.7-Flash · Hugging Face

Twilight Beyond the Gate

Source — DarkWall

What is an automation that surprisingly worked better than you expected?

I recently got into the world of automations for both my business and personally and have been super stoked about the...

IAJRFTAS - I Am Just Really Fond of This (AI) Art Style

Not saying that its better than anything else, this just hits whatever switch it needs to hit. (and yes - before you...

The Gothic Empress

Source — DarkWall

Fantasy Toons

4x AMD R9700 (128GB VRAM) + Threadripper 9955WX Build

Disclaimer: I am from Germany and my English is not perfect, so I used an LLM to help me structure and write this post....

Terraforge greenhouses

How to generate proper Japanese in LTX-2

So, after the recent anime clip posted here a few days ago that got a lot of praise for the visuals, I noticed the...

Lords of Eternity

FLUX 2 Klein 4B vs 9B Multi Camera Angles - One Click, 8 Camera Angles

Just wanted to share this workflow I put together that generates the same character from 8 different camera angles in a...

Dresser v1.0 | Clothing generation with body shape preservation and alpha channel clipping | IL\SDXL\NoobAI

Good afternoon! I'm a little late with this workflow)). Now that Flux.2 Klein has been released and z-image-edit is...

I used temporal time dilation to generate this 60-second video in LTX-2 on my 5070TI in just under two minutes. My GPU didn't even break a sweat. Workflow and explanation in comments (without subgraphs or 'Everything Everywhere All At Once' invisible noodles).

Qwen 4 might be a long way off !? Lead Dev says they are "slowing down" to focus on quality.

128GB VRAM quad R9700 server

This is a sequel to my previous thread from 2024. I originally planned to pick up another pair of MI100s and an...

The Search for Uncensored AI (That Isn’t Adult-Oriented)

I’ve been trying to find an AI that’s genuinely unfiltered and technically advanced, uncensored something that can...

Untitled 33

LTX 2 is amazing : LTX-2 in ComfyUI on RTX 3060 12GB

My setup: RTX 3060 12GB VRAM + 48GB system RAM. I spent the last couple of days messing around with LTX-2 inside...

Best "End of world" model that will run on 24gb VRAM

Hey peeps, I'm feeling in a bit of a omg the world is ending mood and have been amusing myself by downloading and...

The Leilothl

DeepSeek Engram : A static memory unit for LLMs

DeeepSeek AI released a new paper titled "Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large...

Testing my sketches with flux-2-klein 9B

[FLUX.2 \[klein\] 4B & 9B - Fast local image editing and generation]( I'm using flux-2-klein-9b-Q3\K\M.gguf...

LTX-2 - Alignment?

Great model! The voices are getting better but consistency between scenes is a little random

For some things, Z-Image is still king, with Klein often looking overdone

Klein is excellent, particularly for its editing capabilities, however.... I think Z-Image is still king for...

Market of the Modified | Episode 10

If you enjoy this video, consider watching the other episodes in this universe for this video to make sense. Tools...

33 Second 1920x1088 video at 24fps (800 frames) on a single 4090 with memory to spare, this node should help out most people of any GPU size

Made using a custom node which can be found on my github here: Used workflow from here: This video is uploaded to my...

Wasteland nomads

GPT-5.2 xhigh, GLM-4.7, Kimi K2 Thinking, DeepSeek v3.2 on Fresh SWE-rebench (December 2025)

Hi all, I’m Anton from Nebius. We’ve updated the SWE-bench leaderboard with our December runs on 48 fresh GitHub PR...

I fucking love this community

Thank you guys, thanks to everyone who took the time to write a comment or a post explaining, teaching people how...

They are back

Hot take from someone who works in AI automation: most teams are automating the wrong things.

I work in automation for business, and lately I’ve been seeing the same problem over and over. Teams are racing to...

Dang, M2 drives are the new DDR5 apparently.

Latest upgrade…A100 40 GB

Originally this was my gaming rig but I went ITX and basically bought a new computer. So I had the case, fans, AIO, 64...

LTX-2 Updates

We were overwhelmed by the community response to LTX-2 last week. From the moment we released, this community jumped in...

Viking Influencer with LTX2 image 2 video with native generated audio. It can do accents

I tried playing with the native audio in the model, the quality still kinda meh but it there and it works. image in...

Chaos Gods

Nemotron-3-nano:30b is a spectacular general purpose local LLM

Just want to sing the praises of this model. I am stunned at how intelligent it is for a 30b model. Comparing it to...

7x Longer Context Reinforcement Learning in Unsloth

Hey r/LocalLlama! We're excited to show how Unsloth now enables 7x longer context lengths (up to 12x) for Reinforcement...

FLUX.2 [klein] 4B & 9B released

I was able play with Flux Klein before release and it's a blast. 4B uses Qwen3B and takes 1.3 seconds with 4 steps on...

Got tired of reading AI news, so I built an automation that does it for me (18 sources, 100+ hrs saved)

Like a lot of people, I’ve been struggling to keep up with the latest developments in AI. I found that there were some...

RTX 5070 Ti and RTX 5060 Ti 16 GB no longer manufactured

Nvidia has essentially killed off supply for the RTX 5070 Ti. Also supply of RTX 5060 Ti 16 GB has been significantly...

I built a real-time 360 volumetric environment generator running entirely locally. Uses SD.cpp, Depth Anything V2, and LaMa, all within Unity Engine.

I wanted to create a "Holodeck" style experience where I could generate environments while inside VR, but I didn't want...

Untitled 32

Some Niji-7

I trained a model to 'unslop' AI prose

I ran passages from Project Gutenberg through GPT-4o-mini 10 times over, each time telling it to "make it read far...

Zhipu AI breaks US chip reliance with first major model trained on Huawei stack (GLM-Image)

LTX-2 I2V synced to an MP3: Distill Lora Quality STR 1 vs .6 - New Workflow Version 2.

New version of Workflow (v2): This is a follow-up to my previous post - please read it for more information and...

fashion. #26

tiktok: lvmiere\_ ig: lvmiere.vision soundtrack: Wilderness from Diablo II

WTF! LTX-2 is delivering for real 🫧 Made in 160s, 20steps on a 5090

Been away from local generation for a while, definitely impressed by the speed and overall quality!

The Knight, The girl, and her Dog.

NeuTTS Nano: 120M Parameter On-Device TTS based on Llama3

Hey everyone, The team at Neuphonic is back with a new open-source release: NeuTTS Nano. After NeuTTS Air trended #1 on...

Soprano 1.1-80M released: 95% fewer hallucinations and 63% preference rate over Soprano-80M

Hello everyone! Today, I am announcing Soprano 1.1! I’ve designed it for massively improved stability and audio quality...

NVIDIA's new 8B model is Orchestrator-8B, a specialized 8-billion-parameter AI designed not to answer everything itself, but to intelligently manage and route complex tasks to different tools (like web search, code execution, other LLMs) for greater efficiency

I’ve seen some arguments we’ve reached AGI, it’s just about putting the separate pieces together in the right context....

LTX, It do be like that,

civitai classed it as PG, if you feel otherwise, delete

Herbal Tea - Dark Whimsical oil painting

Midjourney is still King at Creating Spectacle

When's this wait gonna be over?

The Executioners of Heaven

We did not ascend. We were left to rot. Now, we are the only thing standing between the void and the world. The...

LTX2 Easy All in One Workflow.

Text to video, image to video, audio to video, image + audio to video, video extend, audio + video extend. All settings...

Untitled 31

GLM-Image explained: why autoregressive + diffusion actually matters

Seeing some confusion about what makes GLM-Image different so let me break it down. How diffusion models work (Flux,...