Tools

Forgive my ignorance but how is a 27B model better than 397B?

Is Qwen just incredibly good at doing dense and not so good at doing MoE? I get that dense is generally better than MoE...

Qwen 3.6 27B is out

Claude Code removed from Claude Pro plan - better time than ever to switch to Local Models.

Time to switch to Kimi k2.6 guys if you haven't already. For $20 a month you can buy the OpenCode Go coding plan (its...

Every time a new model comes out, the old one is obsolete of course

Kimi K2.6 is a legit Opus 4.7 replacement

After testing it and getting some customer feedback too, its the first model I'd confidently recommend to our customers...

Qwen3.6. This is it.

I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build. My God...

Qwen3.6-35B-A3B released!

Meet Qwen3.6-35B-A3B：Now Open-Source！🚀🚀 A sparse MoE model, 35B total params, 3B active. Apache 2.0 license. \-...

Dark Fantasy Realms

Free open-source tool to instantly rig and animate your illustrations (also with mesh deform)

If you haven't seen it yet, a model called see-through dropped last week. It takes a single static anime image and...

the state of LocalLLama

kepler-452b. GGUF when?

ashes to ashes.

anomaly.

Gemma 4 has been released

What’s new in Gemma 4 Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal,...

Claude code source code has been leaked via a map file in their npm registry

From Chaofan Shou on 𝕏 (files):

A simple explanation of the key idea behind TurboQuant

TurboQuant (Zandieh et al. 2025) has been all the rage in the past two days, and I've seen lots of comments here...

Google TurboQuant running Qwen Locally on MacAir

Hi everyone, we just ran an experiment. We patched llama.cpp with Google’s new TurboQuant compression method and then...

Google's new AI algorithm reduces memory 6x and increases speed 8x

Mistral AI to release Voxtral TTS, a 3-billion-parameter text-to-speech model with open weights that the company says outperformed ElevenLabs Flash v2.5 in human preference tests. The model runs on about 3 GB of RAM, achieves 90-millisecond time-to-first-audio, supports nine languages.

VentureBeat: Mistral AI just released a text-to-speech model it says beats ElevenLabs — and it's giving away the...

Intel will sell a cheap GPU with 32GB VRAM next week

It seems Intel will release a GPU with 32 GB of VRAM on March 31, which they would sell directly for $949. Bandwidth...

LM Studio may possibly be infected with sophisticated malware.

\\NO VIRUS\\ LM studio has stated it was a false positive and Microsoft dealt with it I'm no expert, just a tinkerer...

Alibaba confirms they are committed to continuously open-sourcing new Qwen and Wan models

Qwen wants you to know…

Seen while walking through Singapore’s Changi airport earlier this week. Alibaba Cloud spending up big on advertising.

Ooh, new drama just dropped 👀

For those out of the loop: cursor's new model, composer 2, is apparently built on top of Kimi K2.5 without any...

I feel personally attacked

Pagan

I was backend lead at Manus. After building agents for 2 years, I stopped using function calling entirely. Here's what I use instead.

> English is not my first language. I wrote this in Chinese and translated it with AI help. The writing may have...

M5 Max just arrived - benchmarks incoming

The M5 Max 128GB 14" has just arrived. I've been looking forward to putting this through its paces. Testing begins now....

This guy 🤡

At least T3 Code is open-source/MIT licensed.

How was this done? I've experimented a lot and nothing comes close to this guys work

Stickyspoodge admits to using ai in his work, and the hands and other tells in the full video show that it's clearly ai...

Qwen3.5 family comparison on shared benchmarks

Main takeaway: 122B, 35B, and especially 27B retain a lot of the flagship’s performance, while 2B/0.8B fall off much...

Final Qwen3.5 Unsloth GGUF Update!

Hey r/LocalLLaMA this week we worked on further improving the best size/KLD tradeoff for Qwen3.5, and we’re excited to...

Alibaba CEO: Qwen will remain open-source

PSA: Humans are scary stupid

Apologies for the harsh post title but wanted to be evocative & sensationalist as I think everyone needs to see...

I of the Storm

Breaking : The small qwen3.5 models have been dropped

Breaking : Today Qwen 3.5 small

QR Code ControlNet

Why has no one created a QR Monster ControlNet for any of the newer models? I feel like this was the best ControlNet....

OpenAI pivot investors love

Priorities

Surreal oil painting of a windy high tea

Qwen3.5-35B-A3B is a gamechanger for agentic coding.

Qwen3.5-35B-A3B with Opencode Just tested this badboy with Opencode cause frankly I couldn't believe those benchmarks....

Not too far

Distillation when you do it. Training when we do it.

Dark realms and Fallen Gods.

Anthropic: "We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax." 🚨

they have Karpathy, we are doomed ;)

(added second image for the context)

Why Do So Many V8 Images Look Like the Same Two People?

I've rated hundreds of V8 images and I keep seeing the same man and woman. What's going on? Is V8 converging on...

Kitten TTS V0.8 is out: New SOTA Super-tiny TTS Model (Less than 25 MB)

Model introduction: New Kitten models are out. Kitten ML has released open source code and weights for three new tiny...

Thank you Chinese devs for providing for the community if it not for them we'll be still stuck at stable diffusion 1.5

Z.ai said they are GPU starved, openly.

Hugging Face Is Teasing Something Anthropic Related

Anthropic are the guys that make the Claude Models. I highly doubt this will be an Openweights LLM release. More likely...

A clear and boundless sky

No NVIDIA? No Problem. My 2018 "Potato" 8th Gen i3 hits 10 TPS on 16B MoE.

I’m writing this from Burma. Out here, we can’t all afford the latest NVIDIA 4090s or high-end MacBooks. If you have a...

So Colorfully 😾

Never forget…

Yann LeCun says the best open models are not coming from the West. Researchers across the field are using Chinese models. Openness drove AI progress. Close access, and the West risks slowing itself.

From Forbes on YouTube: Yann LeCun Gives Unfiltered Take On The Future Of AI In Davos: Video by vitrupo on 𝕏:

So dreamy🥰

How do I do this, but local?

Here it is boys, Z Base

Link: Comfy

I converted some Half Life 1/2 screenshots into real life with the help of Klein 4b!

I know that there are AI video generators out there that can do this 10x better and image generators too, but I was...

My story of underestimating /r/LocalLLaMA's thirst for VRAM

LTX-2 vs. Wan 2.2 - The Anime Series

Surgical masking with Wan 2.2 Animate in ComfyUI

Surgical masking lets you preserve the original scene’s performance and image quality, keeping everything intact while...

Tao of the Ring

Qwen 3.6 27B is a BEAST

I have a 5090 Laptop from work, 24GB VRAM. I have been testing every model that comes out, and I can confidently say...

Qwen3 TTS is seriously underrated - I got it running locally in real-time and it's one of the most expressive open TTS models I've tried

Heya guys and gals, Around a year ago I released and posted about Persona Engine as a fun side project, trying to get...

unsloth Qwen3.6-27B-GGUF

finally with files inside :)

Qwen3.6-27B released!

Meet Qwen3.6-27B, our latest dense, open-source model, packing flagship-level coding power! Yes, 27B, and Qwen3.6-27B...

Qwen3.6-35B becomes competitive with cloud models when paired with the right agent

A short follow-up to my previous post, where I showed that changing the scaffold around the same 9B Qwen model moved...

Unpopular opinion: OpenClaw and all its clones are almost useless tools for those who know what they're doing. It's kind of impressive for someone who has never used a CLI, Claude Code, Codex, etc. Nor used any workflow tool like 8n8 or make.

It seems to me that OpenClaw and all its clones are almost useless tools for those who know what they're doing. It's...

Gemma-4-E2B's safety filters make it unusable for emergencies

I’ve been testing Google’s Gemma-4-E2B-it as a local, offline resource for emergency preparedness. The idea was to have...

Kimi K2.6 Released (huggingface)

When you dial in your bot’s personality

sycophancy: deleted efficiency per token:+1000% friendship: just beginning edit: “sup” got cut off at top

Why isn't ebay doing anything to stop those scams?

There's no way this is real and ebay is doing nothing to stop those scams. Why, people are actually bidding and buying...

I'm running qwen3.6-35b-a3b with 8 bit quant and 64k context thru OpenCode on my mbp m5 max 128gb and it's as good as claude

of course this is just a trust me bro post but I've been testing various local models (a couple gemma4s, qwen3 coder...

KIMI K2.6 SOON !!

RTX 5070 Ti + 9800X3D running Qwen3.6-35B-A3B at 79 t/s with 128K context, the --n-cpu-moe flag is the most important part.

Spent an evening dialing in Qwen3.6-35B-A3B on consumer hardware. Fun side note: I had Claude Opus 4.7 (just the $20...

qwen3.6 performance jump is real, just make sure you have it properly configured

I've been running workloads that I typically only trust Opus and Codex with, and I can confirm 3.6 is really capable....

Qwen3.6 GGUF Benchmarks

Hey guys, we ran Qwen3.6-35B-A3B GGUF KLD performance benchmarks to help you choose the best quant. Unsloth quants have...

Qwen 3.6 is the first local model that actually feels worth the effort for me

I spent some time yesterday after work trying out the new qwen3.6-35b-a3b model, and at least for me it's the first...

AI News You Missed - March 2026

Latest (non-comfyui) releases you (might of) missed in March 2026: 🧠 LLMs 1. NVIDIA gpt-oss-puzzle-88B \- NVIDIA...

iPhone 2007 [FLUX.2 Klein]

A Lora trained on photos taken with the original Apple iPhone (2007). Works with FLUX.2 Klein Base and FLUX.2 Klein....

Mugen - Modernized Anime SDXL Base, or how to make Bluvoll tiny bit less sane

Your monthly "Anzhc's Posts" issue have arrived. Today im introducing - Mugen \- continuation of the Flux 2 VAE...

llama.cpp at 100k stars

LTX 2.3 Reasoning VBVR Lora comparison on facial expressions

Test of the new lora found on CivitAi LTX 2.3 - Video Reasoning lora VBVR - v1.0 | LTXV23 LoRA | Civitai Both clips...

LocalLLaMA 2026

we are doomed

Another interesting application of Klein 9b Edit mode

Standard ComfyUI template. Klein 9b fp16 model. Prompt: "Transform all to greyed out 3d mesh" EDIT: Perhaps better one...

[Update] ComfyUI VACE Video Joiner v2.5 - Seamless loops, reduced RAM usage on assembly

Github | CivitAI Point this workflow at a directory of clips and it will automatically stitch them together, fixing...

PixelSmile - A Qwen-Image-Edit lora for fine grained expression control . model on Huggingface.

Paper: PixelSmile: Toward Fine-Grained Facial Expression Editing Model: A new LoRA for Qwen-Image called PixelSmile...

I got LTX-2.3 Running in Real-Time on a 4090

Yooo Buff here. I've been working on running LTX-2.3 as efficiently as possible directly in Scope on consumer hardware....

I think I figured out how to fix the audio issues in LTX 2.3

Been tinkering with the official LTX 2.3 ComfyUI workflows and stumbled onto some changes that made a pretty dramatic...

Tried to find out what's in LTX 2.3 training data - Everything here is T2V, no LoRa. So I made a short explainer video about black holes using the ones i've found so far.

Intel announced new enterprise GPU with 32GB vram

If only it works well with work flow. Nvidia have CUDA, AMD have ROCM, I don't even know what Intel have aside from...

Made with ltx

I made the video using ltx, can anybody tell me how I can improve it

Throwback to my proudest impulse buy ever, which has let me enjoy this hobby 10x more

Can you beleive I almost bought two of them?? (oh, and they gave me 10% cashback for Prime Day)

Prices finally coming down? 🥺🙏

No more Sora ..?

Davinci MagiHuman

I'm not affiliated with this team/model, but I have been doing some early testing. I believe it's very promising. Hope...

Best model that can beat Claude opus that runs on 32MB of vram?

Hi everyone! I want to get in to vibe coding to make my very own ai wrapper, what are the best models that can run on...

daVinci-MagiHuman : This new opensource video model beats LTX 2.3

We have a new 15B opensourced fast Audio-Video model called daVinci-MagiHuman claiming to beat LTX 2.3 Check out the...

3yr anniversary of the SOTA classic: "Iron Man flying to meet his fans. With text2video."

SamsungCam UltraReal - Qwen2512 LoRA

Hey everyone I recently decided to test out the new Qwen 2512 model. I previously had a Samsung-style LoRA for the...

I don’t want to rent my computer. I want to own it.

I don’t have a problem paying for AI software if it’s really good. I’m don’t use open source software because I’m...

MiniMax M2.7 Will Be Open Weights

Composer 2-Flash has been saved! (For legal reasons that's a joke)

"open-sourcing new Qwen and Wan models."

Are we getting Wan2.5/2.6 open-source?!

ID-LoRA with LTX-2.3 and ComfyUI custom node🎉

ID-LoRA (Identity-Driven In-Context LoRA) jointly generates a subject's appearance and voice in a single model, letting...

A painter with 50 years of figurative work just open-sourced his entire archive. Fine-tune on it.

I am a figurative artist based in New York with work in the collections of the Metropolitan Museum of Art, MoMA,...

A 10,000 Year Journey to Find You

Moonshot says Cursor Composer was authorized

Sounds like Fireworks had a partnership with Moonshot, and Cursor went through them. Kinda makes sense that Moonshot...

Feedback on my 256gb VRAM local setup and cluster plans. Lawyer keeping it local.

I’m a lawyer who got Claude code pilled about 90 days ago, then thought about what I wanted to do with AI tools, and...

Qwen 3.5 397B is the best local coder I have used until now

Omg, this thing is amazing. I have tried all its smaller silbings 122b/35b/27b, gpt-oss 120b, StepFun 3.5, MiniMax...

ComfyUI Nodes for Filmmaking (LTX 2.3 Shot Sequencing, Keyframing, First Frame/Last Frame)

I decided to try making some comfyui nodes for the first time. Here's the first batch of nodes I made in past couple...

Glm 5.1 👀

Petting the Void

A dark surrealist oil painting in negative space

PSA: Use the official LTX 2.3 workflow, not the ComfyUI included one. It's significantly better.

Most of the time I rely on the default ComfyUI workflows. They're producing results just as good as 90% of the...

Hidden Cave Rooms.

Running TinyLlama 1.1B locally on a PowerBook G4 from 2002. Mac OS 9, no internet, installed from a CD.

Hey everyone! I've been working on this for months and today's the day. MacinAI Local is a complete local AI inference...

Sharing my Gen AI workflow for animating my sprite in Spine2D. It's very manual because i wanted precise control of attack timings and locations.

Main notes SDXL/Illustrious for design and ideas ControlNet for pose stability Prompt for cel shading and use flat...

Qwen3.5 is a working dog.

I saw someone say recently something to the effect of: “that man is a working dog. if you don’t give him a job, he’ll...

Ultra-Real - Lora For Klein 9b (V2 is out)

LoRA designed to reduce the typical smooth/plastic AI look and add more natural skin texture and realism to images. It...

Can't believe I can create 4k videos with a crap 12gb vram card in 20 mins

I know about the silverware, weird looking candle, necklace, should have iterate a few times but this is a zero-shot...

Elephant Beast

Optimised LTX 2.3 for my RTX 3070 8GB - 900x1600 20 sec Video in 21 min (T2V)

Workflow: Video with Full Resolution: Four days of intensive optimization, I finally got LTX 2.3 running efficiently on...

So nobody's downloading this model huh?

Disappointed in the performance myself too :/ The last good Mistral model I can remember was Nemo, which led to a lot...

Two weeks ago, I posted here to see if people would be interested in an open-source local AI 3D model generator

I posted a question about this idea here two weeks ago, kept working on it, and now I finally have a beta to show. It’s...

Just one more chapter

A series exploring the absolute power of a good book. (Oil painting style)

I was looking at my old generated images

My company just handed me a 2x H200 (282GB VRAM) rig. Help me pick the "Intelligence" ceiling.

My workplace just got a server equipped with 2x Nvidia H200 GPUs (141GB HBM3e each). I've been asked to test LLMs on it...

MiniMax-M2.7 Announced!

Trying Out V8🤔

Not Sure Why Mj Prioritized Realism Over Artistic Value...They Really Using 1 Face Now

VIII

I just realised how good GLM 5 is

This is crazy. As a heavy Claude code user, who has used over 12 billion tokens in the last few months, and never tried...

Hugging Face just released a one-liner that uses 𝚕𝚕𝚖𝚏𝚒𝚝 to detect your hardware and pick the best model and quant, spins up a 𝚕𝚕a𝚖𝚊.𝚌𝚙𝚙 server, and launches Pi (the agent behind OpenClaw 🦞)

Unsloth announces Unsloth Studio - a competitor to LMStudio?

Until now, LMStudio has basically been the "go-to" solution for more advanced LLM users in the GGUF ecosystem, but...

Introducing Unsloth Studio: A new open-source web UI to train and run LLMs

Hey r/LocalLlama, we're super excited to launch Unsloth Studio (Beta), a new open-source web UI to train and run LLMs...

Blueberry Sleepwalking

Mistral Small 4:119B-2603

Mistral 4 Family Spotted

Winter is coming

OpenCode concerns (not truely local)

I know we all love using opencode, I just recently found out about it and my experience is generally positive so far....

𝑨𝒃𝒔𝒕𝒓𝒂𝒄𝒕 𝑷𝒐𝒓𝒕𝒓𝒂𝒊𝒕𝒔.

Qwen 3.5 122b - a10b is kind of shocking

I’m building an app with this model locally, and I’ve been genuinely surprised by how naturally it reasons through...

Paper Lion

Homelab has paid for itself! (at least this is how I justify it...)

Hey, I thought I'd do an update on my Homelab I posted a while back. I have it running on LLM experiments, which I...

Nvidia updated the Nemotron Super 3 122B A12B license to remove the rug-pull clauses

tl;dr the new license doesn't include the rug pull clauses and removes restrictions on modifications, guardrails,...

Red Cliff Park

Stray to the east ep003

A cat's journey

You guys gotta try OpenCode + OSS LLM

as a heavy user of CC / Codex, i honestly find this interface to be better than both of them. and since it's open...

Unused clips in various styles

Tried to exorcise my thalassophobia with Midjourney...

...it made it worse.

POV: you work a 9 to 5 job in the future

Dark sci-fi architecture for my world building project (plus a few characters)

Vintage dino pulp

The Wandering Wizard

FЯΛЩGY AЯMY

more on TikTok - @frawgy006 🐸🤘

Straight lines belong to humans

I regret ever finding LocalLLaMA

It all started with using "the AI" to help me study for a big exam. Can it make some flashcards or questions? Then...

Drop distilled lora strength to 0.6, increase steps to 30, enjoy SOTA AI generation at home.

Heretic has FINALLY defeated GPT-OSS with a new experimental decensoring method called ARA

The creator of heretic p-e-w opened a pull request #211 with a new method called Arbitrary-Rank Ablation (ARA) the...

Open WebUI’s New Open Terminal + “Native” Tool Calling + Qwen3.5 35b = Holy Sh!t!!!

Let me pre-apologize for this long and rambling post but I get excited by stuff like this. I think a lot of folks here...

LTX-2.3 is live: rebuilt VAE, improved I2V, new vocoder, native portrait mode, and more

Our web team ships fast. Apparently a little too fast. You found the page before we did. So let's do this properly:...

Ran Qwen 3.5 9B on M1 Pro (16GB) as an actual agent, not just a chat demo. Honest results.

Quick context: I run a personal automation system built on Claude Code. It's model-agnostic, so switching to Ollama was...

Qwen3.5-0.8B - Who needs GPUs?

I am genuinely surprised at how good the model is and that it can run on 14 years old device: 2nd gen i5 + 4GB DDR3 RAM.

Back in my day, LocalLLaMa were the pioneers!

PewDiePie fine-tuned Qwen2.5-Coder-32B to beat ChatGPT 4o on coding benchmarks.

American closed models vs Chinese open models is becoming a problem.

The work I do involves customers that are sensitive to nation state politics. We cannot and do not use cloud API...

Anthropic is the leading contributor to open weight models

It just happens to be entirely against their will and TOS. I say: Distill Baby Distill!

New Qwen3.5 models spotted on qwen chat

Anthropic's recent distillation blog should make anyone only ever want to use local open-weight models; it's scary and dystopian

It's quite ironic that they went for the censorship and authoritarian angles here. Full blog:

People are getting it wrong; Anthropic doesn't care about the distillation, they just want to counter the narrative about Chinese open-source models catching up with closed-source frontier models

Why would they care about distillation when they probably have done the same with OpenAI models and the Chinese labs...

Fun fact: Anthropic has never open-sourced any LLMs

I’ve been working on a little side project comparing tokenizer efficiency across different companies’ models for...

Hypocrisy?

so is OpenClaw local or not

Reading the comments, I’m guessing you didn’t bother to read this: "Safety and alignment at Meta Superintelligence."

Feels like magic. A local gpt-oss 20B is capable of agentic work

I gave a try to zeroclaw agent (intstead of the bloated and overhyped one). After few hours of fuckery with configs...

Qwen3's most underrated feature: Voice embeddings

Did you know that Qwen3 TTS utilizes voice embedding for voice cloning? Your voice is turned into a vector of 1024...

Which one are you waiting for more: 9B or 35B?

Favourite niche usecases?

PSA: The software “Shade” is a fraudulent, plagiarized copy of Heretic

Three days ago, the following repository was published, which its “creator” has been aggressively promoting on various...

The top 3 models on openrouter this week ( Chinese models are dominating!)

the first time i see a model exceed 3 trillion tokens per week on openrouter! the first time i see more than one model...

GGML.AI has got acquired by Huggingface

Deepseek and Gemma ??

Kimi has context window expansion ambitions

Free ASIC Llama 3.1 8B inference at 16,000 tok/s - no, not a joke

Hello everyone, A fast inference hardware startup, Taalas, has released a free chatbot interface and API endpoint...

Pack it up guys, open weight AI models running offline locally on PCs aren't real. 😞

I'm 100% convinced that it's the NFT-bros pushing all the openclawd engagement on X

I'm absolutely sure of it. The same usual suspects, the same language, the same who stole from whom the next million...

More quantization visualization types (repost)

Inspired by this post from u/VoidAlchemy a few months back: Intrusive thoughts had me try to reproduce and extend the...

I plugged a $30 radio into my Mac mini and told my AI "connect to this" — now I control my smart home and send voice messages over radio with zero internet

Hey r/LocalLLaMA, So I live in Ukraine during the war. Power goes out a lot here – russia regularly attacks our power...

PSA: DDR5 RDIMM price passed the point were 3090 are less expensive per gb..

Hello all, Just wanted to note that RDIMM prices are so wild.. Stacking rdimms starts to be as expensive as stacking...

KaniTTS2 — open-source 400M TTS model with voice cloning, runs in 3GB VRAM. Pretrain code included.

Hey everyone, we just open-sourced KaniTTS2 - a text-to-speech model designed for real-time conversational use cases....

Heretic 1.2 released: 70% lower VRAM usage with quantization, Magnitude-Preserving Orthogonal Ablation ("derestriction"), broad VL model support, session resumption, and more

Llamas and Gentlemen, Heretic ( is the leading software for removing censorship from language models. In the three...

The gap between open-weight and proprietary model intelligence is as small as it has ever been, with Claude Opus 4.6 and GLM-5'

GPT-OSS 120b Uncensored Aggressive Release (MXFP4 GGUF)

Hey everyone, made an uncensored version of GPT-OSS 120B. Quick specs: 117B total params, \~5.1B active (MoE with 128...

SWE-rebench Jan 2026: GLM-5, MiniMax M2.5, Qwen3-Coder-Next, Opus 4.6, Codex Performance

Hi all, I’m Anton from Nebius. We’ve updated the SWE-rebench leaderboard with our January runs on 48 fresh GitHub PR...

MiniMaxAI/MiniMax-M2.5 · Hugging Face

You can monitor quants begin to appear with this search:

UG student launches Dhi-5B (Trained from Scratch)

Hii everyone, I present Dhi-5B: A 5 billion parameter Multimodal Language Model trained compute optimally with just...

I restored a few historical figures, using Flux.2 Klein 9B.

So mainly as a test and for fun, I used Flux.2 Klein 9B to restore some historical figures. Results are pretty good....

MiniMaxAI MiniMax-M2.5 has 230b parameters and 10b active parameters

OpenHands reveals the model size in their announcement. Still waiting for the model to appear on HF.

Why do we allow "un-local" content

Title somewhat says it all. I get that it's related but if links to new models are being discussed shouldn't it be a...

Minimax M2.5 Officially Out

Only official webpages released now. But the bench looks very promising: SWE-Bench Verified 80.2% Multi-SWE-Bench 51.3%...

Unsloth just unleashed Glm 5! GGUF NOW!

#SaveLocalLLaMA

GLM-5 scores 50 on the Intelligence Index and is the new open weights leader!

DC Ancient Futurism Style 1

Trained with AI-Toolkit Using Runpod for 7000 steps Rank 32 (All standard flux klein 9B base settings) Tagged with...

GLM-5 Officially Released

We are launching GLM-5, targeting complex systems engineering and long-horizon agentic tasks. Scaling is still one of...

MiniMax M2.5 Released

GLM 5 Released

The realism that you wanted - Z Image Base (and Turbo) LoRA

Train MoE models 12x faster with 30% less memory! (<15GB VRAM)

Hey r/LocalLlama! We’re excited to introduce \~12x faster Mixture of Experts (MoE) training with >35% less VRAM and...

Kimi is so smart

Kimi > ChatGPT = Claude

Qwen-Image-2.0 is out - 7B unified gen+edit model with native 2K and actual text rendering

Qwen team just released Qwen-Image-2.0. Before anyone asks - no open weights yet, it's API-only on Alibaba Cloud...

MechaEpstein-8000

I know it has already been done but this is my AI trained on Epstein Emails. Surprisingly hard to do, as most LLMs will...

Do not Let the "Coder" in Qwen3-Coder-Next Fool You! It's the Smartest, General Purpose Model of its Size

Like many of you, I like to use LLM as tools to help improve my daily life, from editing my emails, to online search....

Only the OGs remember this.

Bad news for local bros

Qwen3.5 Support Merged in llama.cpp

I built a rough .gguf LLM visualizer

I hacked together a small tool that lets you upload a .gguf file and visualize its internals in a 3D-ish way (layers /...

Qwen3 Coder Next as first "usable" coding model < 60 GB for me

I've tried lots of "small" models < 60 GB in the past. GLM 4.5 Air, GLM 4.7 Flash, GPT OSS 20B and 120B, Magistral,...

PR opened for Qwen3.5!!

Looking at the code at src/transformers/models/qwen35/modelingqwen3_5.py, it looks like Qwen3.5 series will have VLMs...

I trained a 1.8M params model from scratch on a total of ~40M tokens.

Ok so I've been working & experimenting with my own simple architecture. I call it Strawberry Here's the repo for...

Prompt injection is killing our self-hosted LLM deployment

We moved to self-hosted models specifically to avoid sending customer data to external APIs. Everything was working...

Nemo 30B is insane. 1M+ token CTX on one 3090

Been playing around with llama.cpp and some 30-80B parameter models with CPU offloading. Currently have one 3090 and 32...

A top-downloaded OpenClaw skill is actually a staged malware delivery chain

Here we go! As expected by most of us here. Jason Meller from 1password argues that OpenClaw’s agent “skills” ecosystem...

GLM 5 Is Being Tested On OpenRouter

[Release] Experimental Model with Subquadratic Attention: 100 tok/s @ 1M context, 76 tok/s @ 10M context (30B model, single GPU)

Hey everyone, Last week I shared preliminary results on a new subquadratic attention mechanism ( Following up with the...

CPU-only, no GPU computers can run all kinds of AI tools locally

While it’s great that so many people on LocalLLaMA are pushing the envelope with what can be done locally with...

I am absolutely loving qwen3-235b

I installed qwen3-235b on my desktop system, and I had to join here to brag about it. It's such a careful model, the...

BalatroBench - Benchmark LLMs' strategic performance in Balatro

If you own a copy of Balatro, you can make your local LLM play it. I built tools to let LLMs play Balatro autonomously....

Google Research announces Sequential Attention: Making AI models leaner and faster without sacrificing accuracy

Qwen3-Coder-Next on RTX 5060 Ti 16 GB - Some numbers

About 2 weeks ago, I posted about running GLM-4.7-Flash on 16 GB of VRAM here...

mistralai/Voxtral-Mini-4B-Realtime-2602 · Hugging Face

Voxtral Mini 4B Realtime 2602 is a multilingual, realtime speech-transcription model and among the first open-source...

Bashing Ollama isn’t just a pleasure, it’s a duty

ACE-Step-1.5 has just been released. It’s an MIT-licensed open source audio generative model with performance close to commercial platforms like Suno

It’s already supported in Comfy. MIT license. HuggingFace Demo is also available! Pretty much the whole package - LoRAs...

The open-source version of Suno is finally here: ACE-Step 1.5

ACE-Step 1.5 is an open-source music model that can generate a full song in about 2 seconds on an A100, runs locally on...

Qwen3-Coder-Next

Qwen3-Coder-Next is out!

Qwen/Qwen3-Coder-Next · Hugging Face

GLM-5 Coming in February! It's confirmed.

Twitter Link:

How close are open-weight models to "SOTA"? My honest take as of today, benchmarks be damned.

Cline team got absorbed by OpenAI. Kilo is going full source available in response.

For those who used Cline with local models, heads up that the core team appears to have joined OpenAI's Codex group...

LingBot-World outperforms Genie 3 in dynamic simulation and is fully Open Source

The newly released LingBot-World framework offers the first high capability world model that is fully open source,...

Mistral CEO Arthur Mensch: “If you treat intelligence as electricity, then you just want to make sure that your access to intelligence cannot be throttled.”

GitHub trending this week: half the repos are agent frameworks. 90% will be dead in 1 week.

It this the js framework hell moment of ai?

Embark on a forest journey

Aurora Town

hallelujah.

still works though

Dream Relic 3

Z-Image + Qwen Image Edit 2511 + Wan 2.2 + MMAudio

A year ago, I never imagined I’d be able to generate a video like this on my own computer. (5070ti gpu) It’s still...

768Gb Fully Enclosed 10x GPU Mobile AI Build

I haven't seen a system with this format before but with how successful the result was I figured I might as well share...

Small lovely robotic critters

Examples of prompt: 1) Hyperreal macro photo of a robotic cockroach, oil-stained titanium plates with grime in the...

an artificial zombie apocalypse.

It's been one year since the release of Deepseek-R1

Unsloth GLM 4.7-Flash GGUF

GLM 4.7 Flash official support merged in llama.cpp

My gpu poor comrades, GLM 4.7 Flash is your local agent

I tried many MoE models at 30B or under and all of them failed sooner or later in an agentic framework. If z.ai is not...

Eldritch ruins... Midjourney really is something else, huh.

I specifically requested no meaningless or decorative details, no clutter. Sharp clarity and unified coherent lines...

🧠💥 My HomeLab GPU Cluster – 12× RTX 5090, AI / K8s / Self-Hosted Everything

After months of planning, wiring, airflow tuning, and too many late nights this is my home lab GPU cluster finally up...

zai-org/GLM-4.7-Flash · Hugging Face

Twilight Beyond the Gate

Source — DarkWall

What is an automation that surprisingly worked better than you expected?

I recently got into the world of automations for both my business and personally and have been super stoked about the...

IAJRFTAS - I Am Just Really Fond of This (AI) Art Style

Not saying that its better than anything else, this just hits whatever switch it needs to hit. (and yes - before you...

The Gothic Empress

Source — DarkWall

Fantasy Toons

4x AMD R9700 (128GB VRAM) + Threadripper 9955WX Build

Disclaimer: I am from Germany and my English is not perfect, so I used an LLM to help me structure and write this post....

Terraforge greenhouses

How to generate proper Japanese in LTX-2

So, after the recent anime clip posted here a few days ago that got a lot of praise for the visuals, I noticed the...

Lords of Eternity

FLUX 2 Klein 4B vs 9B Multi Camera Angles - One Click, 8 Camera Angles

Just wanted to share this workflow I put together that generates the same character from 8 different camera angles in a...

Dresser v1.0 | Clothing generation with body shape preservation and alpha channel clipping | IL\SDXL\NoobAI

Good afternoon! I'm a little late with this workflow)). Now that Flux.2 Klein has been released and z-image-edit is...

I used temporal time dilation to generate this 60-second video in LTX-2 on my 5070TI in just under two minutes. My GPU didn't even break a sweat. Workflow and explanation in comments (without subgraphs or 'Everything Everywhere All At Once' invisible noodles).

Qwen 4 might be a long way off !? Lead Dev says they are "slowing down" to focus on quality.

128GB VRAM quad R9700 server

This is a sequel to my previous thread from 2024. I originally planned to pick up another pair of MI100s and an...

The Search for Uncensored AI (That Isn’t Adult-Oriented)

I’ve been trying to find an AI that’s genuinely unfiltered and technically advanced, uncensored something that can...

Untitled 33

LTX 2 is amazing : LTX-2 in ComfyUI on RTX 3060 12GB

My setup: RTX 3060 12GB VRAM + 48GB system RAM. I spent the last couple of days messing around with LTX-2 inside...

Best "End of world" model that will run on 24gb VRAM

Hey peeps, I'm feeling in a bit of a omg the world is ending mood and have been amusing myself by downloading and...

The Leilothl

DeepSeek Engram : A static memory unit for LLMs

DeeepSeek AI released a new paper titled "Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large...

Testing my sketches with flux-2-klein 9B

[FLUX.2 \[klein\] 4B & 9B - Fast local image editing and generation]( I'm using flux-2-klein-9b-Q3\K\M.gguf...

LTX-2 - Alignment?

Great model! The voices are getting better but consistency between scenes is a little random

For some things, Z-Image is still king, with Klein often looking overdone

Klein is excellent, particularly for its editing capabilities, however.... I think Z-Image is still king for...

Market of the Modified | Episode 10

If you enjoy this video, consider watching the other episodes in this universe for this video to make sense. Tools...

33 Second 1920x1088 video at 24fps (800 frames) on a single 4090 with memory to spare, this node should help out most people of any GPU size

Made using a custom node which can be found on my github here: Used workflow from here: This video is uploaded to my...

Wasteland nomads

GPT-5.2 xhigh, GLM-4.7, Kimi K2 Thinking, DeepSeek v3.2 on Fresh SWE-rebench (December 2025)

Hi all, I’m Anton from Nebius. We’ve updated the SWE-bench leaderboard with our December runs on 48 fresh GitHub PR...

I fucking love this community

Thank you guys, thanks to everyone who took the time to write a comment or a post explaining, teaching people how...

They are back

Hot take from someone who works in AI automation: most teams are automating the wrong things.

I work in automation for business, and lately I’ve been seeing the same problem over and over. Teams are racing to...

Dang, M2 drives are the new DDR5 apparently.

Latest upgrade…A100 40 GB

Originally this was my gaming rig but I went ITX and basically bought a new computer. So I had the case, fans, AIO, 64...

LTX-2 Updates

We were overwhelmed by the community response to LTX-2 last week. From the moment we released, this community jumped in...

Viking Influencer with LTX2 image 2 video with native generated audio. It can do accents

I tried playing with the native audio in the model, the quality still kinda meh but it there and it works. image in...

Chaos Gods

Nemotron-3-nano:30b is a spectacular general purpose local LLM

Just want to sing the praises of this model. I am stunned at how intelligent it is for a 30b model. Comparing it to...

7x Longer Context Reinforcement Learning in Unsloth

Hey r/LocalLlama! We're excited to show how Unsloth now enables 7x longer context lengths (up to 12x) for Reinforcement...

FLUX.2 [klein] 4B & 9B released

I was able play with Flux Klein before release and it's a blast. 4B uses Qwen3B and takes 1.3 seconds with 4 steps on...

Got tired of reading AI news, so I built an automation that does it for me (18 sources, 100+ hrs saved)

Like a lot of people, I’ve been struggling to keep up with the latest developments in AI. I found that there were some...

RTX 5070 Ti and RTX 5060 Ti 16 GB no longer manufactured

Nvidia has essentially killed off supply for the RTX 5070 Ti. Also supply of RTX 5060 Ti 16 GB has been significantly...

I built a real-time 360 volumetric environment generator running entirely locally. Uses SD.cpp, Depth Anything V2, and LaMa, all within Unity Engine.

I wanted to create a "Holodeck" style experience where I could generate environments while inside VR, but I didn't want...

Untitled 32

Some Niji-7

I trained a model to 'unslop' AI prose

I ran passages from Project Gutenberg through GPT-4o-mini 10 times over, each time telling it to "make it read far...

Zhipu AI breaks US chip reliance with first major model trained on Huawei stack (GLM-Image)

LTX-2 I2V synced to an MP3: Distill Lora Quality STR 1 vs .6 - New Workflow Version 2.

New version of Workflow (v2): This is a follow-up to my previous post - please read it for more information and...

fashion. #26

tiktok: lvmiere\_ ig: lvmiere.vision soundtrack: Wilderness from Diablo II

WTF! LTX-2 is delivering for real 🫧 Made in 160s, 20steps on a 5090

Been away from local generation for a while, definitely impressed by the speed and overall quality!

The Knight, The girl, and her Dog.

NeuTTS Nano: 120M Parameter On-Device TTS based on Llama3

Hey everyone, The team at Neuphonic is back with a new open-source release: NeuTTS Nano. After NeuTTS Air trended #1 on...

Soprano 1.1-80M released: 95% fewer hallucinations and 63% preference rate over Soprano-80M

Hello everyone! Today, I am announcing Soprano 1.1! I’ve designed it for massively improved stability and audio quality...

NVIDIA's new 8B model is Orchestrator-8B, a specialized 8-billion-parameter AI designed not to answer everything itself, but to intelligently manage and route complex tasks to different tools (like web search, code execution, other LLMs) for greater efficiency

I’ve seen some arguments we’ve reached AGI, it’s just about putting the separate pieces together in the right context....