AI Reddit Digest

I'm 100% convinced that it's the NFT-bros pushing all the openclawd engagement on X

I'm absolutely sure of it. The same usual suspects, the same language, the same who stole from whom the next million...

More quantization visualization types (repost)

Inspired by this post from u/VoidAlchemy a few months back: Intrusive thoughts had me try to reproduce and extend the...

I plugged a $30 radio into my Mac mini and told my AI "connect to this" — now I control my smart home and send voice messages over radio with zero internet

Hey r/LocalLLaMA, So I live in Ukraine during the war. Power goes out a lot here – russia regularly attacks our power...

PSA: DDR5 RDIMM price passed the point were 3090 are less expensive per gb..

Hello all, Just wanted to note that RDIMM prices are so wild.. Stacking rdimms starts to be as expensive as stacking...

KaniTTS2 — open-source 400M TTS model with voice cloning, runs in 3GB VRAM. Pretrain code included.

Hey everyone, we just open-sourced KaniTTS2 - a text-to-speech model designed for real-time conversational use cases....

Heretic 1.2 released: 70% lower VRAM usage with quantization, Magnitude-Preserving Orthogonal Ablation ("derestriction"), broad VL model support, session resumption, and more

Llamas and Gentlemen, Heretic ( is the leading software for removing censorship from language models. In the three...

The gap between open-weight and proprietary model intelligence is as small as it has ever been, with Claude Opus 4.6 and GLM-5'

GPT-OSS 120b Uncensored Aggressive Release (MXFP4 GGUF)

Hey everyone, made an uncensored version of GPT-OSS 120B. Quick specs: 117B total params, \~5.1B active (MoE with 128...

SWE-rebench Jan 2026: GLM-5, MiniMax M2.5, Qwen3-Coder-Next, Opus 4.6, Codex Performance

Hi all, I’m Anton from Nebius. We’ve updated the SWE-rebench leaderboard with our January runs on 48 fresh GitHub PR...

MiniMaxAI/MiniMax-M2.5 · Hugging Face

You can monitor quants begin to appear with this search:

UG student launches Dhi-5B (Trained from Scratch)

Hii everyone, I present Dhi-5B: A 5 billion parameter Multimodal Language Model trained compute optimally with just...

MiniMaxAI MiniMax-M2.5 has 230b parameters and 10b active parameters

OpenHands reveals the model size in their announcement. Still waiting for the model to appear on HF.

Why do we allow "un-local" content

Title somewhat says it all. I get that it's related but if links to new models are being discussed shouldn't it be a...

Minimax M2.5 Officially Out

Only official webpages released now. But the bench looks very promising: SWE-Bench Verified 80.2% Multi-SWE-Bench 51.3%...

Unsloth just unleashed Glm 5! GGUF NOW!

#SaveLocalLLaMA

GLM-5 scores 50 on the Intelligence Index and is the new open weights leader!

GLM-5 Officially Released

We are launching GLM-5, targeting complex systems engineering and long-horizon agentic tasks. Scaling is still one of...

MiniMax M2.5 Released

GLM 5 Released

Train MoE models 12x faster with 30% less memory! (<15GB VRAM)

Hey r/LocalLlama! We’re excited to introduce \~12x faster Mixture of Experts (MoE) training with >35% less VRAM and...

Kimi is so smart

Kimi > ChatGPT = Claude

Qwen-Image-2.0 is out - 7B unified gen+edit model with native 2K and actual text rendering

Qwen team just released Qwen-Image-2.0. Before anyone asks - no open weights yet, it's API-only on Alibaba Cloud...

MechaEpstein-8000

I know it has already been done but this is my AI trained on Epstein Emails. Surprisingly hard to do, as most LLMs will...

Do not Let the "Coder" in Qwen3-Coder-Next Fool You! It's the Smartest, General Purpose Model of its Size

Like many of you, I like to use LLM as tools to help improve my daily life, from editing my emails, to online search....

Bad news for local bros

Qwen3.5 Support Merged in llama.cpp

I built a rough .gguf LLM visualizer

I hacked together a small tool that lets you upload a .gguf file and visualize its internals in a 3D-ish way (layers /...

Qwen3 Coder Next as first "usable" coding model < 60 GB for me

I've tried lots of "small" models < 60 GB in the past. GLM 4.5 Air, GLM 4.7 Flash, GPT OSS 20B and 120B, Magistral,...

PR opened for Qwen3.5!!

Looking at the code at src/transformers/models/qwen35/modelingqwen3_5.py, it looks like Qwen3.5 series will have VLMs...

I trained a 1.8M params model from scratch on a total of ~40M tokens.

Ok so I've been working & experimenting with my own simple architecture. I call it Strawberry Here's the repo for...

Prompt injection is killing our self-hosted LLM deployment

We moved to self-hosted models specifically to avoid sending customer data to external APIs. Everything was working...

Nemo 30B is insane. 1M+ token CTX on one 3090

Been playing around with llama.cpp and some 30-80B parameter models with CPU offloading. Currently have one 3090 and 32...

A top-downloaded OpenClaw skill is actually a staged malware delivery chain

Here we go! As expected by most of us here. Jason Meller from 1password argues that OpenClaw’s agent “skills” ecosystem...

GLM 5 Is Being Tested On OpenRouter

[Release] Experimental Model with Subquadratic Attention: 100 tok/s @ 1M context, 76 tok/s @ 10M context (30B model, single GPU)

Hey everyone, Last week I shared preliminary results on a new subquadratic attention mechanism ( Following up with the...

CPU-only, no GPU computers can run all kinds of AI tools locally

While it’s great that so many people on LocalLLaMA are pushing the envelope with what can be done locally with...

I am absolutely loving qwen3-235b

I installed qwen3-235b on my desktop system, and I had to join here to brag about it. It's such a careful model, the...

BalatroBench - Benchmark LLMs' strategic performance in Balatro

If you own a copy of Balatro, you can make your local LLM play it. I built tools to let LLMs play Balatro autonomously....

Google Research announces Sequential Attention: Making AI models leaner and faster without sacrificing accuracy

Qwen3-Coder-Next on RTX 5060 Ti 16 GB - Some numbers

About 2 weeks ago, I posted about running GLM-4.7-Flash on 16 GB of VRAM here...

mistralai/Voxtral-Mini-4B-Realtime-2602 · Hugging Face

Voxtral Mini 4B Realtime 2602 is a multilingual, realtime speech-transcription model and among the first open-source...

Bashing Ollama isn’t just a pleasure, it’s a duty

ACE-Step-1.5 has just been released. It’s an MIT-licensed open source audio generative model with performance close to commercial platforms like Suno

It’s already supported in Comfy. MIT license. HuggingFace Demo is also available! Pretty much the whole package - LoRAs...

The open-source version of Suno is finally here: ACE-Step 1.5

ACE-Step 1.5 is an open-source music model that can generate a full song in about 2 seconds on an A100, runs locally on...

Qwen3-Coder-Next

Qwen3-Coder-Next is out!

Qwen/Qwen3-Coder-Next · Hugging Face

GLM-5 Coming in February! It's confirmed.

Twitter Link:

How close are open-weight models to "SOTA"? My honest take as of today, benchmarks be damned.

Cline team got absorbed by OpenAI. Kilo is going full source available in response.

For those who used Cline with local models, heads up that the core team appears to have joined OpenAI's Codex group...

LingBot-World outperforms Genie 3 in dynamic simulation and is fully Open Source

The newly released LingBot-World framework offers the first high capability world model that is fully open source,...

Mistral CEO Arthur Mensch: “If you treat intelligence as electricity, then you just want to make sure that your access to intelligence cannot be throttled.”

GitHub trending this week: half the repos are agent frameworks. 90% will be dead in 1 week.

It this the js framework hell moment of ai?

768Gb Fully Enclosed 10x GPU Mobile AI Build

I haven't seen a system with this format before but with how successful the result was I figured I might as well share...

It's been one year since the release of Deepseek-R1

Unsloth GLM 4.7-Flash GGUF

GLM 4.7 Flash official support merged in llama.cpp

My gpu poor comrades, GLM 4.7 Flash is your local agent

I tried many MoE models at 30B or under and all of them failed sooner or later in an agentic framework. If z.ai is not...

zai-org/GLM-4.7-Flash · Hugging Face

4x AMD R9700 (128GB VRAM) + Threadripper 9955WX Build

Disclaimer: I am from Germany and my English is not perfect, so I used an LLM to help me structure and write this post....

Qwen 4 might be a long way off !? Lead Dev says they are "slowing down" to focus on quality.

128GB VRAM quad R9700 server

This is a sequel to my previous thread from 2024. I originally planned to pick up another pair of MI100s and an...

The Search for Uncensored AI (That Isn’t Adult-Oriented)

I’ve been trying to find an AI that’s genuinely unfiltered and technically advanced, uncensored something that can...

Best "End of world" model that will run on 24gb VRAM

Hey peeps, I'm feeling in a bit of a omg the world is ending mood and have been amusing myself by downloading and...

DeepSeek Engram : A static memory unit for LLMs

DeeepSeek AI released a new paper titled "Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large...

GPT-5.2 xhigh, GLM-4.7, Kimi K2 Thinking, DeepSeek v3.2 on Fresh SWE-rebench (December 2025)

Hi all, I’m Anton from Nebius. We’ve updated the SWE-bench leaderboard with our December runs on 48 fresh GitHub PR...

I fucking love this community

Thank you guys, thanks to everyone who took the time to write a comment or a post explaining, teaching people how...

Dang, M2 drives are the new DDR5 apparently.

Latest upgrade…A100 40 GB

Originally this was my gaming rig but I went ITX and basically bought a new computer. So I had the case, fans, AIO, 64...

Nemotron-3-nano:30b is a spectacular general purpose local LLM

Just want to sing the praises of this model. I am stunned at how intelligent it is for a 30b model. Comparing it to...

7x Longer Context Reinforcement Learning in Unsloth

Hey r/LocalLlama! We're excited to show how Unsloth now enables 7x longer context lengths (up to 12x) for Reinforcement...

RTX 5070 Ti and RTX 5060 Ti 16 GB no longer manufactured

Nvidia has essentially killed off supply for the RTX 5070 Ti. Also supply of RTX 5060 Ti 16 GB has been significantly...

I trained a model to 'unslop' AI prose

I ran passages from Project Gutenberg through GPT-4o-mini 10 times over, each time telling it to "make it read far...

Zhipu AI breaks US chip reliance with first major model trained on Huawei stack (GLM-Image)

NeuTTS Nano: 120M Parameter On-Device TTS based on Llama3

Hey everyone, The team at Neuphonic is back with a new open-source release: NeuTTS Nano. After NeuTTS Air trended #1 on...

Soprano 1.1-80M released: 95% fewer hallucinations and 63% preference rate over Soprano-80M

Hello everyone! Today, I am announcing Soprano 1.1! I’ve designed it for massively improved stability and audio quality...

NVIDIA's new 8B model is Orchestrator-8B, a specialized 8-billion-parameter AI designed not to answer everything itself, but to intelligently manage and route complex tasks to different tools (like web search, code execution, other LLMs) for greater efficiency

I’ve seen some arguments we’ve reached AGI, it’s just about putting the separate pieces together in the right context....