Quick Brief Featured story today: “Testing llama.cpp MTP support on Qwen3.6 – RTX 5090” And more models & releases news from the AI universe – Photo by Faded_Gallery on Unsplash. Today’s Hot Posts Models & Releases Testing llama.cpp MTP support on Qwen3.6 – RTX 5090 Setup: \- RTX 5090, 32 GB, Linux \- Built llama.cpp from 4f13cb7 (the official ghcr.io/ggml-org/llama.cpp:server-cuda image hasn’t picked up the… 🔗 Read more 85 GPU-hours comparing 5 abliteration methods on Qwen3.6-27B: benchmarks, safety, weight forensics...

The post AI News – May 17, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Multi-Token Prediction (MTP) for LLaMA.cpp – Gemma 4 speedup by 40%” And more models & releases news from the AI universe – Photo by Ecliptic Graphic on Unsplash. Today’s Hot Posts Models & Releases Multi-Token Prediction (MTP) for LLaMA.cpp – Gemma 4 speedup by 40% Implemented Multi-Token Prediction for LLaMA.cpp. Quantized Gemma 4 assistant models into GGUF format. Ran tests on a MacBook Pro M5Max. Gemma 26B… 🔗 Read more guess what? if you are...

The post AI News – May 8, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Llama.cpp MTP support now in beta!” And more models & releases news from the AI universe – Photo by Solen Feyissa on Unsplash. Today’s Hot Posts Models & Releases Llama.cpp MTP support now in beta! Happy to report that llama.cpp MTP support is now in beta, thanks to Aman (and all the others that have pushed the various issues in the… 🔗 Read more it’s time to update your Gemma 4 GGUFs Chat Template was...

The post AI News – May 4, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “I’m done with using local LLMs for coding” And more models & releases news from the AI universe – Photo by Logan Voss on Unsplash. Today’s Hot Posts Models & Releases I’m done with using local LLMs for coding I think gave it a fair shot over the past few weeks, forcing myself to use local models for non-work tech asks. I use Claude Code at my job so… 🔗 Read more Qwen 3.6 27B...

The post AI News – April 28, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “I’m glad we have deepseek” And more models & releases news from the AI universe – Photo by Enchanted Tools on Unsplash. Today’s Hot Posts Models & Releases I’m glad we have deepseek other companies are slowly going away from open weight, not releasing base models, delaying open weight distribution, not releasing top models… 🔗 Read more “Weights are coming”.Xiaomi’s MiMo V2.5 Pro has landed at 54 in the Artificial Analysis Intelligence Index. From: \-...

The post AI News – April 25, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Kimi K2.6 Released (huggingface)” And more models & releases news from the AI universe – Photo by Mitchell Griest on Unsplash. Today’s Hot Posts Models & Releases Kimi K2.6 Released (huggingface) Via r/LocalLLaMA · 418 points · 122 comments 🔗 Read more Qwen 3.6 Max Preview just went live on the Qwen Chat website. It currently has the highest AA-Intelligence Index score among Chinese models (52) (Will it be open source?) Via r/LocalLLaMA · 222...

The post AI News – April 20, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Are my hopes for running a local LLM unrealistic?” And more models & releases news from the AI universe – Photo by Google DeepMind on Unsplash Today’s Hot Posts Models & Releases DFlash speculative decoding on Apple Silicon : 85 tok/s, 3.3x on Qwen3.5-9B (MLX, M5 Max) I’m building a native MLX implementation of DFlash (paper) for Apple Silicon. A small draft model generates 16 tokens in parallel via block… 🔗 Read more Are my...

The post AI News – April 11, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “You can now fine-tune Gemma 4 locally 8GB VRAM + Bug Fixes” And more models & releases news from the AI universe – Photo by fabio on Unsplash Today’s Hot Posts Models & Releases You can now fine-tune Gemma 4 locally 8GB VRAM + Bug Fixes Hey guys, you can now fine-tune Gemma 4 E2B and E4B in our free Unsloth notebooks! You need **8GB VRAM to train Gemma-4-E2B** locally. Unsloth… 🔗 Read more Gemma...

The post AI News – April 7, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Netflix just dropped their first public model on Hugging Face: VOID: Video Object and Interaction Deletion” And more models & releases news from the AI universe – Photo by Google DeepMind on Unsplash. Today’s Hot Posts Models & Releases Netflix just dropped their first public model on Hugging Face: VOID: Video Object and Interaction Deletion Hugging Face netflix/void-model: Project page – GitHub: Demo: ( 🔗 Read more You can now run Google Gemma 4 locally!...

The post AI News – April 2, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Qwen3.5-Omni results have been published by Alibaba” And more models & releases news from the AI universe – Photo by Joshua Sortino on Unsplash Today’s Hot Posts Models & Releases Qwen3.5-Omni results have been published by Alibaba Via r/LocalLLaMA · 246 points · 34 comments 🔗 Read more I just want to catch up on local LLM’s after work.. Via r/LocalLLaMA · 224 points · 41 comments 🔗 Read more Claude code source code has...

The post AI News – March 31, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “A simple explanation of the key idea behind TurboQuant” And more models & releases news from the AI universe – Photo by Vitaly Gariev on Unsplash. Today’s Hot Posts Models & Releases A simple explanation of the key idea behind TurboQuant TurboQuant (Zandieh et al. 2025) has been all the rage in the past two days, and I’ve seen lots of comments here attempting to explain the magic… 🔗 Read more Me waiting for TurboQuant...

The post AI News – March 28, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “LM Studio may possibly be infected with sophisticated malware.” And more models & releases news from the AI universe – Photo by Back2Gaming on Unsplash. Today’s Hot Posts Models & Releases LM Studio may possibly be infected with sophisticated malware. I’m no expert, just a tinkerer who messed with models at home, so correct me if this is a false positive, but it doesn’t look that way to me…. 🔗 Read more Created a SillyTavern...

The post AI News – March 24, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Ooh, new drama just dropped 👀” And more models & releases news from the AI universe – Photo by Markus Kammermann on Unsplash. Today’s Hot Posts Models & Releases Ooh, new drama just dropped 👀 For those out of the loop: cursor’s new model, composer 2, is apparently built on top of Kimi K2.5 without any attribution. Even Elon Musk has… 🔗 Read more Cursor’s new Composer 2.0 is apparently based on Kimi2.5 This guy...

The post AI News – March 20, 2026 appeared first on The Red Ferret Journal.

A new AI agent which promises to create complete video drama episodes on demand has been released on ByteDance’s XiaoYunQue AI platform. The product is based around the new Seedance 2.0 video generation model, and takes video generation into a completely new universe. Up till now people have been very pleased with generating short clips for advertising and online media. But this is the first time a product has arrived which allows producers to generate complete episodes in one go....

The post This stunning new AI agent could mark the end of the Hollywood entertainment industry appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Best Model for your Hardware?” And more models & releases news from the AI universe – Photo by Logan Voss on Unsplash. Today’s Hot Posts Models & Releases Best AI Model for your Hardware? Via r/LocalLLM · 87 points · 33 comments 🔗 Read more We compressed 6 LLMs and found something surprising: they don’t degrade the same way **:** we shrink the MLP layers inside transformers (no quantization, no custom kernels) and measured how...

The post AI News – March 17, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Omnicoder-9b SLAPS in Opencode” And more models & releases news from the AI universe – Photo by Markus Kammermann on Unsplash. Today’s Hot Posts Models & Releases Omnicoder-9b SLAPS in Opencode I was feeling a bit disheartened by seeing how anti-gravity and github copilot were now putting heavy quota restrictions and I kinda felt… 🔗 Read more Is the 3090 still a good option? I found one locally for $623. Is it a good deal?...

The post AI News – March 13, 2026 appeared first on The Red Ferret Journal.

Quick Brief Featured story today: “Qwen-3.5-27B-Derestricted” And more models & releases news from the AI universe – Photo by Omar:. Lopez-Rincon on Unsplash Today’s Hot Posts Models & Releases Qwen-3.5-27B-Derestricted Just saw this posted. Has anyone tried this and compared it to Heretic models? I don’t see any GGUFs done yet. 🔗 Read more 2026 reality check: Are local LLMs on Apple Silicon legitimately as good (or better) than paid online models yet? Could a MacBook Pro M5 (base, pro...

The post AI News – March 9, 2026 appeared first on The Red Ferret Journal.

Quick Brief Today’s AI digest features 20 top stories across 5 AI topic areas. Models & Releases leads this edition with new releases, community experiments, and real-world insights from the local LLM ecosystem. Photo by Egor Komarov on Unsplash. Today’s Hot Posts Models & Releases Qwen3-Coder-Next is the top model in SWE-rebench @ Pass 5. I think everyone missed it. Not only it is the top of the open source models but of all models, and it is an instruct...

The post AI News – March 7, 2026 appeared first on The Red Ferret Journal.

Quick Brief Today’s AI digest features 20 top stories across 5 AI topic areas. Models & Releases leads this edition with new releases, community experiments, and real-world insights from the local LLM ecosystem. Photo by Jo Lin on Unsplash. Today’s Hot Posts Models & Releases Alibaba CEO: Qwen will remain open-source Via r/LocalLLaMA · 520 points · 79 comments 🔗 Read more Google invites ex-qwen ;) to make Gemma great again? ;) 🔗 Read more I’m running a Truman Show...

The post AI Digest – March 5, 2026 appeared first on The Red Ferret Journal.

Quick Brief Today’s AI digest features 20 top stories across 5 AI topic areas. Models & Releases leads this edition with new releases, community experiments, and real-world insights from the local LLM ecosystem. Photo by Zulfugar Karimov on Unsplash. Today’s Hot Posts Models & Releases Qwen3.5-0.8B – Who needs GPUs? I am genuinely surprised at how good the model is and that it can run on 14 years old device: 2nd gen i5 + 4GB DDR3 RAM. 🔗 Read more...

The post AI Digest – March 4, 2026 appeared first on The Red Ferret Journal.

Quick Brief Today’s AI digest features 20 top stories across 5 AI topic areas. Models & Releases leads this edition with new releases, community experiments, and real-world insights from the local LLM ecosystem. Photo by Logan Voss on Unsplash. Today’s Hot Posts Models & Releases Breaking : The small qwen3.5 models have been dropped Via r/LocalLLaMA · 489 points · 104 comments 🔗 Read more Qwen/Qwen3.5-9B · Hugging Face # Model Overview * Type: Causal Language Model with Vision Encoder...

The post AI Digest – March 2, 2026 appeared first on The Red Ferret Journal.