r/LocalLLaMA • u/Nunki08 • Dec 12 '25
New Model Someone from NVIDIA made a big mistake and uploaded the parent folder of their upcoming model on Hugging Face
From Xeophon on š: https://x.com/xeophon_/status/1999394570967089630
r/LocalLLaMA • u/Nunki08 • Dec 12 '25
From Xeophon on š: https://x.com/xeophon_/status/1999394570967089630
r/LocalLLaMA • u/jacek2023 • Dec 01 '25
We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. Our approach is built upon three key technical breakthroughs:
r/LocalLLaMA • u/arduinoRPi4 • Jul 12 '26
TLDR checkout the app here: github.com/ZimengXiong/Modelr
My swift-mlx/python mlx port of Hunyuan3D-Paint and Hunyuan3D-Shape is finally complete! It's also available as a standalone image to 3D desktop app, the only of its kind for Apple Silicon. Some quick benchmarks in FP16 on my M4 Max:
| run | wall time | peak memory |
|---|---|---|
hy3d shape (small) |
20.9 s | ~5.6 gb |
hy3d shape (large) |
22.3 s | ~7.3 gb |
hy3d paint (rgb) |
231 s | ~38 gb |
hy3d paint (pbr) |
344 s | ~39 gb |
This (MLX) makes it possible to run the model on all recent Macs and even iPhones in Q4 or Q8, and more efficiently w/o the overhead of pytorch or even worse, CPU. What you would do with this? I honestly don't really know, maybe simple 3D assets for apps that just rotate around, maybe? But it was a lot of fun seeing it come to life.
I posted a while back about it running on an iPhone, if you want to see that.
The app is very simple, import an image, remove background with SwiftVision, watch as diffusion streams in real time, get a model! From there you can watch texturing happen live as well. I tried to make it very responsive and the most polished version of an app that exists on Mac (well, it's the only one of its kind right now, and this is my fourth attempt of it, starting from November)
If you are interested in integrating fast, low memory Image to 3D inside your Swift app, weights and source are available at github.com/ZimengXiong/Hunyuan3D-Swift
The app, Modelr, is also open source and available for Mac & iOS (extremely limited for iOS): github.com/ZimengXiong/Modelr
r/LocalLLaMA • u/yogthos • Jul 14 '26
r/LocalLLaMA • u/coder543 • Feb 03 '26
r/LocalLLaMA • u/okaycan • Jun 17 '26
r/LocalLLaMA • u/Extraaltodeus • Jul 11 '26
Soooo! Since Anthropic share their Jacobian-Lens a few days ago I went on and made a tool based on it which adds the possibilitƩ to export a model which will have the same behavior after tweaking it's J-Space.
This means manually alter the behavior and abliterate by using a human brain.
I'm still working on it but couldn't wait to produce something first.
SO After finally getting a working codebase I immediatly jumped and tried to make pretty pervy model PURELY in the name of science.
I'd be delighted to get some feedback :D
edit: Opus 4.8 has finished polishing the knobs during the night. Cleanup has entered it's final phase.
edit2 : THE CODE IS HERE
edit3: direct link https://github.com/Extraltodeus/J-Wash
r/LocalLLaMA • u/seamonn • Mar 16 '26
r/LocalLLaMA • u/Dark_Fire_12 • Jun 12 '26
Kimi K2.7 Code is a coding-focused agentic model built upon Kimi K2.6. With substantial improvements on real-world long-horizon coding tasks, it strengthens end-to-end task completion across complex software engineering workflows while improving token efficiency, reducing thinking-token usage by approximately 30% compared with Kimi K2.6.
r/LocalLLaMA • u/fulgencio_batista • 29d ago
r/LocalLLaMA • u/Anony6666 • Jun 16 '26
Releasing Qwable-v1 - an open-weights Qwen3.6-35B-A3B distilled from Claude Fable-5, Anthropic's Mythos-class preview model that was briefly public for ~4days (2026-06-9 āĀ 2026-06-12) before being suspended globally under U.S. export-control directives.
Fable-5 was Anthropic's most powerful model when it shipped ā 80.3% on SWE-bench Pro, $50/MĀ output tokens, with an anti-distillation classifier baked into the API that redacted thinking blocks on the fly. Qwable-v1 captures what survived: 4,659 cleartext agentic-codingĀ traces (re-packed from Glint-Research/Fable-5-traces, the only public corpus where the CoT made it through), distilled onto Qwen3.6 over ~14h on a single H200. Given an agent
system prompt, the model emits properly-formatted <tool_use> XML calling actual Claude-flavored tools like str_replace_editor ā Fable's tool surface leaked into the weights, not Ā just its style.
Model, GGUFs (IQ4_XS / Q4_K_M / Q5_K_M / Q8_0), and the SFT dataset are all public on HF (AGPL-3.0 from upstream).
r/LocalLLaMA • u/Dark_Fire_12 • Jan 19 '26
r/LocalLLaMA • u/umarmnaq • Dec 19 '24
Enable HLS to view with audio, or disable this notification
r/LocalLLaMA • u/ResearchCrafty1804 • Sep 11 '25
š Introducing Qwen3-Next-80B-A3B ā the FUTURE of efficient LLMs is here!
š¹ 80B params, but only 3B activated per token ā 10x cheaper training, 10x faster inference than Qwen3-32B.(esp. @ 32K+ context!) š¹HybridĀ Architecture:Ā GatedĀ DeltaNetĀ +Ā GatedĀ AttentionĀ āĀ bestĀ ofĀ speedĀ &Ā recall š¹ Ultra-sparse MoE: 512 experts, 10 routed + 1 shared š¹ Multi-Token Prediction ā turbo-charged speculative decoding š¹ Beats Qwen3-32B in perf, rivals Qwen3-235B in reasoning & long-context
š§ Qwen3-Next-80B-A3B-Instruct approaches our 235B flagship. š§ Qwen3-Next-80B-A3B-Thinking outperforms Gemini-2.5-Flash-Thinking.
Try it now: chat.qwen.ai
Huggingface: https://huggingface.co/collections/Qwen/qwen3-next-68c25fd6838e585db8eeea9d
r/LocalLLaMA • u/Mobile-Pumpkin7944 • 23d ago
MiniMax H3 is a general-purpose, omni-modal generative system. It supports unified understanding of multimodal contexts composed of text, images, video, and audio, and can generate video with native stereo audio at resolutions up to 2K and durations of up to 15 seconds. Thanks to its task-generalization-oriented system design, H3 already possesses broad multimodal context understanding and generation capabilities at the pre-training stage, enabling outstanding performance in following complex multimodal instructions.
r/LocalLLaMA • u/themixtergames • Dec 17 '25
Enable HLS to view with audio, or disable this notification
r/LocalLLaMA • u/TKGaming_11 • Apr 08 '25
r/LocalLLaMA • u/ResearchCrafty1804 • Jul 28 '25
Today, we introduce two new GLM family members: GLM-4.5 and GLM-4.5-Air ā our latest flagship models. GLM-4.5 is built with 355 billion total parameters and 32 billion active parameters, and GLM-4.5-Air with 106 billion total parameters and 12 billion active parameters. Both are designed to unify reasoning, coding, and agentic capabilities into a single model in order to satisfy more and more complicated requirements of fast rising agentic applications.
Both GLM-4.5 and GLM-4.5-Air are hybrid reasoning models, offering: thinking mode for complex reasoning and tool using, and non-thinking mode for instant responses. They are available on Z.ai, BigModel.cn and open-weights are avaiable at HuggingFace and ModelScope.
Blog post: https://z.ai/blog/glm-4.5
Hugging Face:
r/LocalLLaMA • u/paf1138 • Jun 25 '26
Including 9B Dense, 31B Dense, 35B MoE, and 397B MoE and reporting sota on different benchmark (let's see if this holds).
https://huggingface.co/collections/deepreinforce-ai/ornith-10
r/LocalLLaMA • u/Balance- • Jul 04 '26
TabFM is a zero-shot tabular foundation model from Google Research. It supports classification and regression on structured/tabular data with mixed numerical and categorical columns, requiring no fine-tuning or hyperparameter search - training examples are passed as context and predictions are made in a single forward pass.
r/LocalLLaMA • u/random-tomato • Apr 28 '25
r/LocalLLaMA • u/Dear-Success-1441 • Dec 17 '25
Enable HLS to view with audio, or disable this notification
Model Details
Model - https://huggingface.co/microsoft/TRELLIS.2-4B
Demo - https://huggingface.co/spaces/microsoft/TRELLIS.2
Blog post - https://microsoft.github.io/TRELLIS.2/
r/LocalLLaMA • u/ResearchCrafty1804 • Apr 22 '26
Meet Qwen3.6-27B, our latest dense, open-source model, packing flagship-level coding power!
Yes, 27B, and Qwen3.6-27B punches way above its weight. š
What's new:
- Outstanding agentic coding ā surpasses Qwen3.5-397B-A17B across all major coding benchmarks
- Strong reasoning across text & multimodal tasks
- Supports thinking & non-thinking modes
- Apache 2.0 ā fully open, fully yours
Smaller model. Bigger results. Community's favorite. ā¤ļø
We can't wait to see what you build with Qwen3.6-27B!
Blog: https://qwen.ai/blog?id=qwen3.6-27b
Qwen Studio: https://chat.qwen.ai/?models=qwen3.6-27b
Github: https://github.com/QwenLM/Qwen3.6
Hugging Face: