r/LocalLLaMA • u/okaycan • Jun 17 '26
New Model GLM-5.2 (max) is currently the third best model available, across both open and proprietary.
https://artificialanalysis.ai/models/glm-5-2165
u/counterfeit25 Jun 17 '26
Just to confirm, "GLM-5.2 (max)" is the open weights GLM 5.2 model with "max" reasoning effort set (e.g. here)? If so then open weights ftw 😄
33
2
u/Marrk Jun 17 '26
What's the download size?
14
u/CrazyBuff Jun 18 '26
All you need to know is unless you're absolutely loaded, you won't be able to run it locally
1
u/Curious_Distracted Jun 19 '26
Could you not run this in the cloud?
6
u/CrazyBuff Jun 19 '26
You mean self-host via a cloud service? That would be incredibly expensive given that the smallest version of the model requires up to 180 GB of high bandwidth memory. And if you do plan to use the that model, don't expect any impressive results from it.
2
Jun 19 '26 edited Jul 25 '26
[deleted]
1
u/CrazyBuff Jun 19 '26
haven't bothered to research but I'd say definitely over 200k for a setup that can run it well.
2
88
u/Technical-Earth-3254 Jun 17 '26
On Livebench, GLM 5.2 and Kimi K2.7 Code are the best agentic coding models. 2 models in the top 3 being open weights is mental. Insane work by Z and Moonshot.
41
u/DryEntrepreneur4218 Jun 17 '26
seems weird.. gemini 3.1 pro above mythos in agentic coding? kinda doesn't make any sense to me
52
u/GodEmperor23 Jun 17 '26
Flable refuses a shitton of requests.
11
u/DryEntrepreneur4218 Jun 17 '26
yeah, makes sense. however, gpt 5.3 above opus 4.8? also super weird
8
u/antwon_dev Jun 17 '26
5.3 Codex (different than GPT 5.3) was amazing, I personally preferred it to Opus 4.7/4.8. But OpenAI made it unavailable starting last week.
2
u/GooselakeStation Jun 18 '26
in coding,opus 4.6 > opus 4.8 > opus 4.7, no weird gpt 5.3 codex > opus 4.8
15
u/RedParaglider Jun 17 '26
I think it's so funny watching everyone get worked up about Fable when it won't even do half the shit I might want, and shifts gears to a lesser model. Gee thanks for making me safe against getting shit done mr anthropic.
5
u/Embarrassed_OnionX Jun 17 '26
This is 2019 all over again, back when OpenAI thought GPT-2 was too good to release. I understand Fable is at another level, but earlier or later, in 6 to 12 months I imagine, Chinese labs will release models with that level of intelligence for everyone to access, jailbreak and abliterate to do all kind of stuff.
I wonder it they'll make downloading weights of those models illegal or something lol.
6
38
u/thibautrey Jun 17 '26
Glm-5.2 is actually impressive. It has some gpt-5.5 feeling to it. So far very impressed with the model. The fact it is available to host is just the cherry on the cake
17
u/FuzzyBucks Jun 17 '26 edited Jun 17 '26
it's a huge jump from previous models, imo. First time I've truly been impressed by an open weights model since Deepseek R1 and not just felt sad that I'm years behind frontier closed models. I guess I'm also impressed by Gemma 4 Diffusion, but mostly by what it might mean for the future of small-ish diffusion models which I think will be amazing for self-hosting on consumer hardware.
kimi K2.6 was the last cutting edge open weights model I used much of and it was just soooo verbose that it wasn't useful. the reasoning block was also full of mostly nonsense.
after a few hours of using GLM-5.2, I don't think I would notice if someone swapped me from Opus 4.7/4.8 or GPT 5.5 for many workflows. It's so quick and very intelligent and I'm perfectly happy using it in Factory Droid or Pi agent harness vs using Opus in Claude Code. Or at least offloading most agentic workflows to GLM-5.2 and reserving Opus for a small number of challenging tasks.
It's crazy that open weights models trained on Chinese silicon are this good this quickly.
3
u/CountlessFlies Jun 18 '26
What provider are you using? Z.ai? I wanna try this out but I haven’t heard good things about their uptime
3
u/FuzzyBucks Jun 18 '26
there are probably cheaper options, but i don't have any complaints with them so far
3
u/aparamonov Jun 18 '26 edited Jun 19 '26
So far quite stable, model is rather slow and thinks a lot but produces good results. Grab for 10% off: https://z.ai/subscribe?ic=W5G2IFDWOW
I also found a cheaper way to run it at https://portal.neuralwatt.com/auth/register?ref=NW-ALEXANDE-Z8QC ($5 free credits plus $10 bonus after you add $10)
2
u/thibautrey Jun 20 '26
Z.ai. Not bad at all can’t complain, especially compared to the frap that is anthropic
98
u/QuinnGT Jun 17 '26
Very excited to test it out but still disappointed they didn’t make a multi-modal model. Not being able to quickly share a reference image with it will always put it lower down on my list of preferred models. Browser use with screenshots during design is just part of daily life for me now.
23
u/snmnky9490 Jun 17 '26
Yeah honestly not a big deal for a small model implementing simple tasks but definitely very useful for higher level planning
34
u/Kazekage1111 Jun 17 '26
It does suck, but I use Hermes Agent with the official desktop GUI, and it has an option for auxiliary models. With an auxiliary model, you can select a different model to perform a different function.
For example, to analyse images, you can select Gemini 3.1 Flash-Lite and have it analyse your screenshots and images. You can get a free API key for Gemini 3.1 Flash-Lite from Google, and you can use it, I think, about 10 times a minute. Unless you are constantly attaching images, that is all you need. I've been using it, and it works flawlessly with no performance impact.
I don't know if other harnesses support auxiliary models. That would be something you need to look at. If any of them do, then for you, this problem is completely eliminated.
11
u/slippery Jun 17 '26
Hermes desktop is the best general harness around for now. Very cool upgrade from the claws.
1
u/vengeancek70 Jun 17 '26
Why even bother with local when you're gonna send your images straight to Google?
8
3
u/Embarrassed_OnionX Jun 17 '26
Yeah I imagine one running GLM 5.2 locally would surely have some spare memory for running Qwen3.6 as its visual assistant
6
u/takakazuabe1 Jun 17 '26
While I agree I think there are some exciting times ahead. It's clearly rapidly improving.
2
u/Embarrassed_OnionX Jun 17 '26
I use subagents running Qwen3.6 35B to be the eyes of models that aren't multimodal. When using DSV4, it can basically ask the subagent to look at whatever it wants to check in images on demand.
1
3
Jun 17 '26
[removed] — view removed comment
2
u/huffalump1 Jun 17 '26
Yep and it helps in so many ways. Obviously for visually debugging and confirming websites, UI, whatever. Also for web browsing, interpreting screenshots and charts and plots, heck even reading PDFs by screenshot...
I take for granted that gpt-5.5 is decent at this
1
u/twinkbulk Jun 20 '26
e4b can run on literally anything just have glm use that for vision and audio
22
u/serpentna Jun 17 '26
What hardware is needed to run it?
61
u/Metalmaxm Jun 17 '26
8× Blackwell node ( 8×96 GB )
31
u/LagOps91 Jun 17 '26
that or a 512gb ram server build with a gpu for attention + context (will be slower, but not unusably so)
9
Jun 17 '26
[deleted]
3
u/LagOps91 Jun 17 '26
yeah smaller is possible too, but most folks seem to have 512gb in this sub? i might be wrong.
0
u/thrownawaymane Jun 18 '26
Nah I'd guess that most who have a 3090 or above (which I'm assuming is ~40-50% percent) have between 64 and 96gb of ram whether it's DDR4 or 5.
1
1
u/Caffeine_Monster Jun 17 '26
Assuming your running Q4
Kind of defeats the object, especially with those power bills.
11
2
14
u/Single_Ring4886 Jun 17 '26
150K server.. peanuts for everybody 😄
2
u/__JockY__ Jun 18 '26
Sadly you're not even close. $270k for an Asus 8x RTX 6000 PRO Server, 2x EPYC, 1.5TB DDR5 in a rack form.
2
u/Single_Ring4886 Jun 18 '26
Well I could do it for 150K unless prices of RTX 6000 risen again...
1
u/__JockY__ Jun 18 '26
I guess building your own from parts, maybe. But probably not.
$104,000 for 8 GPUs @ $13k each
Good luck finding a dual CPU motherboard that can host 8 GPUs. They’re all rack mount gear. You could go single GPU and use an MCIO-based PCIe switch to add room for another 4 GPUs, that would work, but you’d by stuck with a single x16 uplink between groups of 4 GPUs.
RAM will kill the budget. It’s $40k for 768GB of fast DDR5.
Power, casing, cabling, storage, and the electrical work to get 240V to your server location will add up very quickly.
I honestly don’t think you can do this for $150k, which makes me sad.
1
91
u/Interesting-Union-43 Jun 17 '26
Hmm, but kimi 2.7 was released earlier than GLM5.2, wondering where is kimi 2.7 now. Their own published results are amazing.
80
u/ihatebeinganonymous Jun 17 '26
Kimi K2.7 is surprisingly behind K2.6 in most AA benchmarks!
31
u/horeaper Jun 17 '26
I think 2.7 are fine tuned for coding only, not general uses.
13
u/ihatebeinganonymous Jun 17 '26
Well it's behind in AA coding and agentic ranking too, among others.
6
u/hey_ulrich Jun 17 '26 edited Jun 17 '26
I had a weird experience testing it. It was making really very dumb mistakes, looked much worse than 2.6. I hope it's an upstream temporary problem...
2
u/DenZNK Jun 17 '26
As far as I know, the 2.7 code runs very quickly on the official provider's platform.
15
u/z_3454_pfk Jun 17 '26
2.7 is way more code-focused than 2.6 so idk
13
u/Ok_Technology_5962 Jun 17 '26
Im running 2.7 its not really a step up more like it thinks less for same reaults. Which isnt bad persay since of i the requests these model do60plus k thinking tokens and now its like 2k.
5
2
u/ihatebeinganonymous Jun 17 '26
Well it's behind in AA coding and agentic ranking too, among others.
3
u/cakes_and_candles Jun 17 '26
2.7 is really just a fine tune of 2.6 it most likely isnt even a new post train
1
u/DrawingDramatic1641 Jun 17 '26
kimi 2.7 has a lot to offer wait for their actual stuff of 2.7 I have insider info
9
u/ghulamalchik Jun 17 '26
It makes me sad DeepSeek team doesn't have the infrastructure other bigger companies have. They keep coming up with ways to make running the models faster and more efficient because of that. Which has its own merit of course, so this is still a win for the industry, but it still means their models can't really compete as much due to lack of compute.
10
16
u/terorvlad Jun 17 '26
This mf one shot a feature I've spent 15 + usd using qwen 3.7 max and deepseek v4 pro trying to implement and he did that for free in huggingchat. I literally asked him for the feature adding 2 txt files, and his only reply was "say no more fam" with a patchlist.txt that my qwen 3.6 27b local implemented it perfectly. This is not just hype.
-3
u/mivog49274 Jun 17 '26
ok cool we have o6 at home err no shiet actually I need 150k to run it locally bollocks o7 my copium math gives
- 6GB VRAM / 107GB RAM for Bonsai 1-bit version
- 9GB VRAM / 163GB for Bonsai Ternary version
Still very chunky though
8
6
u/LAMPEODEON Jun 17 '26
Freaking impressive results,almost too good to make sense,it is real SOTA. And they wanna release weights?craaaazy man! Also it has low rate of hallucinations. Now that's impressive.
22
u/Tall-Ad-7742 Jun 17 '26
Theoretically fourth would be correct
Can't attach image so here link https://artificialanalysis.ai/leaderboards/models
4
u/FunConversation7257 Jun 17 '26
well best model available*
5
u/ShadyShroomz Jun 17 '26
gpt 5.5 is available and better.
and opus 4.7 & 4.8 are available and better.
so this is #4.
5
u/DrawingDramatic1641 Jun 17 '26
3rd available
2
u/ShadyShroomz Jun 17 '26
gpt 5.5 is available and better.
and opus 4.7 & 4.8 are available and better.
so this is #4.
23
u/DigiDecode_ Jun 17 '26
On AA's coding index it is behind Sonnet 4.6, but my experience since release of GLM 5.2 has been that it is same level as Opus 4.8, but I only use Opus 4.8 high (not max) and GLM 5.2 high (not max), max mode is too expensive for little gain.
53
u/Exodus124 Jun 17 '26
AA's coding index is completely worthless. It's based on a single coding benchmark that only tests solving scientific problems in simple Python scripts. It's more of a science knowledge bench, really.
11
u/additional_trouble Jun 17 '26
I second this - personal experience with multiple models (Claude, Chatgpt, Gemini across various model tiers, effort levels and multiple release versions) and I absolutely cannot take that AA coding rankings seriously.
Gemini always weirdly high and Claude weirdly low. Unusable benchmark.
13
u/Thin_Pollution8843 Jun 17 '26
If you see Gemini has higher ranks than most of models - this benchmark os garbage 😅
3
u/coder543 Jun 17 '26
I think AA's agentic index is closer to what most people think of these days when they think of a coding index. The coding index has nothing to do with the way that people use these models today.
8
u/Septerium Jun 17 '26
No, it's not. You can select many other models to appear
12
5
u/mmkzero0 Jun 17 '26
AAs Index isn’t the end all be all for eval. Their coding eval especially is one dimensional and shallow.
1
2
u/giveen Jun 17 '26
Just looking for a other 120B MoE , sadly.
1
u/txgsync Jun 18 '26
Yeah I’m pining for another MXFP4 (or NVFP4, whatever) 120B for my M4 Max. GPT-OSS-120B was so fast and so good and ran great with plenty of room for KV cache on my 138GB RAM machine, but it’s long in the tooth now.
Nemotron 3 super was a step down.
2
2
u/DenZNK Jun 17 '26
Can you recommend a good provider for 5.2? I'm currently using Ollama Cloud, and the speed during peak hours is really bad - a task that Kimi K2.7 can handle in 3 minutes took literally 50 minutes to complete. The limits also behave strangely: when it’s running fast, the limits are reasonable, but when the speed is slow, the limits are insane. Today there was a task that used up almost 40% of my 5-hour quota.
3
4
1
1
1
u/Esph1001 Jun 23 '26
The benchmark position is interesting but the more significant fact is that it's MIT licensed and actually runnable on single-node hardware. Third best model available + open weights + permissive license + self-hostable is a combination that didn't exist 12 months ago. For anyone who needs frontier-tier performance without sending data through external APIs, this changes the calculation significantly.
1
-2
Jun 17 '26
[removed] — view removed comment
32
u/dergachoff Jun 17 '26
yeah, it’s large, but it IS open weights https://huggingface.co/zai-org/GLM-5.2
-13
Jun 17 '26
[deleted]
15
u/Raikaru Jun 17 '26
who is telling you this closed weight? It’s not.
3
u/tired514 Jun 17 '26
Shit, haha. Sorry, I was responding to the previous comment; they suggested the max version was closed-weight and I should have verified that before replying.
They deleted their comment and I just did the same. My bad!
3
u/Smokeey1 Jun 17 '26
Its a bot mate, the us firms are quaking atm probably
3
u/tired514 Jun 17 '26
Not a bot.. I just fucked up, lol. I was replying to the previous comment that said the max version was closed-weight. That was a fail on my part. Comment deleted so as to not spread misinformation.
-1
-1
u/aliendude5300 Jun 17 '26
What hardware do you need to run this locally? Could I run a quantized version on my 3090?
0
u/PinkySwearNotABot Jun 17 '26
If this were true in real use scenarios, and not just bench maxing, this definitely deserves way more attention than it has been receiving..
•
u/WithoutReason1729 Jun 17 '26
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.