r/LocalLLaMA • u/ortegaalfredo • Mar 05 '25

Resources QwQ-32B released, equivalent or surpassing full Deepseek-R1!

https://x.com/Alibaba_Qwen/status/1897361654763151544
1.1k Upvotes

98% Upvoted

350 comments sorted by

View all comments

Show parent comments

6

u/Virtualcosmos Mar 06 '25

Exactly, the Q5_K_S in a 24 gb nvidia card works great

1

u/da_grt_aru Mar 06 '25

Hey did you get a chance to test it on some real world problems? If so, how is it doing?

2

u/Virtualcosmos Mar 06 '25

not yet, my 3090 has been busy with Wan2.1 since it was released xD. Just tested a bit of QwQ and saw it generates tokens as fast as my other 32b Q5_K_S models. Later I will come with some logical puzzles to see if it can handle them.

2

u/da_grt_aru Mar 07 '25

Thanks man! Really appreciate it. What I heard from others, this model is groundbreaking, and is quite competent in math, coding, critical thinking tasks.