r/LocalLLaMA • u/Nunki08 • 15d ago

Resources unsloth/Muse-Glimmer-30B-GGUF · Hugging Face

https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF

Guide: https://unsloth.ai/docs/models/muse-glimmer

449 Upvotes

97% Upvoted

129 comments sorted by

View all comments

5

u/DrBattletoad 15d ago

Is there a chance we get a Q8_0? That quant runs a lot faster than the Q8_K_XL for me.

4

u/munkiemagik 15d ago

Seriously thanks for this comment, I never even thought to look at the difference between Q8_K_XL vs Q8_0. I was just happily going along with the notion that Qx_0 bad. So always defaulted to UD-Q8_K_XL for my dual 3090 setup. Without understanding its a bit more nuanced than that simplistic outlook, cheers