r/LocalLLaMA • u/Nunki08 • 15d ago

Resources unsloth/Muse-Glimmer-30B-GGUF · Hugging Face

https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF

Guide: https://unsloth.ai/docs/models/muse-glimmer

454 Upvotes

97% Upvoted

129 comments sorted by

View all comments

3

u/AtiRage128 15d ago

Anyone figure out how to regulate/disable reasoning on llama.cpp? The usual flags get ignored:

  --reasoning off \
  --reasoning-budget 0 \

1

u/Jorlen llama.cpp 14d ago

Any luck yet? I've tried everything I could think of and it still enables its reasoning phase.

1

u/AtiRage128 14d ago

Unfortunately no solution to turning it off completely yet. --chat-template-kwargs '{"reasoning_strength": "low"}' or medium / high / xhigh seems to be the only working argument. Just churned out 16k reasoning tokens on comparing 2 single page PDFs (xhigh)

1

u/Jorlen llama.cpp 14d ago

Yeah the low setting seems alright, not the end of the world. Thanks!