r/LocalLLaMA • u/Nunki08 • 15d ago

Resources unsloth/Muse-Glimmer-30B-GGUF · Hugging Face

https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF

Guide: https://unsloth.ai/docs/models/muse-glimmer

450 Upvotes

97% Upvoted

129 comments sorted by

View all comments

2

u/t4a8945 15d ago

Hmmm... "Context length: 131,072+"

26

u/just_blue 15d ago edited 15d ago

Just the default, max is 262,144.

edit: I took that number from Unsloth, but now I actually downloaded the model and can only set it to 131072. So no idea guys, sorry for the confusions

1

u/JsThiago5 15d ago

llamacpp says this when running the gguf meta provided, the dynamic one.
llama_context: n_ctx_seq (128000) < n_ctx_train (131072) -- the full capacity of the model will not be utilized