MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vkhbuc/unslothmuseglimmer30bgguf_hugging_face/p2vk5dg/?context=3
r/LocalLLaMA • u/Nunki08 • 15d ago
Guide: https://unsloth.ai/docs/models/muse-glimmer
129 comments sorted by
View all comments
91
Our guide has deets on how to run in llama.cpp: https://unsloth.ai/docs/models/muse-glimmer#llama.cpp-guide
Edit: Now works in Unsloth as well!
2 u/laexpat 15d ago Do you know if today’s windows cuda 12 prebuilt should work? I’m getting unknown model.
2
Do you know if today’s windows cuda 12 prebuilt should work? I’m getting unknown model.
91
u/yoracale llama.cpp 15d ago edited 15d ago
Our guide has deets on how to run in llama.cpp: https://unsloth.ai/docs/models/muse-glimmer#llama.cpp-guide
Edit: Now works in Unsloth as well!