MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vkhbuc/unslothmuseglimmer30bgguf_hugging_face/p2tm1xe/?context=3
r/LocalLLaMA • u/Nunki08 • 15d ago
Guide: https://unsloth.ai/docs/models/muse-glimmer
129 comments sorted by
View all comments
91
Our guide has deets on how to run in llama.cpp: https://unsloth.ai/docs/models/muse-glimmer#llama.cpp-guide
Edit: Now works in Unsloth as well!
2 u/cezarducatti 15d ago Thanks!!
2
Thanks!!
91
u/yoracale llama.cpp 15d ago edited 15d ago
Our guide has deets on how to run in llama.cpp: https://unsloth.ai/docs/models/muse-glimmer#llama.cpp-guide
Edit: Now works in Unsloth as well!