lmstudio-community/GLM-4.7-GGUF
358B
•
Updated
•
73
•
1
AI & ML interests
Models quantized and uploaded by the LM Studio community, for the LM Studio community. Discord: https://discord.gg/aPQfnNkxGC
Recent Activity
View all activity
neilmehta24
published
a
model
4 days ago
lmmy
updated
a
model
8 days ago
mattjcly
published
6
models
19 days ago
lmstudio-community/functiongemma-270m-it-MLX-4bit
Text Generation
•
41.9M
•
Updated
•
131
lmstudio-community/functiongemma-270m-it-MLX-5bit
Text Generation
•
50.3M
•
Updated
•
173
lmstudio-community/functiongemma-270m-it-MLX-6bit
Text Generation
•
58.7M
•
Updated
•
302
lmstudio-community/functiongemma-270m-it-GGUF
0.3B
•
Updated
•
1.54k
•
1
lmstudio-community/functiongemma-270m-it-MLX-8bit
Text Generation
•
75.4M
•
Updated
•
2.74k
•
3
lmstudio-community/functiongemma-270m-it-MLX-bf16
Text Generation
•
0.3B
•
Updated
•
1.35k
lmmy
updated
2
models
19 days ago
mattjcly
updated
a
model
19 days ago
lmmy
updated
3
models
19 days ago
lmmy
updated
a
model
20 days ago
mattjcly
published
a
model
20 days ago
lmmy
updated
a
model
20 days ago
mattjcly
published
2
models
21 days ago
Post
68174
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinjaand it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)