-
-
-
-
-
-
Inference Providers
Active filters:
4bit
mlx-community/Qwen3.5-397B-A17B-nvfp4
Text Generation
•
396B
•
Updated
•
2.76k
•
4
bullpoint/Qwen3-Coder-Next-AWQ-4bit
Text Generation
•
14B
•
Updated
•
285k
•
7
legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF
Text Generation
•
16B
•
Updated
•
452
•
9
TheCluster/amoral-gemma-3-12B-v2-mlx-4bit
Image-Text-to-Text
•
Updated
•
36
•
2
0xSero/GLM-4.7-REAP-218B-A32B-W4A16
Text Generation
•
2B
•
Updated
•
364
•
19
sugam24/dots-ocr-awq-4bit
Image-to-Text
•
0.8B
•
Updated
•
173
•
1
manu02/Eva-4B-V2-bnb-4bit-nf4-dq
Text Generation
•
4B
•
Updated
•
16
•
1
manu02/Octen-Embedding-8B-bnb-4bit-nf4-dq
Text Generation
•
8B
•
Updated
•
12
•
2
andrevp/Nanbeige4.1-3B-MLX-4bit
Text Generation
•
0.6B
•
Updated
•
61
•
1
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
8
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
16
•
121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
2
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
2
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
19
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
3
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
3
•
1
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
1
•
3
Text Generation
•
Updated
•
6
•
1
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
3
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
1
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
3
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
•
3
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
•
1
SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
5
•
8
SebastianSchramm/UniNER-7B-type-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
2
•
1
SebastianSchramm/UniNER-7B-definition-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
2
•
1
SebastianSchramm/UniNER-7B-type-sup-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
5
Text Generation
•
Updated
kingabzpro/zephyr-7b-beta-Agent-Instruct
Text Generation
•
Updated
•
1
•
1
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
7B
•
Updated
•
2
•
2