Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Fireworks
Cohere
fal
Replicate
Hyperbolic
Cerebras
Together AI
Nscale
Nebius AI Studio
SambaNova
Novita
HF Inference API
Misc
Reset Misc
arxiv:
2505.07004
Misc with no match
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
23
Full-text search
Edit filters
Sort: Trending
Active filters:
2505.07004
Clear all
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-LNQ
Updated
9 days ago
•
1.06k
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-LNQ
Updated
9 days ago
•
433
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-LNQ
Updated
9 days ago
•
117
jusjinuk/Llama-3.3-70B-Instruct-2bit-GuidedQuant-LNQ
Updated
9 days ago
•
24
jusjinuk/Llama-3.3-70B-Instruct-3bit-GuidedQuant-LNQ
Updated
9 days ago
•
20
jusjinuk/Llama-3.3-70B-Instruct-4bit-GuidedQuant-LNQ
Updated
9 days ago
•
17
jusjinuk/Llama-3.3-70B-Instruct-3bit-SqueezeLLM
Updated
9 days ago
•
32
jusjinuk/Llama-3.3-70B-Instruct-4bit-SqueezeLLM
Updated
9 days ago
•
5
jusjinuk/Llama-3.1-8B-Instruct-2bit-SqueezeLLM
Updated
9 days ago
•
97
jusjinuk/Llama-3.1-8B-Instruct-3bit-SqueezeLLM
Updated
9 days ago
•
110
jusjinuk/Llama-3.1-8B-Instruct-4bit-SqueezeLLM
Updated
9 days ago
•
125
jusjinuk/Qwen3-32B-2bit-GuidedQuant-LNQ
Updated
6 days ago
•
58
jusjinuk/Qwen3-32B-3bit-GuidedQuant-LNQ
Updated
5 days ago
•
11
jusjinuk/Qwen3-32B-4bit-GuidedQuant-LNQ
Updated
5 days ago
•
17
jusjinuk/Qwen3-32B-2bit-SqueezeLLM
Updated
9 days ago
•
15
jusjinuk/Qwen3-32B-3bit-SqueezeLLM
Updated
9 days ago
•
8
jusjinuk/Qwen3-32B-4bit-SqueezeLLM
Updated
9 days ago
•
12
jusjinuk/gemma-3-27b-it-2bit-GuidedQuant-LNQ
Updated
3 days ago
•
21
jusjinuk/gemma-3-27b-it-2bit-SqueezeLLM
Updated
5 days ago
•
9
jusjinuk/gemma-3-27b-it-3bit-GuidedQuant-LNQ
Updated
5 days ago
•
5
jusjinuk/gemma-3-27b-it-3bit-SqueezeLLM
Updated
5 days ago
•
14
jusjinuk/gemma-3-27b-it-4bit-GuidedQuant-LNQ
Updated
5 days ago
•
7
jusjinuk/gemma-3-27b-it-4bit-SqueezeLLM
Updated
5 days ago
•
9