jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-QTIP
Updated
Instruction-tuned models (GuidedQuant)
-
-
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-1B-Instruct-2bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-1B-Instruct-3bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-1B-Instruct-4bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-3B-Instruct-2bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-3B-Instruct-3bit-GuidedQuant-QTIP
Updated -
jusjinuk/Llama-3.2-3B-Instruct-4bit-GuidedQuant-QTIP
Updated -
jusjinuk/gemma-3-27b-it-2bit-GuidedQuant-LNQ
Updated • 22 -
jusjinuk/gemma-3-27b-it-3bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/gemma-3-27b-it-4bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Qwen3-32B-2bit-GuidedQuant-LNQ
Updated • 69 -
jusjinuk/Qwen3-32B-3bit-GuidedQuant-LNQ
Updated • 15 -
jusjinuk/Qwen3-32B-4bit-GuidedQuant-LNQ
Updated • 21 -
jusjinuk/Llama-3.3-70B-Instruct-2bit-GuidedQuant-LNQ
Updated • 26 -
jusjinuk/Llama-3.3-70B-Instruct-3bit-GuidedQuant-LNQ
Updated • 59 -
jusjinuk/Llama-3.3-70B-Instruct-4bit-GuidedQuant-LNQ
Updated • 53 -
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-LNQ
Updated • 1.54k -
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-LNQ
Updated • 889 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-LNQ
Updated • 144 -
GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance
Paper • 2505.07004 • Published • 6 -
jusjinuk/gemma-3-27b-it-2bit-SqueezeLLM
Updated • 11 -
jusjinuk/gemma-3-27b-it-3bit-SqueezeLLM
Updated • 14 -
jusjinuk/gemma-3-27b-it-4bit-SqueezeLLM
Updated • 13 -
jusjinuk/Qwen3-32B-2bit-SqueezeLLM
Updated • 15 -
jusjinuk/Qwen3-32B-3bit-SqueezeLLM
Updated • 8 -
jusjinuk/Qwen3-32B-4bit-SqueezeLLM
Updated • 13 -
jusjinuk/Llama-3.3-70B-Instruct-2bit-SqueezeLLM
Updated • 15 -
jusjinuk/Llama-3.3-70B-Instruct-3bit-SqueezeLLM
Updated • 125 -
jusjinuk/Llama-3.3-70B-Instruct-4bit-SqueezeLLM
Updated • 21 -
jusjinuk/Llama-3.1-8B-Instruct-2bit-SqueezeLLM
Updated • 118 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-SqueezeLLM
Updated • 111 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-SqueezeLLM
Updated • 150