bigstorm/dolphin-2.9.2-qwen2-72b-6.0bpw-exl2
Text Generation
•
Updated
•
10
•
1
General ExLLamaV2 (exl2) Quants
Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy.
-
-
bigstorm/dolphin-2.9.1-llama-3-70b-6.0bpw-exl2
Text Generation • Updated • 9 • 3 -
bigstorm/Hermes-2-Theta-Llama-3-8B-8.0bpw-8hb-exl2
Text Generation • Updated • 11 -
bigstorm/Yi-1.5-34B-Chat-16K-8.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Codestral-22B-v0.1-8.0bpw-8hb-exl2
Text Generation • Updated • 9 -
bigstorm/dolphin-2.9.2-qwen2-72b-7.0bpw-8hb-exl2
Text Generation • Updated • 6 • 2 -
bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2
Text Generation • Updated • 6 -
bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2
Text Generation • Updated • 6 -
bigstorm/Mixtral-8x22B-Instruct-v0.1-7.0bpw-8hb-exl2
Updated -
bigstorm/gemma-2-27b-it-8.0bpw-8hb-exl2
Text Generation • Updated • 9 -
bigstorm/Llama-3-Groq-8B-Tool-Use-8.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Llama-3-Groq-70B-Tool-Use-8.0bpw-8hb-exl2
Text Generation • Updated • 9 • 1 -
bigstorm/Mistral-Nemo-Base-2407-8.0bpw-8hb-exl2
Text Generation • Updated • 7 -
bigstorm/Mistral-Nemo-Instruct-2407-8.0bpw-8hb-exl2
Text Generation • Updated • 5 -
bigstorm/Meta-Llama-3.1-70B-Instruct-8.0bpw-8hb-exl2
Text Generation • Updated • 11 -
bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2
Text Generation • Updated • 5 -
bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2
Text Generation • Updated • 7 -
bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2
Updated • 2 -
bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2
Updated • 3 -
bigstorm/Hermes-3-Llama-3.1-70B-8.0bpw-8hb-exl2
Updated • 5 -
bigstorm/Phi-3.5-mini-instruct-6.5bpw-8hb-exl2
Text Generation • Updated • 9 -
bigstorm/dolphin-2.9.4-llama3.1-8b-7.0bpw-8hb-exl2
Updated • 7 -
bigstorm/Mistral-Large-Instruct-2407-5.5bpw-8hb-exl2
Updated • 5 -
bigstorm/Mistral-Large-Instruct-2407-5.0bpw-8hb-exl2
Updated • 4 -
bigstorm/Mistral-Large-Instruct-2407-4.5bpw-8hb-exl2
Updated • 17 -
bigstorm/Mistral-Large-Instruct-2407-6.0bpw-8hb-exl2
Updated • 5 -
bigstorm/Mistral-Large-Instruct-2407-6.5bpw-8hb-exl2
Updated • 6 -
bigstorm/Reflections-Llama-3.1-70B-8.0bpw-8hb-exl2
Text Generation • Updated • 7 -
bigstorm/Reflections-Llama-3.1-70B-6.0bpw-8hb-exl2
Text Generation • Updated • 5 • 1 -
bigstorm/dolphin-2.9.4-llama3.1-8b-6.0bpw-6hb-exl2
Updated • 5 -
bigstorm/dolphin-2.9.4-llama3.1-8b-6.0bpw-8hb-exl2
Updated • 3 -
bigstorm/dolphin-2.9.3-mistral-nemo-12b-6.0bpw-6hb-exl2
Updated • 4 -
bigstorm/dolphin-2.9.3-llama-3-8b-6.0bpw-6hb-exl2
Updated • 6 -
bigstorm/dolphin-2.9.1-llama-3-8b-6.0bpw-6hb-exl2
Updated • 6 -
bigstorm/Qwen2.5-72B-Instruct-6.0bpw-6hb-exl2
Text Generation • Updated • 8 -
bigstorm/Qwen2.5-72B-Instruct-7.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Llama-3.2-1B-8.0bpw-8hb-exl2
Text Generation • Updated • 4 -
bigstorm/Qwama-0.5B-Instruct-8.0bpw-8hb-exl2
Updated • 2 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2
Text Generation • Updated • 20 • 3 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2
Text Generation • Updated • 11 • 1 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2
Text Generation • Updated • 11 • 3 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-6.0bpw-8hb-exl2
Text Generation • Updated • 14 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.0bpw-6hb-exl2
Text Generation • Updated • 6 -
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.5bpw-6hb-exl2
Text Generation • Updated • 8