cyberagent/Mistral-Nemo-Japanese-Instruct-2408
Text Generation
•
12B
•
Updated
•
2.31k
•
40
Quantization Tests
Comparing Efficiency and Quality of various formats
-
-
shisa-ai/Mistral-Nemo-Japanese-Instruct-FP8-Dynamic
12B • Updated • 12 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-SQ-GPTQ-W8A8-INT8
12B • Updated • 25 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-GPTQ-W4A16-gs32
3B • Updated • 11 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-GPTQ-W4A16-gs128
3B • Updated • 14 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-GPTQ-W4A16-gs32-noact
3B • Updated • 54 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-exl2-6.0bpw
Updated • 36 -
shisa-ai/Mistral-Nemo-Japanese-Instruct-2408-q4f16_1-MLC
Updated -
QuantFactory/Mistral-Nemo-Japanese-Instruct-2408-GGUF
Text Generation • 12B • Updated • 735 • 17