QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF

This is quantized version of munish0838/Mistral-v0.3-Instruct-Matter-Slim-A created using llama.cpp

Model Description

  • Developed by: munish0838
  • License: apache-2.0
  • Finetuned from model : unsloth/mistral-7b-instruct-v0.3-bnb-4bit
  • Dataset Used: 0-hero/Matter-0.1-Slim-A

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
98
GGUF
Model size
7.25B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF

Collection including QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF