Hugging Face's logo

macadeliccc
/
Hermes-2-Pro-Mistral-7B-AWQ

Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community

Original model

Downloads last month
77
Safetensors
Model size
1.2B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for macadeliccc/Hermes-2-Pro-Mistral-7B-AWQ

Base model

mistralai/Mistral-7B-v0.1
Finetuned
NousResearch/Hermes-2-Pro-Mistral-7B
Quantized
(14)
this model