mridul3301
/

mistral-7b-finetuned-gguf

Model card Files Files and versions Community

GGUF models of the following model : https://huggingface.co/mridul3301/BioMistral-7B-finetuned

3 format of quantization:

fp8
fp16
fp32

Converted the safetensors to GGUF for inference in CPU using llama_cpp

Downloads last month: 24

GGUF

Model size

7.24B params

Architecture

llama

View all variants

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support