Hugging Face's logo

DevQuasar
/
neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community

'Make knowledge free for everyone'

Quantized version of: neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4 Buy Me a Coffee at ko-fi.com

Downloads last month
70
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF

Base model

meta-llama/Llama-3.1-8B
Finetuned
RedHatAI/Sparse-Llama-3.1-8B-2of4
Finetuned
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
Quantized
(4)
this model

Collection including DevQuasar/neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF