Hugging Face's logo

leliuga
/
gemma-7b-bnb-4bit

Text Generation
Transformers
Safetensors
gemma
arxiv:1910.09700
text-generation-inference
4-bit precision
Model card Files Community

gemma-7b - bnb 4bit

Description

This model is 4bit quantized version of gemma-7b using bitsandbytes. It's designed for fine-tuning! The PAD token is set as <>.

Downloads last month
81
Safetensors
Model size
4.78B params
Tensor type
F32
·
BF16
·
U8
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for leliuga/gemma-7b-bnb-4bit

Base model

google/gemma-7b
Quantized
(23)
this model

Collection including leliuga/gemma-7b-bnb-4bit