Hugging Face's logo

TheBloke
/
Phind-CodeLlama-34B-v2-AWQ

Text Generation
Transformers
Safetensors
llama
code llama
Eval Results
text-generation-inference
4-bit precision
awq
Model card Files Community
3
New discussion

torch.bfloat16 is not supported for quantization method awq

5
#2 opened over 1 year ago by
Pizzarino