Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Llama-2-7b-chat-hf-FP8
like
0
Follow
Red Hat AI
1.29k
Text Generation
Transformers
Safetensors
llama
fp8
vllm
conversational
text-generation-inference
License:
llama2
Model card
Files
Files and versions
xet
Community
1
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
Loading the quantized model using AutoModelForCausalLM
#1 opened 25 days ago by
NamburiSrinath
NamburiSrinath