Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
nvidia
/
Llama-3.1-405B-Instruct-FP8
like
11
Follow
NVIDIA
30.7k
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
License:
llama3.1
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
KeyError when loading Llama-3.1-405B-Instruct-FP8 with VLLM v0.7.3
2
#2 opened 3 months ago by
xihajun
xihajun