Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Qwen2.5-72B-quantized.w8a16
like
0
Follow
Red Hat AI
763
Text Generation
Safetensors
English
qwen2
int8
vllm
llm-compressor
conversational
compressed-tensors
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
Community
main
Qwen2.5-72B-quantized.w8a16
/
generation_config.json
alexmarques
Upload folder using huggingface_hub
f3302d0
verified
7 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
117 Bytes
{
"bos_token_id"
:
151643
,
"eos_token_id"
:
151643
,
"max_new_tokens"
:
2048
,
"transformers_version"
:
"4.45.1"
}