c4ai-command-r7b-12-2024-exl2 / generation_config.json
Anthonyg5005's picture
Add quant for BPW 2.8
ca10ae3 verified
raw
history blame
178 Bytes
{
"_from_model_config": true,
"bos_token_id": 5,
"cache_implementation": "hybrid",
"eos_token_id": 255001,
"pad_token_id": 0,
"transformers_version": "4.48.0.dev0"
}