phi3_medium_1c_book1 / generation_config.json
yegorzv's picture
Upload generation_config.json with huggingface_hub
7ce6445 verified
raw
history blame contribute delete
288 Bytes
{
"_from_model_config": true,
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": 32007,
"max_length": 4096,
"max_new_tokens": 1536,
"pad_token_id": 1,
"repetition_penalty": 1.12,
"temperature": 0.2,
"top_k": 30,
"top_p": 0.9,
"transformers_version": "4.46.2"
}