Text Generation
Transformers
PyTorch
Safetensors
English
gpt2
alignment
instruction tuned
text generation
conversation
assistant
dpo
text-generation-inference
Inference Endpoints
nicholasKluge commited on
Commit
2a1da5f
1 Parent(s): b14f9e9

Upload generation_config.json

Browse files
Files changed (1) hide show
  1. generation_config.json +12 -4
generation_config.json CHANGED
@@ -1,6 +1,14 @@
1
  {
2
- "_from_model_config": true,
3
- "bos_token_id": 50256,
4
- "eos_token_id": 50256,
5
- "transformers_version": "4.35.2"
 
 
 
 
 
 
 
 
6
  }
 
1
  {
2
+ "bos_token_id": 50257,
3
+ "do_sample": true,
4
+ "eos_token_id": 50258,
5
+ "max_new_tokens": 512,
6
+ "pad_token_id": 50260,
7
+ "renormalize_logits": true,
8
+ "repetition_penalty": 1.1,
9
+ "temperature": 0.3,
10
+ "top_k": 30,
11
+ "top_p": 0.3,
12
+ "transformers_version": "4.35.2",
13
+ "use_cache": false
14
  }