Remove hardcode bos_token_id
2460dc2
duzx16
commited on
Commit History
Add support for streaming output
42095d4
duzx16
commited on
Fix overflow in FP16
220f772
duzx16
commited on
Set is_parallelizable to False
f9f74fd
duzx16
commited on
Add logit processor for NaN or Inf scores
c3dece3
duzx16
commited on
Fix default history argument
9d1509a
duzx16
commited on
Add support for float32
d4832e8
duzx16
commited on
Fix past_key_values
cd8041e
duzx16
commited on
