Add pad token id
#1
by
rawsh
- opened
Fixes Cannot handle batch sizes > 1 if no padding token is defined
tested with:
infinity_emb v2 --model-id michaelfeil/mxbai-rerank-large-v2-seq --device mps --engine torch --no-model-warmup --revision refs/pr/1