RuntimeError: probability tensor contains either `inf`, `nan` or element < 0
#18
by
lcahill
- opened
Getting this error only when running gemma 2.
Transformers version: transformers-4.43.3 (also get it when installing straight from github: transformers-4.44.0.dev0)
Pytorch: '2.3.1+cu118'
Cuda: 11.8
Hi
@lcahill
, Please try again by installing the latest stable transformers and torch version in your code using - !pip install -U transformers and !pip install torch=2.3.1 and let us know if the issue still persists. Thank you.
Hi, Hope this issue is resolved. Version mismatches between compatible libraries can sometimes cause such errors, often due to the staggered release of dependent libraries.