Error when run the demo code.

#1
by UnnamedWatcher - opened

I run the demo code but failed. The error is :

image.png

When the tranformers version degrades from 4.44.2 to 4.40.1, the bug disappeared.

can i use the model by vllm,how to run it ,help please

Sign up or log in to comment