Not supported with TGI

#92

by abhishek3jangid - opened Jan 15

Jan 15

ValueError: Unsupported model type mixtral
rank=0
2024-01-15T05:46:51.125822Z ERROR text_generation_launcher: Shard 0 failed to start
2024-01-15T05:46:51.125859Z INFO text_generation_launcher: Shutting down shards
Error: ShardCannotStart

aigeek0x0

Jan 19

Make sure you install the latest transformers package using git.

shankarkumarj

Jan 24

I get the error : ValueError: Unsupported model type mixtral

ArthurZ

Jan 26

pip install -U transformers

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment