fastapi
uvicorn
transformers
torch
protobuf==3.20.*
accelerate>=0.26.0
bitsandbytes