gradio
fastapi
uvicorn
torch
tiktoken
pydantic
transformers
bitsandbytes
accelerate