File size: 340 Bytes
0ed32d5
 
 
 
 
 
 
1
2
3
4
5
6
7
streamlit
torch            # PyTorch for model inference
sentencepiece    # Tokenizer for T5 models
accelerate>=0.29.0  # For device_map and efficient loading
huggingface_hub  # To use InferenceClient for API calls
# Transformers library with BitNet support (via GitHub fork)
transformers @ git+https://github.com/shumingma/transformers.git