Instructions to use transformers-community/sink_cache with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use transformers-community/sink_cache with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("transformers-community/sink_cache", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
example
Joao Ganteea681c7 -
revert readme
Joao Gantebd36a6b -
add model
Joao Gante7939f4e -
add example
Joao Ganted938814
-
update readme
Joao Gantebdb93c2
-
add WIP
Joao Gante2a0ad2b -
add sanity checks
Joao Gante835a8a6 -
add sanity checks
Joao Ganteffa8b5a -
allow passing a sink cache back in
Joao Gantef84586a -
add sink cache options
Joao Gantee9837c5 -
add sinkcache class
Joao Gante7f36015 -
add readme
Joao Gante7bbd1e8 -
initial commit
Verified signature936e74c