Text Generation
Transformers
Safetensors
stablelm
causal-lm
stablelm-2-1_6b / tokenization_arcade100k.py

Commit History

fix: make `eos_token`/`pad_token` overridable and add `pickle` support
c6d8d63
verified

jon-tow commited on

feat(tokenizer): expose merge ranks and special tokens for GGUF
478d491
verified

jon-tow commited on

init: release
96634d3

jon-tow commited on