nllb-200-distilled-600M / tokenizer.json

lysandre HF Staff

Add fast tokeinzer

3045d0b about 3 years ago

17.3 MB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

SHA256:: e316b82de11d0f951f370943b3c438311629547285129b0b81dadabd01bca665
Pointer size:: 133 Bytes
Size of remote file:: 17.3 MB
Xet backed hash:: 0202f54e596c03be98c5a537e9214967476071dce868ac20a7a42ad57fdd1f7b

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.