Ctrl+K

8 contributors

History: 37 commits

versae

Merge branch 'main' of https://huggingface.co/flax-community/bertin-roberta-large-spanish into main

61f6971 almost 4 years ago

configs
Adding base config and organizing configs almost 4 years ago
mc4
Fixes to mc4 fork almost 4 years ago
.gitattributes

736 Bytes

Update .gitattributes almost 4 years ago
.gitignore

1.84 kB

Initial test with BETO's corpus about 4 years ago
README.md

1.84 kB

Adding checkpointing, wandb, and new mlm script almost 4 years ago
config.json

618 Bytes

Adding config and models for the hub widget almost 4 years ago
config.py

247 Bytes

Scripts for perplexity sampling and fixes almost 4 years ago
convert.py

469 Bytes

Adding missing import almost 4 years ago
flax_model.msgpack

250 MB
LFS

New Flax model almost 4 years ago
get_embeddings_and_perplexity.py

1.53 kB

Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization. almost 4 years ago
perplexity.py

751 Bytes

Adding checkpointing, wandb, and new mlm script almost 4 years ago
pytorch_model.bin

499 MB
LFS

Base model at 105k steps almost 4 years ago
run.sh

883 Bytes

Adding base config and organizing configs almost 4 years ago
run_mlm_flax.py

30 kB

Adding sampling to mc4 almost 4 years ago
run_mlm_flax_stream.py

28.4 kB

Fixes to mc4 fork almost 4 years ago
run_stream.sh

924 Bytes

Adding base config and organizing configs almost 4 years ago
tokenizer.json

1.47 MB

New tokenizer almost 4 years ago
tokens.py

649 Bytes

Scripts for perplexity sampling and fixes almost 4 years ago
tokens.py.orig

899 Bytes

Adjust batch size for extrating tokens almost 4 years ago
tsne_plot.py

3.02 kB

Remove unused imports almost 4 years ago