Should We Still Pretrain Encoders with Masked Language Modeling?
Paper
•
2507.00994
•
Published
•
78
Theo Johannet
tjohanne
·
AI & ML interests
NLP, audio
Recent Activity
upvoted
a
paper
about 2 months ago
Should We Still Pretrain Encoders with Masked Language Modeling?
updated
a model
over 1 year ago
tjohanne/whisper-small-hi
updated
a dataset
over 1 year ago
tjohanne/ASR-FRECSC
Organizations
upvoted
a
paper
about 2 months ago