Update README.md

README.md

@@ -82,6 +82,24 @@ We evaluate PortBERT on **ExtraGLUE**, a Portuguese adaptation of the GLUE bench
 ## Fairseq Checkpoint
 Get the fairseq checkpoint [here](https://drive.proton.me/urls/K1564WDMX4#Ynyx8jgPis4R).
 
+## Citations
+If you use PortBERT in your research, please cite the following paper:
+```bibtex
+@book{scheible-schmitt-etal-2025-portbert,
+  author = {\textbf{Scheible-Schmitt}, \textbf{Raphael} and He, Henry and Mendes, Armando B.},
+  title = {PortBERT: Navigating the Depths of Portuguese Language Models},
+  booktitle = {Proceedings of the Workshop on Beyond English: Natural Language Processing for all Languages in an Era of Large Language Models},
+  month = {September},
+  year = {2025},
+  address = {Varna, Bulgaria},
+  publisher = {INCOMA Ltd., Shoumen, BULGARIA},
+  pages = {59--71},
+  abstract = {Transformer models dominate modern NLP, but efficient, language-specific models remain scarce. In Portuguese, most focus on scale or accuracy, often neglecting training and deployment efficiency. In the present work, we introduce PortBERT, a family of RoBERTa-based language models for Portuguese, designed to balance performance and efficiency. Trained from scratch on over 450 GB of deduplicated and filtered mC4 and OSCAR23 from CulturaX using fairseq, PortBERT leverages byte-level BPE tokenization and stable pre-training routines across both GPU and TPU processors. We release two variants, PortBERT base and PortBERT large, and evaluate them on ExtraGLUE, a suite of translated GLUE and SuperGLUE tasks. Both models perform competitively, matching or surpassing existing monolingual and multilingual models. Beyond accuracy, we report training and inference times as well as fine-tuning throughput, providing practical insights into model efficiency. PortBERT thus complements prior work by addressing the underexplored dimension of compute-performance tradeoffs in Portuguese NLP. We release all models on Huggingface and provide fairseq checkpoints to support further research and applications.},
+  url = {https://aclanthology.org/2025.globalnlp-1.8},
+  doi = {https://doi.org/10.26615/978-954-452-105-9-008}
+}
+```
+
 ## 📜 License
 
 MIT License