Update README.md

README.md

@@ -12,14 +12,13 @@ language:
 - nl
 - pl
 ---
-**
-Pleias-pico-350m-preview** is an early preview of a 350 million parameter base model trained by Pleias on Common Corpus.
+**Pleias-pico-350m-Preview** is an early preview of a 350 million parameter base model trained by [Pleias](https://huggingface.co/PleIAs) on [Common Corpus](https://huggingface.co/datasets/PleIAs/common_corpus).
 
-Like all the base and specialized models from Pleias, Pleias-350m-Preview has only been trained on open data out of copyright (public domain) or under a permissible license.
+Like all the base and specialized models from Pleias, Pleias-pico-350m-Preview has only been trained on open data out of copyright (public domain) or under a permissible license.
 
 ## Description
 
-Pleias-pico-350m-preview is a transformer base model, entirely pretrained from scratch, using an architecture similar to Llama/GPT-Neox for easier deployment/inference.
+Pleias-pico-350m-Preview is a transformer base model, entirely pretrained from scratch, using an architecture similar to Llama/GPT-Neox for easier deployment/inference.
 
 It includes the following features, that would apply to any responsibly trained variant:
 * Only trained on open data under a permissible license and in compliance with the European AI Act. By design, all Pleias model are unable to output copyrighted content.
@@ -28,21 +27,21 @@ It includes the following features, that would apply to any responsibly trained
 * Extremely low level of toxicity and problematic content.
 
 
-Pleias-pico-350m-preview has demonstrated unusual abilities for multilingual generation in its size range. Fully supported languages include English, French, Spanish, German, Italian, Dutch, Latin and Portuguese. 
+Pleias-pico-350m-Preview has demonstrated unusual abilities for multilingual generation in its size range. Fully supported languages include English, French, Spanish, German, Italian, Dutch, Latin and Portuguese. 
 
-Given its size, Pleias-pico-350m-preview can run on CPU without any compression loss. We provide a first GGUF variant as part of our release.
+Given its size, Pleias-pico-350m-Preview can run on CPU without any compression loss. We provide a first GGUF variant as part of our release.
 
 ## Recommended use
-As a base model, Pleias-360m-Preview is only able to run continuation prompts.
+As a base model, Pleias-pico-350m-Preview is only able to run continuation prompts.
 
 Text generation is currently able to support a range of creative writing tasks in multiple European languages. For more consistent results we recommend using a low or null temperature with a slight repetition penalty (1.1-1.2).
 
-Pleias-360m-Preview has been successfully adapted for continuous pretraining and full-fine-tuning on document processing tasks such as RAG, translation or OCR correction. Given the small size of the model we do not recommend fine-tuning methods based on LORA.
+Pleias-pico-350m-Preview has been successfully adapted for continuous pretraining and full-fine-tuning on document processing tasks such as RAG, translation or OCR correction. Given the small size of the model we do not recommend fine-tuning methods based on LORA.
 
 ## Examples
-With only 360 million parameters, Pleias-360m-Preview is able to generate consistent texts in multiple European languages.
+With only 350 million parameters, Pleias-pico-350m-Preview is able to generate consistent texts in multiple European languages.
 
-Thanks to an unprecedented coverage of ancient texts in public domain, Pleias-360m-Preview is even able to generate texts in historical script. Such as a continuation of <i>To be or not to be</i> in original spelling:
+Thanks to an unprecedented coverage of ancient texts in public domain, Pleias-pico-350m-Preview is even able to generate texts in historical script. Such as a continuation of <i>To be or not to be</i> in original spelling:
 
 <blockquote>
 <b>To be, or not to be, that is the Queſtion:<br/>
@@ -76,18 +75,18 @@ Car il eſt certain que les Princes font moins heureux;<br/>
 Que ceux qui ont eu leur vie par leurs mains confacrée.<br/>
 </blockquote>
 
-Pleias-360m is able to interspesed languages and has good capacities for translation, even in classical languages like Latin:
+Pleias-pico-350m-Preview is able to intersperse languages and has good capacities for translation, even in classical languages like Latin:
 
 <blockquote>
 <b>Cicero advocated for a similar idea: Equidem ad</b> pacem, non ut in pace sit; sed ut in pace. Cicero's statement is echoed by other authors of the time, such as Quintilian and Tacitus, who also emphasized the importance of peace over war (Quint., Inst., 1, 4). In contrast to the Roman concept of "pax" or "pacificus", which was often associated with military conquests, Cicero saw peace as an ideal state that could be achieved through peaceful means. 
 </blockquote>
 
 ## Training
-Pleias-360m-Preview was fully pretrained at Jean Zay on 64 h100s for 46 hours with Nanotron, the pretraining library from HuggingFace. We provide the complete settings as a yaml file as part of our release. 
+Pleias-pico-350m-Preview was fully pretrained at Jean Zay on 64 h100s for 46 hours with Nanotron, the pretraining library from HuggingFace. We provide the complete settings as a yaml file as part of our release. 
 
 Training schedule includes 518,000 steps (batch size 1,024) on a filtered and enhanced version of Common Corpus (1,086,324,736,000 tokens).
 
 ## Update
-Pleias-360m-Preview is currently released as an early preview.
+Pleias-pico-350m-Preview is currently released as an early preview.
 
 The model will undergo several more round of post-training to enhance reasoning capacities and fine-tunability as well as in anticipation of a generalist instruct version.