Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ Our complete suite of models from 11M to 570M parameters trained with Pico:
|
|
40 |
- [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
|
41 |
- [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
|
42 |
|
43 |
-
> π§ **Disclaimer** These models are still under construction. The models released in this repository have been trained for
|
44 |
>
|
45 |
> π§ **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
|
46 |
|
|
|
40 |
- [**pico-decoder-medium**](https://huggingface.co/pico-lm/pico-decoder-medium) (181M parameters)
|
41 |
- [**pico-decoder-large**](https://huggingface.co/pico-lm/pico-decoder-large) (570M parameters)
|
42 |
|
43 |
+
> π§ **Disclaimer** These models are still under construction. The models released in this repository have been trained for 125,000 steps (corresponding to ~250B tokens). Training will finalize after 200,000 steps.
|
44 |
>
|
45 |
> π§ **Coming Soon!** **pico-decoder-xl** (1B+ parameters) Watch this space or star our [GitHub repository](https://github.com/pico-lm) for updates!
|
46 |
|