Spaces:
Running
Running
File size: 858 Bytes
aa8f591 23d4c16 4c3ffa2 d959a85 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
title: README
emoji: 🏆
colorFrom: green
colorTo: gray
sdk: static
pinned: false
---
<a href="https://huggingface.co/gair-prox" target="_blank">
<img src="https://cdn-uploads.huggingface.co/production/uploads/628f6e5ab90dde28ef57d293/gfqBTSEIa140Hu-mfo9Qe.png" alt="Clickable Image" />
</a>
GAIR-ProX, a subsidiary of [GAIR](https://huggingface.co/GAIR), spearheads the 🫐 ProX Project. This initiative aims to enhance pre-training efficiency by refining corpus documents using language models at scale. Through meticulous operations (e.g., document-level filtering and chunk-level cleaning), implemented as scalable, executable programs, 🫐 ProX seeks to improve pre-training data quality at scale, ultimately developing more robust and efficient language models.
<i>Read our [technical report](https://huggingface.co/papers/2409.17115)!</i> |