Hugging Face's logo
BuiDoan's picture
54 45

BuiDoan

BuiDoan
thangvip's profile picture 21world's profile picture fibonacciai's profile picture
Ā·

AI & ML interests

None yet

Recent Activity

reacted to jsulz's post with šŸš€ 1 day ago
It's been a bit since I took a step back and looked at https://huggingface.co/xet-team progress to migrate Hugging Face from Git LFS to Xet, but every time I do it boggles the mind. A month ago there were 5,500 users/orgs on Xet with 150K repos and 4PB. Today? šŸ¤— 700,000 users/orgs šŸ“ˆ 350,000 repos šŸš€ 15PB Meanwhile, our migrations have pushed throughput to numbers that are bonkers. In June, we hit upload speeds of 577Gb/s (crossing 500Gb/s for the first time). These are hard numbers to put into context, but let's try: The latest run of the Common Crawl from https://huggingface.co/commoncrawl was 471 TB. We now have ~32 crawls stored in Xet. At peak upload speed we could move the latest crawl into Xet in about two hours. We're moving to a new phase in the process, so stay tuned. This shift in gears means it's also time to roll up our sleeves and look at all the bytes we have and the value we're adding to the community. I already have some homework from @RichardErkhov to look at the dedupe across their uploads, and I'll be doing the same for other early adopters, big models/datasets, and frequent uploaders (looking at you @bartowski šŸ‘€) Let me know if there's anything you're interested in; happy to dig in!
liked a model 10 days ago
mistralai/Magistral-Small-2506
liked a model 10 days ago
Menlo/Jan-nano
View all activity

Organizations

Gradio-Blocks-Party's profile picture