Hugging Face's logo
Ann Huang's picture
3 7 5

Ann Huang

erinys
21world's profile picture ductrinh's profile picture lunarflu's profile picture
·
https://huggingface.co/erinys

AI & ML interests

None yet

Recent Activity

updated a Space about 2 months ago
xet-team/cas-analysis
reacted to elliesleightholm's post with 🤗 about 2 months ago
I made a beginners guide to Hugging Face Spaces 🤗 I hope it's useful to some of you :) YouTube video: https://www.youtube.com/watch?v=xqdTFyRdtjQ Blog: https://www.marqo.ai/blog/how-to-create-a-hugging-face-space
reacted to jsulz's post with 🔥 about 2 months ago
When the XetHub crew joined Hugging Face this fall, @erinys and I started brainstorming how to share our work to replace Git LFS on the Hub. Uploading and downloading large models and datasets takes precious time. That’s where our chunk-based approach comes in. Instead of versioning files (like Git and Git LFS), we version variable-sized chunks of data. For the Hugging Face community, this means: ⏩ Only upload the chunks that changed. 🚀 Download just the updates, not the whole file. 🧠 We store your file as deduplicated chunks In our benchmarks, we found that using CDC to store iterative model and dataset version led to transfer speedups of ~2x, but this isn’t just a performance boost. It’s a rethinking of how we manage models and datasets on the Hub. We're planning on our new storage backend to the Hub in early 2025 - check out our blog to dive deeper, and let us know: how could this improve your workflows? https://huggingface.co/blog/from-files-to-chunks
View all activity

Articles

Organizations

Hugging Face's profile picture Blog-explorers's profile picture Journalists on Hugging Face's profile picture Xet Team's profile picture open/ acc's profile picture

erinys's activity

upvoted an article 3 months ago
view article
Article

How to optimize your data labelling project with custom interfaces

By burtenshaw •
• 18
upvoted 2 articles 4 months ago
view article
Article

Improving Parquet Dedupe on Hugging Face Hub

• 32
view article
Article

Introducing the SQL Console on Datasets

• 20
upvoted 2 articles 5 months ago
view article
Article

XetHub is joining Hugging Face!

• 81