Post
2327
FiftyOne Datasets <> Hugging Face Hub Integration!
As of yesterday's release of FiftyOne
You can now load Parquet datasets from the hub and have them converted directly into FiftyOne datasets. To load MNIST, for example:
You can also load FiftyOne datasets directly from the hub. Here's how you load the first 1000 samples from the VisDrone dataset:
And tying it all together, you can push your FiftyOne datasets directly to the hub:
Major thanks to @tomaarsen @davanstrien @severo @osanseviero and @julien-c for helping to make this happen!!!
Full documentation and details here: https://docs.voxel51.com/integrations/huggingface.html#huggingface-hub
As of yesterday's release of FiftyOne
0.23.8, the FiftyOne open source library for dataset curation and visualization is now integrated with the Hugging Face Hub!You can now load Parquet datasets from the hub and have them converted directly into FiftyOne datasets. To load MNIST, for example:
pip install -U fiftyoneimport fiftyone as fo
import fiftyone.utils.huggingface as fouh
dataset = fouh.load_from_hub(
"mnist",
format="ParquetFilesDataset",
classification_fields="label",
)
session = fo.launch_app(dataset)You can also load FiftyOne datasets directly from the hub. Here's how you load the first 1000 samples from the VisDrone dataset:
import fiftyone as fo
import fiftyone.utils.huggingface as fouh
dataset = fouh.load_from_hub("jamarks/VisDrone2019-DET", max_samples=1000)
# Launch the App
session = fo.launch_app(dataset)And tying it all together, you can push your FiftyOne datasets directly to the hub:
import fiftyone.zoo as foz
import fiftyone.utils.huggingface as fouh
dataset = foz.load_zoo_dataset("quickstart")
fouh.push_to_hub(dataset, "my-dataset")Major thanks to @tomaarsen @davanstrien @severo @osanseviero and @julien-c for helping to make this happen!!!
Full documentation and details here: https://docs.voxel51.com/integrations/huggingface.html#huggingface-hub