Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
huggingface 's Collections
DistilBERT release

DistilBERT release

updated Apr 17, 2024

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints.

Upvote
26

  • distilbert/distilbert-base-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 142k • • 51

  • distilbert/distilbert-base-uncased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 10.5M • • 733

  • distilbert/distilbert-base-multilingual-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 797k • 203

  • distilbert/distilbert-base-uncased-finetuned-sst-2-english

    Text Classification • 0.1B • Updated Dec 19, 2023 • 3.12M • • 800

  • distilbert/distilbert-base-uncased-distilled-squad

    Question Answering • 0.1B • Updated May 6, 2024 • 159k • • 116

  • distilbert/distilbert-base-cased-distilled-squad

    Question Answering • 0.1B • Updated May 6, 2024 • 245k • • 251
Upvote
26
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs