DistilBERT
Collection
Smaller BERT models for question answering and text classification
•
13 items
•
Updated
Sparse DISTILBERT model (uncased)
Finetuned model pruned to 1:4 structured sparsity.
Intended Use
The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.
Evaluation Results
We get the following results on the SQuADv1.1 tasks development set:
| Task | SQuADv1.1 (F1) |
|---|---|
| 87.00 |
- Downloads last month
- 24
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.