File size: 481 Bytes
f2f3ebb 0cc80dc f2f3ebb 0cc80dc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
datasets:
- ddrg/math_formulas
- ddrg/named_math_formulas
- ddrg/math_formula_retrieval
- ddrg/math_text
---
# Mathematical Structure Aware BERT
<!-- Provide a quick summary of what the model is/does. -->
Pretrained model based on [bert-base-cased](https://huggingface.co/bert-base-cased) with further mathematical pre-training.
Compared to bert-base-cased, 300 additional mathematical [LaTeX tokens](added_tokens.json) have been added before the mathematical pre-training. |