| datasets: | |
| - ddrg/math_formulas | |
| - ddrg/named_math_formulas | |
| - ddrg/math_formula_retrieval | |
| - ddrg/math_text | |
| # Mathematical Structure Aware BERT | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| Pretrained model based on [bert-base-cased](https://huggingface.co/bert-base-cased) with further mathematical pre-training. | |
| Compared to bert-base-cased, 300 additional mathematical [LaTeX tokens](added_tokens.json) have been added before the mathematical pre-training. |