MarkupLM

Multimodal (text +markup language) pre-training for Document AI

Introduction

MarkupLM is a simple but effective multi-modal pre-training method of text and markup language for visually-rich document understanding and information extraction tasks, such as webpage QA and webpage information extraction. MarkupLM archives the SOTA results on multiple datasets. For more details, please refer to our paper:

MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding Junlong Li, Yiheng Xu, Lei Cui, Furu Wei, ACL 2022

Usage

We refer to the docs and demo notebooks.

Downloads last month
9,551
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for microsoft/markuplm-base

Finetunes
2 models

Space using microsoft/markuplm-base 1