The documentation page MODEL_DOC/ROFORMER doesn’t exist in v4.21.3, but exists on the main version. Click here to redirect to the main version of the documentation.