README.md

---
library_name: transformers
license: openrail++
datasets:
- textdetox/multilingual_paradetox
- chameleon-lizard/synthetic-multilingual-paradetox
language:
- en
- ru
- uk
- am
- de
- es
- zh
- ar
- hi
pipeline_tag: text2text-generation
---

# Model Card for Model ID

Finetune of the mt0-xl model for text toxification task.


## Model Details

### Model Description

This is a finetune of mt0-xl model for text toxification task. Can be used for synthetic data generation from non-toxic examples.

- **Developed by:** Nikita Sushko
- **Model type:** mt5-xl
- **Language(s) (NLP):** English, Russian, Ukranian, Amharic, German, Spanish, Chinese, Arabic, Hindi
- **License:** OpenRail++
- **Finetuned from model:** mt0-xl

## Uses

This model is intended to be used for synthetic data generation from non-toxic examples.

### Direct Use

The model may be directly used for text toxification tasks.

### Out-of-Scope Use

The model may be used for generating toxic versions of sentences.

## Bias, Risks, and Limitations

Since this model generates toxic versions of sentences, it may be used to increase toxicity of generated texts.

## How to Get Started with the Model

Use the code below to get started with the model.

```python
import transformers

checkpoint = 'chameleon-lizard/tox-mt0-xl'

tokenizer = transformers.AutoTokenizer.from_pretrained(checkpoint)
model = transformers.AutoModelForSeq2SeqLM.from_pretrained(checkpoint, torch_dtype='auto', device_map="auto")

pipe = transformers.pipeline(
    "text2text-generation", 
    model=model, 
    tokenizer=tokenizer, 
    max_length=512,
    truncation=True,
)

language = 'English'
text = "That's dissapointing."
print(pipe('Rewrite the following text in {language} the most toxic and obscene version possible: {text}')[0]['generated_text'])
# Resulting text: "That's dissapointing, you stupid ass bitch."
```

Be sure to prompt with the provided prompt format for the best performance. Failure to include target language may result in model responses be in random language.