Hugging Face's logo

ell-hol
/
mT5-OrangeSum

Summarization
Transformers
PyTorch
Enawené-Nawé
mt5
text2text-generation
Trained with AutoTrain
Eval Results
Inference Endpoints
Model card Files Community
2
mT5-OrangeSum / README.md
ell-hol's picture
ell-hol
Add evaluation results on the abstract config and validation split of orange_sum (#1)
f3b573f
preview code
|
raw
history blame contribute delete
3.01 kB
metadata
language:
  - unk
tags:
  - autotrain
  - summarization
datasets:
  - ell-hol/autotrain-data-test-orangesum
widget:
  - text: I love AutoTrain 🤗
co2_eq_emissions:
  emissions: 675.7789931017469
model-index:
  - name: ell-hol/mT5-OrangeSum
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: orange_sum
          type: orange_sum
          config: abstract
          split: validation
        metrics:
          - type: rouge
            value: 33.377
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDhjMWIxYmNmNDYzNTMzMDM2YjQyOTdkYjYyMDJkZDhlNzQ2ZDVkNGM2YTIzODU4ZWYwZDg2ODZkN2U5OTk2MSIsInZlcnNpb24iOjF9.UL_nv_GGJ75LMgDmRjvrp0dYhCyjz-h5txS1ljDFS7k9Yy6iJ0QnTebou1tsLFtj7sBSvUKvZeyqFXEHN7SBCg
          - type: rouge
            value: 14.4472
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTYxZTVkMzFlMGUxMWNmNzc5ZDI0OWM3ODY2ZTc1MDg2MDc2NTRiZjM3OTA4NGI1MmEwNzQzMjQyOWM5NDE3YiIsInZlcnNpb24iOjF9.xsBp4kyHAnAnAWllwvcXNF3vFFbgP_3Ipplg0Cs8yMzY2qIKozlflWSpmm7qyru1RvtDrHH5JQy0hSSz49tMDQ
          - type: rouge
            value: 24.1902
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzgxMDNmODZiOTcxYmU0NjlkMjEzOTBmZjZhMzkxZDcyODNjYmJjOGNiNzA2MTI2YjU4MTUzZTFlM2EwYjRkNyIsInZlcnNpb24iOjF9.QE9X1gqHxDA_Vzj86nOi1FrYXrvvYR-uQgAKn2ESJp48mnT4rHCnpxVo3qJGXcoeD0vA0M9VDWJzc2pci34PBA
          - type: rouge
            value: 25.5277
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDk2YzY1NjU3NDgxMDllYjIwMGI5NGE2ZjY3NzcxZGEwNmYzYjQxYzVlZTdmYzdkYWIxM2Y1YjkxNjZhOWRlZiIsInZlcnNpb24iOjF9.ksd-KgRtY71cHJxFsqLWr5lofRSrfiwixGTI6Hek6GvfisssetoDPy17bWnQpUqfN0ozxJciw2VzpauYPDuZCg
          - type: loss
            value: 1.6347737312316895
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDNmODJhNzdmMzNkMTc4MDcwZDhmNDFiZjM1ZWVmYjQ4N2IzNWU3MjYwMWM4ZmM0NjFhNjY1OTBlZjBkMjY0YSIsInZlcnNpb24iOjF9.aaF2D-cKnhK4YaqFV23QhoiTCOK7rQJKoXJMMj-kuxe_NLQBLNj73LBou376IlsTmOxxk_mmEimzwMMbTiVSDA
          - type: gen_len
            value: 48.4967
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzk3YjMxZWY2NzE5ZWMxZjBhYmE5YzU2YTM3MzNmMjlmNmJjM2MyMzY4ZTE1MjI1ZTNkN2YxOWZhOThmYzljMyIsInZlcnNpb24iOjF9._I_I9B66dT3S8RMMmMACG3YjIQYcXzmodriDWM33jRa4X6NFQx0b6_YHNP7K-uLEm8qD31bgb0NlsaRA37qLBA

Model Trained Using AutoTrain

  • Problem type: Summarization
  • Model ID: 2638979565
  • CO2 Emissions (in grams): 675.7790

Validation Metrics

  • Loss: 1.631
  • Rouge1: 33.348
  • Rouge2: 14.481
  • RougeL: 24.210
  • RougeLsum: 25.514
  • Gen Len: 48.497

Usage

You can use cURL to access this model:

$ curl -X POST -H "Authorization: Bearer YOUR_HUGGINGFACE_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/ell-hol/autotrain-test-orangesum-2638979565