Kunal Dhawan commited on
Commit
6c0383f
·
1 Parent(s): 195d5b9

added mcv16.1 numbers

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md CHANGED
@@ -68,6 +68,62 @@ model-index:
68
  - name: Test WER
69
  type: wer
70
  value: 1.95
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
71
  - task:
72
  type: Automatic Speech Translation
73
  name: automatic-speech-translation
@@ -379,6 +435,7 @@ The constituents of public data are as follows.
379
  Automatic Speech Recognition:
380
  * [HuggingFace OpenASR Leaderboard evaluation sets](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
381
  * [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
 
382
 
383
  Automatic Speech Translation:
384
  * [FLEURS](https://huggingface.co/datasets/google/fleurs)
@@ -431,6 +488,11 @@ WER on [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
431
  |:---------:|:-----------:|:------:|:------:|:------:|
432
  | 2.2.0 | canary-1b-flash | 4.36 | 2.69 | 4.47 |
433
 
 
 
 
 
 
434
 
435
  More details on evaluation can be found at [HuggingFace ASR Leaderboard](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
436
 
 
68
  - name: Test WER
69
  type: wer
70
  value: 1.95
71
+ - task:
72
+ type: Automatic Speech Recognition
73
+ name: automatic-speech-recognition
74
+ dataset:
75
+ name: Mozilla Common Voice 16.1
76
+ type: mozilla-foundation/common_voice_16_1
77
+ config: en
78
+ split: test
79
+ args:
80
+ language: en
81
+ metrics:
82
+ - name: Test WER (En)
83
+ type: wer
84
+ value: 6.99
85
+ - task:
86
+ type: Automatic Speech Recognition
87
+ name: automatic-speech-recognition
88
+ dataset:
89
+ name: Mozilla Common Voice 16.1
90
+ type: mozilla-foundation/common_voice_16_1
91
+ config: de
92
+ split: test
93
+ args:
94
+ language: de
95
+ metrics:
96
+ - name: Test WER (De)
97
+ type: wer
98
+ value: 4.03
99
+ - task:
100
+ type: Automatic Speech Recognition
101
+ name: automatic-speech-recognition
102
+ dataset:
103
+ name: Mozilla Common Voice 16.1
104
+ type: mozilla-foundation/common_voice_16_1
105
+ config: es
106
+ split: test
107
+ args:
108
+ language: es
109
+ metrics:
110
+ - name: Test WER (ES)
111
+ type: wer
112
+ value: 3.31
113
+ - task:
114
+ type: Automatic Speech Recognition
115
+ name: automatic-speech-recognition
116
+ dataset:
117
+ name: Mozilla Common Voice 16.1
118
+ type: mozilla-foundation/common_voice_16_1
119
+ config: fr
120
+ split: test
121
+ args:
122
+ language: fr
123
+ metrics:
124
+ - name: Test WER (Fr)
125
+ type: wer
126
+ value: 5.88
127
  - task:
128
  type: Automatic Speech Translation
129
  name: automatic-speech-translation
 
435
  Automatic Speech Recognition:
436
  * [HuggingFace OpenASR Leaderboard evaluation sets](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
437
  * [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
438
+ * [MCV] (https://commonvoice.mozilla.org/en/datasets)
439
 
440
  Automatic Speech Translation:
441
  * [FLEURS](https://huggingface.co/datasets/google/fleurs)
 
488
  |:---------:|:-----------:|:------:|:------:|:------:|
489
  | 2.2.0 | canary-1b-flash | 4.36 | 2.69 | 4.47 |
490
 
491
+ WER on [MCV-16.1](https://commonvoice.mozilla.org/en/datasets) test set:
492
+ | **Version** | **Model** | **En** | **De** | **Es** | **Fr** |
493
+ |:---------:|:-----------:|:------:|:------:|:------:|:------:|
494
+ | 2.2.0 | canary-1b-flash | 6.99 | 4.03 | 3.31 | 5.88 |
495
+
496
 
497
  More details on evaluation can be found at [HuggingFace ASR Leaderboard](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
498