Kunal Dhawan
commited on
Commit
·
6c0383f
1
Parent(s):
195d5b9
added mcv16.1 numbers
Browse files
README.md
CHANGED
@@ -68,6 +68,62 @@ model-index:
|
|
68 |
- name: Test WER
|
69 |
type: wer
|
70 |
value: 1.95
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
71 |
- task:
|
72 |
type: Automatic Speech Translation
|
73 |
name: automatic-speech-translation
|
@@ -379,6 +435,7 @@ The constituents of public data are as follows.
|
|
379 |
Automatic Speech Recognition:
|
380 |
* [HuggingFace OpenASR Leaderboard evaluation sets](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
|
381 |
* [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
|
|
|
382 |
|
383 |
Automatic Speech Translation:
|
384 |
* [FLEURS](https://huggingface.co/datasets/google/fleurs)
|
@@ -431,6 +488,11 @@ WER on [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
|
|
431 |
|:---------:|:-----------:|:------:|:------:|:------:|
|
432 |
| 2.2.0 | canary-1b-flash | 4.36 | 2.69 | 4.47 |
|
433 |
|
|
|
|
|
|
|
|
|
|
|
434 |
|
435 |
More details on evaluation can be found at [HuggingFace ASR Leaderboard](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
|
436 |
|
|
|
68 |
- name: Test WER
|
69 |
type: wer
|
70 |
value: 1.95
|
71 |
+
- task:
|
72 |
+
type: Automatic Speech Recognition
|
73 |
+
name: automatic-speech-recognition
|
74 |
+
dataset:
|
75 |
+
name: Mozilla Common Voice 16.1
|
76 |
+
type: mozilla-foundation/common_voice_16_1
|
77 |
+
config: en
|
78 |
+
split: test
|
79 |
+
args:
|
80 |
+
language: en
|
81 |
+
metrics:
|
82 |
+
- name: Test WER (En)
|
83 |
+
type: wer
|
84 |
+
value: 6.99
|
85 |
+
- task:
|
86 |
+
type: Automatic Speech Recognition
|
87 |
+
name: automatic-speech-recognition
|
88 |
+
dataset:
|
89 |
+
name: Mozilla Common Voice 16.1
|
90 |
+
type: mozilla-foundation/common_voice_16_1
|
91 |
+
config: de
|
92 |
+
split: test
|
93 |
+
args:
|
94 |
+
language: de
|
95 |
+
metrics:
|
96 |
+
- name: Test WER (De)
|
97 |
+
type: wer
|
98 |
+
value: 4.03
|
99 |
+
- task:
|
100 |
+
type: Automatic Speech Recognition
|
101 |
+
name: automatic-speech-recognition
|
102 |
+
dataset:
|
103 |
+
name: Mozilla Common Voice 16.1
|
104 |
+
type: mozilla-foundation/common_voice_16_1
|
105 |
+
config: es
|
106 |
+
split: test
|
107 |
+
args:
|
108 |
+
language: es
|
109 |
+
metrics:
|
110 |
+
- name: Test WER (ES)
|
111 |
+
type: wer
|
112 |
+
value: 3.31
|
113 |
+
- task:
|
114 |
+
type: Automatic Speech Recognition
|
115 |
+
name: automatic-speech-recognition
|
116 |
+
dataset:
|
117 |
+
name: Mozilla Common Voice 16.1
|
118 |
+
type: mozilla-foundation/common_voice_16_1
|
119 |
+
config: fr
|
120 |
+
split: test
|
121 |
+
args:
|
122 |
+
language: fr
|
123 |
+
metrics:
|
124 |
+
- name: Test WER (Fr)
|
125 |
+
type: wer
|
126 |
+
value: 5.88
|
127 |
- task:
|
128 |
type: Automatic Speech Translation
|
129 |
name: automatic-speech-translation
|
|
|
435 |
Automatic Speech Recognition:
|
436 |
* [HuggingFace OpenASR Leaderboard evaluation sets](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
|
437 |
* [MLS](https://huggingface.co/datasets/facebook/multilingual_librispeech)
|
438 |
+
* [MCV] (https://commonvoice.mozilla.org/en/datasets)
|
439 |
|
440 |
Automatic Speech Translation:
|
441 |
* [FLEURS](https://huggingface.co/datasets/google/fleurs)
|
|
|
488 |
|:---------:|:-----------:|:------:|:------:|:------:|
|
489 |
| 2.2.0 | canary-1b-flash | 4.36 | 2.69 | 4.47 |
|
490 |
|
491 |
+
WER on [MCV-16.1](https://commonvoice.mozilla.org/en/datasets) test set:
|
492 |
+
| **Version** | **Model** | **En** | **De** | **Es** | **Fr** |
|
493 |
+
|:---------:|:-----------:|:------:|:------:|:------:|:------:|
|
494 |
+
| 2.2.0 | canary-1b-flash | 6.99 | 4.03 | 3.31 | 5.88 |
|
495 |
+
|
496 |
|
497 |
More details on evaluation can be found at [HuggingFace ASR Leaderboard](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)
|
498 |
|