Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ We follow the same evaluation protocol as [CultureMERT-95M](https://huggingface.
|
|
40 |
|
41 |
## ROC-AUC / mAP
|
42 |
|
43 |
-
|
|
44 |
|--------------------|:-------------:|:----------:|:--------:|:----:|:---:|:----:|:--------:|
|
45 |
| **MERT-v1-95M** | 83.2% / 53.3% | 82.4% / 52.9% | 74.9% / 39.7% | 85.7% / 56.5% | 90.7% / 48.1% | 89.6% / 35.9% | 66.1% |
|
46 |
| **CultureMERT-95M** | **89.6%** / 60.6% | **88.2%** / **63.5%** | **79.2%** / 43.1% | 86.9% / 56.7% | 90.7% / 48.1% | 89.4% / 35.9% | **69.3%** |
|
@@ -49,7 +49,7 @@ We follow the same evaluation protocol as [CultureMERT-95M](https://huggingface.
|
|
49 |
|
50 |
## Micro-F1 / Macro-F1
|
51 |
|
52 |
-
|
|
53 |
|--------------------|:-------------:|:----------:|:--------:|:----:|:---:|:----:|:--------:|
|
54 |
| **MERT-v1-95M** | 73.0% / 38.9% | 71.1% / 33.2% | 80.1% / 30.0% | 72.4% / 42.6% | 57.0% / 36.9% | 35.7% / 21.2% | 49.3% |
|
55 |
| **CultureMERT-95M** | **77.4%** / **45.8%** | **77.8%** / **50.4%** | **82.7%** / **32.5%** | **73.1%** / 43.1% | 58.3% / 36.6% | 35.6% / **22.9%** | **52.9%** |
|
|
|
40 |
|
41 |
## ROC-AUC / mAP
|
42 |
|
43 |
+
| | Turkish-makam | Hindustani | Carnatic | Lyra | FMA-medium | MTAT | **Avg.** |
|
44 |
|--------------------|:-------------:|:----------:|:--------:|:----:|:---:|:----:|:--------:|
|
45 |
| **MERT-v1-95M** | 83.2% / 53.3% | 82.4% / 52.9% | 74.9% / 39.7% | 85.7% / 56.5% | 90.7% / 48.1% | 89.6% / 35.9% | 66.1% |
|
46 |
| **CultureMERT-95M** | **89.6%** / 60.6% | **88.2%** / **63.5%** | **79.2%** / 43.1% | 86.9% / 56.7% | 90.7% / 48.1% | 89.4% / 35.9% | **69.3%** |
|
|
|
49 |
|
50 |
## Micro-F1 / Macro-F1
|
51 |
|
52 |
+
| | Turkish-makam | Hindustani | Carnatic | Lyra | FMA-medium | MTAT | **Avg.** |
|
53 |
|--------------------|:-------------:|:----------:|:--------:|:----:|:---:|:----:|:--------:|
|
54 |
| **MERT-v1-95M** | 73.0% / 38.9% | 71.1% / 33.2% | 80.1% / 30.0% | 72.4% / 42.6% | 57.0% / 36.9% | 35.7% / 21.2% | 49.3% |
|
55 |
| **CultureMERT-95M** | **77.4%** / **45.8%** | **77.8%** / **50.4%** | **82.7%** / **32.5%** | **73.1%** / 43.1% | 58.3% / 36.6% | 35.6% / **22.9%** | **52.9%** |
|