Update README.md
Browse files
README.md
CHANGED
@@ -182,6 +182,30 @@ You can finetune this model on your own dataset.
|
|
182 |
|
183 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
184 |
-->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
185 |
|
186 |
## Training Details
|
187 |
|
|
|
182 |
|
183 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
184 |
-->
|
185 |
+
## Evaluation
|
186 |
+
|
187 |
+
### Metrics
|
188 |
+
|
189 |
+
#### Information Retrieval
|
190 |
+
|
191 |
+
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
|
192 |
+
```
|
193 |
+
{'aaa_cosine_accuracy@1': 0.6465,
|
194 |
+
'aaa_cosine_accuracy@3': 0.8083,
|
195 |
+
'aaa_cosine_accuracy@5': 0.8598,
|
196 |
+
'aaa_cosine_accuracy@10': 0.9207,
|
197 |
+
'aaa_cosine_precision@1': 0.6465,
|
198 |
+
'aaa_cosine_precision@3': 0.4838,
|
199 |
+
'aaa_cosine_precision@5': 0.4153200000000001,
|
200 |
+
'aaa_cosine_precision@10': 0.33329000000000003,
|
201 |
+
'aaa_cosine_recall@1': 0.1383275111412705,
|
202 |
+
'aaa_cosine_recall@3': 0.24971930213626684,
|
203 |
+
'aaa_cosine_recall@5': 0.315993377810083,
|
204 |
+
'aaa_cosine_recall@10': 0.42927605009627184,
|
205 |
+
'aaa_cosine_ndcg@10': 0.5298122781447128,
|
206 |
+
'aaa_cosine_mrr@10': 0.7379566269841226,
|
207 |
+
'aaa_cosine_map@100': 0.4812504287090463}
|
208 |
+
```
|
209 |
|
210 |
## Training Details
|
211 |
|