Update README.md
Browse files
README.md
CHANGED
@@ -182,7 +182,30 @@ You can finetune this model on your own dataset.
|
|
182 |
|
183 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
184 |
-->
|
|
|
185 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
186 |
## Training Details
|
187 |
|
188 |
### Training Dataset
|
|
|
182 |
|
183 |
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
184 |
-->
|
185 |
+
## Evaluation
|
186 |
|
187 |
+
### Metrics
|
188 |
+
|
189 |
+
#### Information Retrieval
|
190 |
+
|
191 |
+
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
|
192 |
+
```
|
193 |
+
{'aaaaa_cosine_accuracy@1': 0.63,
|
194 |
+
'aaaaa_cosine_accuracy@3': 0.7802,
|
195 |
+
'aaaaa_cosine_accuracy@5': 0.8281,
|
196 |
+
'aaaaa_cosine_accuracy@10': 0.8822,
|
197 |
+
'aaaaa_cosine_precision@1': 0.63,
|
198 |
+
'aaaaa_cosine_precision@3': 0.4519333333333333,
|
199 |
+
'aaaaa_cosine_precision@5': 0.37512,
|
200 |
+
'aaaaa_cosine_precision@10': 0.28753,
|
201 |
+
'aaaaa_cosine_recall@1': 0.13777929675306055,
|
202 |
+
'aaaaa_cosine_recall@3': 0.24131449086140638,
|
203 |
+
'aaaaa_cosine_recall@5': 0.29659234974950643,
|
204 |
+
'aaaaa_cosine_recall@10': 0.3865740651558402,
|
205 |
+
'aaaaa_cosine_ndcg@10': 0.4835411072398472,
|
206 |
+
'aaaaa_cosine_mrr@10': 0.7153021428571383,
|
207 |
+
'aaaaa_cosine_map@100': 0.3784947452420437}
|
208 |
+
```
|
209 |
## Training Details
|
210 |
|
211 |
### Training Dataset
|