tintnguyen commited on
Commit
aaccb84
·
verified ·
1 Parent(s): 72088a5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -182,6 +182,30 @@ You can finetune this model on your own dataset.
182
 
183
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
184
  -->
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
185
 
186
  ## Training Details
187
 
 
182
 
183
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
184
  -->
185
+ ## Evaluation
186
+
187
+ ### Metrics
188
+
189
+ #### Information Retrieval
190
+
191
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
192
+ ```
193
+ {'aaa_cosine_accuracy@1': 0.6465,
194
+ 'aaa_cosine_accuracy@3': 0.8083,
195
+ 'aaa_cosine_accuracy@5': 0.8598,
196
+ 'aaa_cosine_accuracy@10': 0.9207,
197
+ 'aaa_cosine_precision@1': 0.6465,
198
+ 'aaa_cosine_precision@3': 0.4838,
199
+ 'aaa_cosine_precision@5': 0.4153200000000001,
200
+ 'aaa_cosine_precision@10': 0.33329000000000003,
201
+ 'aaa_cosine_recall@1': 0.1383275111412705,
202
+ 'aaa_cosine_recall@3': 0.24971930213626684,
203
+ 'aaa_cosine_recall@5': 0.315993377810083,
204
+ 'aaa_cosine_recall@10': 0.42927605009627184,
205
+ 'aaa_cosine_ndcg@10': 0.5298122781447128,
206
+ 'aaa_cosine_mrr@10': 0.7379566269841226,
207
+ 'aaa_cosine_map@100': 0.4812504287090463}
208
+ ```
209
 
210
  ## Training Details
211