tintnguyen commited on
Commit
314f904
·
verified ·
1 Parent(s): 841e98a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md CHANGED
@@ -182,7 +182,30 @@ You can finetune this model on your own dataset.
182
 
183
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
184
  -->
 
185
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
186
  ## Training Details
187
 
188
  ### Training Dataset
 
182
 
183
  *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
184
  -->
185
+ ## Evaluation
186
 
187
+ ### Metrics
188
+
189
+ #### Information Retrieval
190
+
191
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) on [ir-eval](https://huggingface.co/datasets/tintnguyen/ir-eval/tree/main)
192
+ ```
193
+ {'aaaaa_cosine_accuracy@1': 0.63,
194
+ 'aaaaa_cosine_accuracy@3': 0.7802,
195
+ 'aaaaa_cosine_accuracy@5': 0.8281,
196
+ 'aaaaa_cosine_accuracy@10': 0.8822,
197
+ 'aaaaa_cosine_precision@1': 0.63,
198
+ 'aaaaa_cosine_precision@3': 0.4519333333333333,
199
+ 'aaaaa_cosine_precision@5': 0.37512,
200
+ 'aaaaa_cosine_precision@10': 0.28753,
201
+ 'aaaaa_cosine_recall@1': 0.13777929675306055,
202
+ 'aaaaa_cosine_recall@3': 0.24131449086140638,
203
+ 'aaaaa_cosine_recall@5': 0.29659234974950643,
204
+ 'aaaaa_cosine_recall@10': 0.3865740651558402,
205
+ 'aaaaa_cosine_ndcg@10': 0.4835411072398472,
206
+ 'aaaaa_cosine_mrr@10': 0.7153021428571383,
207
+ 'aaaaa_cosine_map@100': 0.3784947452420437}
208
+ ```
209
  ## Training Details
210
 
211
  ### Training Dataset