tomaarsen HF Staff commited on
Commit
65804d0
·
verified ·
1 Parent(s): 330dab1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -3
README.md CHANGED
@@ -115,13 +115,36 @@ You can finetune this model on your own dataset.
115
  #### Cross Encoder Reranking
116
 
117
  * Dataset: `gooaq-dev`
118
- * Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
119
 
120
  | Metric | Value |
121
  |:------------|:---------------------|
122
  | map | 0.8039 (+0.2728) |
123
- | mrr@10 | 0.8028 (+0.2789) |
124
- | **ndcg@10** | **0.8475 (+0.2562)** |
125
 
126
  <!--
127
  ## Bias, Risks and Limitations
 
115
  #### Cross Encoder Reranking
116
 
117
  * Dataset: `gooaq-dev`
118
+ * Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
119
+ ```json
120
+ {
121
+ "at_k": 10,
122
+ "always_rerank_positives": false
123
+ }
124
+ ```
125
+
126
+ | Metric | Value |
127
+ |:------------|:---------------------|
128
+ | map | 0.7451 (+0.2140) |
129
+ | mrr@10 | 0.7443 (+0.2203) |
130
+ | **ndcg@10** | **0.7849 (+0.1937)** |
131
+
132
+ #### Cross Encoder Reranking
133
+
134
+ * Dataset: `gooaq-dev`
135
+ * Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
136
+ ```json
137
+ {
138
+ "at_k": 10,
139
+ "always_rerank_positives": true
140
+ }
141
+ ```
142
 
143
  | Metric | Value |
144
  |:------------|:---------------------|
145
  | map | 0.8039 (+0.2728) |
146
+ | mrr@10 | 0.8028 (+0.2788) |
147
+ | **ndcg@10** | **0.8475 (+0.2563)** |
148
 
149
  <!--
150
  ## Bias, Risks and Limitations