Update README.md
Browse files
README.md
CHANGED
@@ -115,13 +115,36 @@ You can finetune this model on your own dataset.
|
|
115 |
#### Cross Encoder Reranking
|
116 |
|
117 |
* Dataset: `gooaq-dev`
|
118 |
-
* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
119 |
|
120 |
| Metric | Value |
|
121 |
|:------------|:---------------------|
|
122 |
| map | 0.8039 (+0.2728) |
|
123 |
-
| mrr@10 | 0.8028 (+0.
|
124 |
-
| **ndcg@10** | **0.8475 (+0.
|
125 |
|
126 |
<!--
|
127 |
## Bias, Risks and Limitations
|
|
|
115 |
#### Cross Encoder Reranking
|
116 |
|
117 |
* Dataset: `gooaq-dev`
|
118 |
+
* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
|
119 |
+
```json
|
120 |
+
{
|
121 |
+
"at_k": 10,
|
122 |
+
"always_rerank_positives": false
|
123 |
+
}
|
124 |
+
```
|
125 |
+
|
126 |
+
| Metric | Value |
|
127 |
+
|:------------|:---------------------|
|
128 |
+
| map | 0.7451 (+0.2140) |
|
129 |
+
| mrr@10 | 0.7443 (+0.2203) |
|
130 |
+
| **ndcg@10** | **0.7849 (+0.1937)** |
|
131 |
+
|
132 |
+
#### Cross Encoder Reranking
|
133 |
+
|
134 |
+
* Dataset: `gooaq-dev`
|
135 |
+
* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
|
136 |
+
```json
|
137 |
+
{
|
138 |
+
"at_k": 10,
|
139 |
+
"always_rerank_positives": true
|
140 |
+
}
|
141 |
+
```
|
142 |
|
143 |
| Metric | Value |
|
144 |
|:------------|:---------------------|
|
145 |
| map | 0.8039 (+0.2728) |
|
146 |
+
| mrr@10 | 0.8028 (+0.2788) |
|
147 |
+
| **ndcg@10** | **0.8475 (+0.2563)** |
|
148 |
|
149 |
<!--
|
150 |
## Bias, Risks and Limitations
|