Evaluations

[EMB] AWQ: encoding corpus ...
      corpus time=121.40s | 42.69 docs/s
[EMB] AWQ: encoding queries ...
      query time=4.12s | 72.81 q/s

[RET] Ranking top-10 ...

==================== Tiny-BEIR (SciFact/test) ====================
Encoding speed (corpus | queries):
  Base : 26.62 docs/s | 106.20 q/s
  AWQ  : 42.69 docs/s | 72.81 q/s

Metrics (nDCG@10 / Recall@1 / Recall@10 / MRR@10):
  Base : 73.25% | 55.63% | 88.66% | 68.53%
  AWQ  : 73.43% | 58.13% | 86.99% | 69.36%

Evaluated queries: 300
===============================================================

Downloads last month: 12

Safetensors

Model size

2.17B params

Tensor type

F32

I32

F16

Inference Providers NEW

Text Ranking

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for sionic-ai/bge-reasoner-embed-qwen3-8b-0923-AWQ-4bit

Base model

BAAI/bge-reasoner-embed-qwen3-8b-0923

Quantized

(1)

this model