Release hs-rerank-1

.gitattributes

@@ -0,0 +1,38 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+assets/banner.png filter=lfs diff=lfs merge=lfs -text
+assets/benchmarks.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,155 @@
+---
+license: mit
+base_model: jhu-clsp/mmBERT-small
+base_model_relation: finetune
+library_name: sentence-transformers
+pipeline_tag: text-ranking
+language:
+- en
+- es
+- fr
+- de
+- pt
+- ja
+- ko
+- zh
+tags:
+- sentence-transformers
+- cross-encoder
+- reranker
+- multilingual
+- onnx
+- text-embeddings-inference
+- hindsight
+---
+
+![Hindsight](assets/banner.png)
+
+# hs-rerank-1
+
+hs-rerank-1 is a multilingual cross-encoder reranker built for [Hindsight](https://github.com/vectorize-io/hindsight).
+It reads a query and a document together and returns a relevance score.
+
+## Highlights
+
+- **Multilingual:** English, Spanish, French, German, Portuguese, Japanese, Korean and Chinese
+  (Simplified and Traditional).
+- **Long inputs:** up to 8,192 tokens per query and document pair.
+- **Small:** 114M parameters. 98M of them are the token embedding table, so each forward pass
+  runs a 15M-parameter transformer.
+- **CPU and GPU:** ships an int8 ONNX export for CPU, and safetensors for GPU in FP16.
+- **Serves on TEI:** CPU and GPU images.
+
+## Model overview
+
+| | |
+|---|---|
+| Model type | Cross-encoder reranker |
+| Base model | `jhu-clsp/mmBERT-small` |
+| Parameters | 114M |
+| Languages | en, es, fr, de, pt, ja, ko, zh |
+| Context length | 8,192 tokens |
+| Output | One relevance score per query and document pair |
+| Formats | safetensors stored in FP16 (FP32 copy on the `fp32` branch), ONNX (`onnx/model.onnx`, int8 vocabulary table) |
+
+## Evaluation
+
+![hs-rerank-1 benchmarks](assets/benchmarks.png)
+
+## Usage
+
+### Sentence Transformers
+
+```bash
+pip install -U sentence-transformers
+```
+
+```python
+from sentence_transformers import CrossEncoder
+
+model = CrossEncoder("hindsight-ai/hs-rerank-1")
+
+query = "¿Qué app de presupuesto estoy creando?"
+documents = [
+    "El usuario quiere tooltips en su app de presupuesto.",
+    "El usuario corre los domingos por la mañana.",
+]
+
+print(model.rank(query, documents))
+# [{'corpus_id': 0, 'score': 0.9647}, {'corpus_id': 1, 'score': 0.0003}]
+```
+
+`predict` and `rank` return scores between 0 and 1. Pass `activation_fn=torch.nn.Identity()`
+for raw logits.
+
+### Text Embeddings Inference
+
+CPU (uses `onnx/model.onnx`):
+
+```bash
+docker run -p 8080:80 \
+  ghcr.io/huggingface/text-embeddings-inference:cpu-1.9.3 \
+  --model-id hindsight-ai/hs-rerank-1 --auto-truncate
+```
+
+GPU:
+
+```bash
+docker run --gpus all -p 8080:80 \
+  ghcr.io/huggingface/text-embeddings-inference:89-1.9.3 \
+  --model-id hindsight-ai/hs-rerank-1 --auto-truncate
+```
+
+Use the GPU image tag for your GPU: `89-1.9.3` for L4 and other Ada GPUs, `1.9.3` for A100
+and H100.
+
+```bash
+curl 127.0.0.1:8080/rerank \
+  -H 'Content-Type: application/json' \
+  -d '{
+    "query": "¿Qué app de presupuesto estoy creando?",
+    "texts": [
+      "El usuario quiere tooltips en su app de presupuesto.",
+      "El usuario corre los domingos por la mañana."
+    ]
+  }'
+```
+
+### Hindsight
+
+```bash
+HINDSIGHT_API_RERANKER_PROVIDER=local
+HINDSIGHT_API_RERANKER_LOCAL_MODEL=hindsight-ai/hs-rerank-1
+```
+
+Or point Hindsight at a TEI server:
+
+```bash
+HINDSIGHT_API_RERANKER_PROVIDER=tei
+HINDSIGHT_API_RERANKER_TEI_URL=http://localhost:8080
+```
+
+### Hindsight Inference
+
+hs-rerank-1 is also served at `https://inference.hindsight.vectorize.io`. To use it from
+Hindsight:
+
+```bash
+HINDSIGHT_API_RERANKER_PROVIDER=hindsight
+HINDSIGHT_API_RERANKER_HINDSIGHT_API_KEY=<your Hindsight Inference API key>
+```
+
+## License
+
+MIT
+
+## Citation
+
+```bibtex
+@misc{hindsightai2026hsrerank1,
+  title  = {hs-rerank-1},
+  author = {{Hindsight AI}},
+  year   = {2026},
+  url    = {https://huggingface.co/hindsight-ai/hs-rerank-1}
+}
+```

config.json

@@ -0,0 +1,72 @@
+{
+  "architectures": [
+    "ModernBertForSequenceClassification"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "classifier_activation": "gelu_pytorch_tanh",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "cls",
+  "cls_token_id": 1,
+  "decoder_bias": true,
+  "deterministic_flash_attn": true,
+  "dtype": "float32",
+  "embedding_dropout": 0.0,
+  "eos_token_id": 1,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu_pytorch_tanh",
+  "hidden_size": 384,
+  "id2label": {
+    "0": "LABEL_0"
+  },
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "label2id": {
+    "LABEL_0": 0
+  },
+  "layer_norm_eps": 1e-05,
+  "layer_types": [
+    "full_attention",
+    "sliding_attention",
+    "sliding_attention",
+    "full_attention",
+    "sliding_attention",
+    "sliding_attention",
+    "full_attention",
+    "sliding_attention"
+  ],
+  "local_attention": 128,
+  "local_rope_theta": 160000.0,
+  "mask_token_id": 4,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 6,
+  "num_hidden_layers": 8,
+  "pad_token_id": 0,
+  "position_embedding_type": "sans_pos",
+  "rope_parameters": {
+    "full_attention": {
+      "rope_theta": 160000,
+      "rope_type": "default"
+    },
+    "sliding_attention": {
+      "rope_theta": 160000,
+      "rope_type": "default"
+    }
+  },
+  "sep_token_id": 1,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "tie_word_embeddings": true,
+  "transformers_version": "5.16.1",
+  "vocab_size": 256000
+}

config_sentence_transformers.json

@@ -0,0 +1 @@
+{"model_type": "CrossEncoder", "activation_fn": "torch.nn.modules.linear.Identity"}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a3b0d9a505dd9fe810bfa411e23a45c33d6c6d5801e1b680f390edea7db2782
+size 227593826

onnx/model.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c866580692c6bf274b11ca622db4329f4cbfd6f08f96af964badc31d748ef243
+size 160582339

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 8192,
+  "do_lower_case": false
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:609d8f4c067cd3950f88594c5a802616cea245823836ef5848ee4fc40aab5b6f
+size 34363188

tokenizer_config.json

@@ -0,0 +1,23 @@
+{
+  "backend": "tokenizers",
+  "bos_token": "<bos>",
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "<bos>",
+  "eos_token": "<eos>",
+  "extra_special_tokens": [
+    "<start_of_turn>",
+    "<end_of_turn>"
+  ],
+  "mask_token": "<mask>",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "<pad>",
+  "padding_side": "right",
+  "sep_token": "<eos>",
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "TokenizersBackend",
+  "unk_token": "<unk>"
+}