File size: 754 Bytes
4b903b6 b54ea9c 4b903b6 6bf3927 4b903b6 d8936da 4b903b6 d8936da 4b903b6 b54ea9c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
---
library_name: model2vec
license: mit
model_name: cnmoro/custom-model2vec-tokenlearn-small
tags:
- embeddings
- static-embeddings
- sentence-transformers
language:
- pt
- en
---
A custom model2vec model, trained using a modified version of the [tokenlearn](https://github.com/MinishLab/tokenlearn) library.
Base model is nomic-ai/nomic-embed-text-v2-moe.
The output dimension is 256, and the vocabulary size is 10.000.
The training process used a mix of English (10%) and Portuguese (90%) texts.
```python
from model2vec import StaticModel
# Load a pretrained Sentence Transformer model
model = StaticModel.from_pretrained("cnmoro/custom-model2vec-tokenlearn-small")
# Compute text embeddings
embeddings = model.encode(["Example sentence"])
``` |