File size: 754 Bytes
4b903b6
 
 
 
 
 
 
 
b54ea9c
 
 
4b903b6
 
 
 
6bf3927
 
4b903b6
 
 
 
 
d8936da
4b903b6
 
d8936da
4b903b6
 
 
b54ea9c
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
library_name: model2vec
license: mit
model_name: cnmoro/custom-model2vec-tokenlearn-small
tags:
- embeddings
- static-embeddings
- sentence-transformers
language:
- pt
- en
---

A custom model2vec model, trained using a modified version of the [tokenlearn](https://github.com/MinishLab/tokenlearn) library.

Base model is nomic-ai/nomic-embed-text-v2-moe.

The output dimension is 256, and the vocabulary size is 10.000.

The training process used a mix of English (10%) and Portuguese (90%) texts.

```python
from model2vec import StaticModel

# Load a pretrained Sentence Transformer model
model = StaticModel.from_pretrained("cnmoro/custom-model2vec-tokenlearn-small")

# Compute text embeddings
embeddings = model.encode(["Example sentence"])
```