Train 400x faster Static Embedding Models with Sentence Transformers
•
98
Yes, the implementation is just https://pytorch.org/docs/stable/generated/torch.nn.EmbeddingBag.html. In short: token -> token embedding via lookup -> text embedding via mean pooling (averaging per dimension).
NanoBEIR