Hugging Face's logo
Youngjoon Jang's picture
10 3 21

Youngjoon Jang

yjoonjang
dragonkue's profile picture CocoRoF's profile picture maywell's profile picture
Ā·

AI & ML interests

None yet

Recent Activity

reacted to tomaarsen's post with šŸ”„ 6 days ago
I just released Sentence Transformers v4.1; featuring ONNX and OpenVINO backends for rerankers offering 2-3x speedups and improved hard negatives mining which helps prepare stronger training datasets. Details: šŸŽļø ONNX, OpenVINO, Optimization, Quantization - I've added ONNX and OpenVINO support with just one extra argument: "backend" when loading the CrossEncoder reranker, e.g.: `CrossEncoder("cross-encoder/ms-marco-MiniLM-L6-v2", backend="onnx")` - The `export_optimized_onnx_model`, `export_dynamic_quantized_onnx_model`, and `export_static_quantized_openvino_model` functions now work with CrossEncoder rerankers, allowing you to optimize (e.g. fusions, gelu approximations, etc.) or quantize (int8 weights) rerankers. - I've uploaded ~340 ONNX & OpenVINO models for all existing models under the cross-encoder Hugging Face organization. You can use these without having to export when loading. ā› Improved Hard Negatives Mining - Added 'absolute_margin' and 'relative_margin' arguments to `mine_hard_negatives`. - `absolute_margin` ensures that `sim(query, negative) < sim(query, positive) - absolute_margin`, i.e. an absolute margin between the negative & positive similarities. - `relative_margin` ensures that `sim(query, negative) < sim(query, positive) * (1 - relative_margin)`, i.e. a relative margin between the negative & positive similarities. - Inspired by the excellent NV-Retriever paper from NVIDIA. And several other small improvements. Check out the full release notes here: https://github.com/UKPLab/sentence-transformers/releases/tag/v4.1.0 With this release, I introduce near-feature parity between the SentenceTransformer embedding & CrossEncoder reranker models, which I've wanted to do for quite some time! With rerankers very strongly supported now, it's time to look forward to other useful architectures!
upvoted a paper 6 days ago
MIEB: Massive Image Embedding Benchmark
published a model 12 days ago
yjoonjang/preranker-v1
View all activity

Organizations

NLP & AI - Korea University's profile picture ģøģŠ¤ķŠøėŸ­ķŠø.ķ•œźµ­'s profile picture Human-Inspired AI Research's profile picture Human-Inspired AI Research & On The IT Contract Research Center's profile picture Uracle-KULLM's profile picture