Tolga Cangöz's picture

Tolga Cangöz

tolgacangoz

·

standard_ai

AI & ML interests

AIGC

Recent Activity

liked a model about 11 hours ago

diffusers/Wan2.1-VAE

reacted to tomaarsen's post with ❤️ about 11 hours ago

An assembly of 18 European companies, labs, and universities have banded together to launch 🇪🇺 EuroBERT! It's a state-of-the-art multilingual encoder for 15 European languages, designed to be finetuned for retrieval, classification, etc. 🇪🇺 15 Languages: English, French, German, Spanish, Chinese, Italian, Russian, Polish, Portuguese, Japanese, Vietnamese, Dutch, Arabic, Turkish, Hindi 3️⃣ 3 model sizes: 210M, 610M, and 2.1B parameters - very very useful sizes in my opinion ➡️ Sequence length of 8192 tokens! Nice to see these higher sequence lengths for encoders becoming more common. ⚙️ Architecture based on Llama, but with bi-directional (non-causal) attention to turn it into an encoder. Flash Attention 2 is supported. 🔥 A new Pareto frontier (stronger *and* smaller) for multilingual encoder models 📊 Evaluated against mDeBERTa, mGTE, XLM-RoBERTa for Retrieval, Classification, and Regression (after finetuning for each task separately): EuroBERT punches way above its weight. 📝 Detailed paper with all details, incl. data: FineWeb for English and CulturaX for multilingual data, The Stack v2 and Proof-Pile-2 for code. Check out the release blogpost here: https://huggingface.co/blog/EuroBERT/release * https://huggingface.co/EuroBERT/EuroBERT-210m * https://huggingface.co/EuroBERT/EuroBERT-610m * https://huggingface.co/EuroBERT/EuroBERT-2.1B The next step is for researchers to build upon the 3 EuroBERT base models and publish strong retrieval, zero-shot classification, etc. models for all to use. I'm very much looking forward to it!

upvoted an article 1 day ago

What changed in the Transformer architecture

View all activity

Organizations

tolgacangoz's activity

upvoted an article 1 day ago

Article

What changed in the Transformer architecture

By

•

3 days ago

• 12

upvoted a collection 6 days ago

Shot categorizer

Fine-tune of Florence-2 to generate shot categories, useful for data curation. Code: https://github.com/huggingface/movie-shot-categorizer. • 3 items • Updated 6 days ago • 2

upvoted an article 9 days ago

Article

You could have designed state of the art positional encoding

Nov 25, 2024

• 180

upvoted a collection 9 days ago

video-effects datasets

Smol datasets to emulate cool video effects like "squish", "dissolve", etc. Inspired by Pika effects. • 4 items • Updated Jan 28 • 2

upvoted a paper 10 days ago

Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget

Paper • 2407.15811 • Published Jul 22, 2024 • 2

upvoted a collection 11 days ago

AI Tools for Art - Feb '25

Tools & models from the 2nd issue of AI Tools for Art 🎉 Read more about February's releases: https://open.substack.com/pub/multimodalaiart • 18 items • Updated 11 days ago • 1

upvoted a paper 12 days ago

Towards an AI co-scientist

Paper • 2502.18864 • Published 14 days ago • 41

upvoted a collection 14 days ago

Remote VAE Inference Endpoints

Models and handler code used in https://huggingface.co/blog/remote_vae • 5 items • Updated 1 day ago • 4

upvoted a paper 15 days ago

AnyText2: Visual Text Generation and Editing With Customizable Attributes

Paper • 2411.15245 • Published Nov 22, 2024 • 1

upvoted an article 16 days ago

Article

Remote VAEs for decoding with HF endpoints 🤗

16 days ago

• 34

upvoted a paper 16 days ago

KernelBench: Can LLMs Write Efficient GPU Kernels?

Paper • 2502.10517 • Published 25 days ago • 2

upvoted a collection 17 days ago

SigLIP 2

OpenCLIP and timm SigLIP 2 models • 45 items • Updated 18 days ago • 11

upvoted a paper 18 days ago

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

Paper • 2502.14786 • Published 19 days ago • 128

upvoted a paper 22 days ago

Region-Adaptive Sampling for Diffusion Transformers

Paper • 2502.10389 • Published 25 days ago • 52

upvoted a paper 23 days ago

Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps

Paper • 2501.09732 • Published Jan 16 • 70

upvoted a collection 27 days ago

DeepSeek-R1

8 items • Updated Jan 21 • 568

upvoted an article 28 days ago

Article

Build awesome datasets for video generation

28 days ago

• 26

upvoted a paper 29 days ago

Matryoshka Quantization

Paper • 2502.06786 • Published 29 days ago • 29

upvoted a collection about 1 month ago

video-effects

Fine-tunes of open video generation models like CogVideoX to emulate cool video effects like "squish", "dissolve", "cakeify", etc. Pika inspired. • 8 items • Updated 3 days ago • 5

upvoted a paper about 1 month ago

DynVFX: Augmenting Real Videos with Dynamic Content

Paper • 2502.03621 • Published Feb 5 • 29