dns brl's picture

5 2 7

dns brl

dnsbrl

·

AI & ML interests

None yet

Recent Activity

reacted to piercus's post with 👀 5 days ago

🚧 Reproducing LBM-Eraser… in progress! [1] When repurposing a T2I model into a pure I2I model, there’s always that orphaned text path — what do we do with it? 🤔 You can reuse it as learnable embeddings in multi-task setups [2], freeze an empty text prompt, distillate or prune the corresponding part. In LBM, they take a clever route — zeroing [3] and reshaping [4] the text-related cross-attentions into self-attentions. This gives you fresh weights for I2I computation, nicely integrated into your SD architecture. 📎 References [1] Our LBM Fork: https://github.com/finegrain-ai/LBM [2] OmniPaint: https://huggingface.co/papers/2503.08677 [3] LBM Zeroing: https://github.com/gojasper/LBM/blob/cafebc46a9ac16dcc61691d289cc4676b5c75380/examples/training/train_lbm_surface.py#L147-L148 [4] LBM Reshaping: https://github.com/gojasper/LBM/blob/cafebc46a9ac16dcc61691d289cc4676b5c75380/examples/training/train_lbm_surface.py#L100

reacted to piercus's post with 👍 18 days ago

We've just forked LBM to reproduce the LBM eraser results Our fork : https://github.com/finegrain-ai/LBM LBM paper: https://huggingface.co/papers/2503.07535 LBM relighting demo : https://huggingface.co/spaces/jasperai/LBM_relighting

upvoted an article about 1 month ago

Model Quality: Hugging Face Is All You Need

View all activity

Organizations

dnsbrl 's collections 1