Spaces:
Running
on
Zero
Apply for community grant: Academic project (gpu)
Title: ID-Patch: Robust ID Association for Group Photo Personalization
Project Page: https://byteaigc.github.io/ID-Patch/
GitHub: https://github.com/bytedance/ID-Patch
Model: https://huggingface.co/ByteDance/ID-Patch
Our paper has been accepted to CVPR 2025.
Abstract: The ability to synthesize personalized group photos and specify the positions of each identity offers immense creative potential. While such imagery can be visually appealing, it presents significant challenges for existing technologies. A persistent issue is identity (ID) leakage, where injected facial features interfere with one another, resulting in low face resemblance, incorrect positioning, and visual artifacts. Existing methods suffer from limitations such as the reliance on segmentation models, increased runtime, or a high probability of ID leakage. To address these challenges, we propose ID-Patch, a novel method that provides robust association between identities and 2D positions. Our approach generates an ID patch and ID embeddings from the same facial features: the ID patch is positioned on the conditional image for precise spatial control, while the ID embeddings integrate with text embeddings to ensure high resemblance. Experimental results demonstrate that ID-Patch surpasses baseline methods across metrics, such as face ID resemblance, ID-position association accuracy, and generation efficiency.
Hi @tzhi-bytedance , we've assigned ZeroGPU to this Space. Please check the compatibility and usage sections of this page so your Space can run on ZeroGPU.