Apply for community grant: Academic project (gpu)

#1
by sst12345 - opened

CoRe^2: Collect, Reflect and Refine to Generate Better and Faster.

In this paper, we introduce a novel plug-and-play inference paradigm, CoRe^2, which comprises three subprocesses: Collect, Reflect, and Refine. CoRe^2 first collects classifier-free guidance (CFG) trajectories, and then use collected data to train a weak model that reflects the easy-to-learn contents while reducing number of function evaluations during inference by half. Subsequently, CoRe^2 employs weak-to-strong guidance to refine the conditional output, thereby improving the model's capacity to generate high-frequency and realistic content, which is difficult for the base model to capture. To the best of our knowledge, CoRe^2 is the first to demonstrate both efficiency and effectiveness across a wide range of DMs, including SDXL, SD3.5, and FLUX, as well as ARMs like LlamaGen. It has exhibited significant performance improvements on HPD v2, Pick-of-Pic, Drawbench, GenEval, and T2I-Compbench.

However, deploying SD3.5 with ZeroGPU in spaces encounters a timeout error, which I'm guessing may be a result of insufficient video memory to get it to run for more than 60s.

Hi @sst12345 , you can specify the duration parameter to increase the timeout. You can find more info in https://huggingface.co/zero-gpu-explorers.

Thanks for your suggestions! I have fixed this bug!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment