New Pretrained Model

#1
by yumingj - opened
CVPR Demo Track org

Hi @radames ,

I have updated a newly pretrained model of the Text2Human. Could you please update the model here as well?

I have updated the original space: https://huggingface.co/spaces/CVPR/Text2Human

And the newly pretrained model is released here: https://huggingface.co/yumingj/Text2Human_SSHQ

Thanks!

CVPR Demo Track org

Hi @radames , I found that we need to realign the data to make the new model work better. I will upload the realigned segmentation masks later tomorrow and will post the link to the new segmentation masks here.

CVPR Demo Track org

ohh @yumingj , the new model is so much better! I've update the API endpoint to the new model. Another change, my team recommend to move the project to CVPR org as an unofficial demo for your project, to increase visibility. thanks

CVPR Demo Track org

Hi @radames , thanks for your help to update the models!

I have realigned the segmentation masks. Here is the link to the newly aligned masks for your sampled ones: https://drive.google.com/file/d/1enZaB4ZAkRrq6EQtotlgNQ-Z6fvIHX-f/view?usp=sharing

My conclusion is that using the newly aligned masks could have a better performance than the original masks on the new models. Could you please have a look? If it is better, could you please help to replace the masks? If you found it is better to use the original masks, we can then keep the original masks.

Thanks!

CVPR Demo Track org

thanks @yumingj I've updated the samples! they're incredible realistic, so the weird faces was due to the mask misalignment! it also explains why it was so hard to generate starting from a blank canvas, you always have to draw in the expected areas, I'm glad we have the samples to start them. cheers

radames changed discussion status to closed
CVPR Demo Track org

Hi @radames , thanks for your help! I also notice a small bug in this demo. Changing the random seed seems not to work. After generating a human image given a mask and texture conditions, I tried to generate a different person by changing the random seed. However, the generated images don't change. Could you please check if the random seed really works? Thanks!

CVPR Demo Track org

thanks for catching that, fixed it now! but after random new seed you still need to click on generate. thanks

Sign up or log in to comment