Does the visual model freeze during the pre training phase

#4
by paul91 - opened

Does the visual model freeze during the pre training phase

Z.ai & THUKEG org

activate

activate

Interpolate the position embedding in ViT and then finetune the whole ViT model without peft.
Is like this?

Sign up or log in to comment