some weights not initialized problem with transformers library.

#13
by robotrule - opened

Some weights of Qwen2_5_VLForConditionalGeneration were not initialized from the model checkpoint at Qwen/Qwen2.5-VL-32B-Instruct-AWQ and are newly initialized: ['lm_head.qweight', 'lm_head.qzeros', 'lm_head.scales']

Hi! Did you manage to solve this?

Maybe a transformers version problem, I'm using 4.50.0 now.

Please solve this problem asap

我也遇到了这个问题,据我观测,似乎是transformers的版本和autoawq的版本冲突的原因,问题目前仍然没被解决。

Sign up or log in to comment