AWQ Version

#2
by devops724 - opened

Hi, all qwen models have offcial AWQ version
but i can't find VL-32B AWQ version

RuntimeError: Error(s) in loading state_dict for Linear:
size mismatch for bias: copying a param with shape torch.Size([5120]) from checkpoint, the shape in current model is torch.Size([1280])

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment