GGUF models not working
#1
by
Jehex
- opened
Trying both models from theses repo :
https://huggingface.co/calcuis/hidream-gguf/tree/main
https://huggingface.co/city96/HiDream-I1-Dev-gguf/tree/main
and getting errors ( even with the fp8 versions )
While copying the parameter named "double_stream_blocks.0.block.ff_i.gate.weight", whose dimensions in the model are torch.Size([4, 2560]) and whose dimensions in the checkpoint are torch.Size([4, 2720]), an exception occurred : ('The size of tensor a (2560) must match the size of tensor b (2720) at non-singleton dimension 1',).
and
mat1 and mat2 shapes cannot be multiplied (2x768 and 2048x2560)
any solutions ?