How to use consolidated.xx.pt?

#47
by Wan62 - opened

It seems that transformer can only load from safetensor files, is that like the standard models now for LLM? pt and pth are abandoned?

Yes it is the recommended way to load models. The consolidated files are the original checkpoints (used by VLLM)

Sign up or log in to comment