gguf.part1of2 vs 00001-of-00002.gguf

#1
by DontPlanToEnd - opened

Is there a reason to make gguf.part1of2 type splits instead of 00001-of-00002.gguf? The 00001-of-00002 ones are nice since you don't have to wait a while for the parts to merge.

We don't like multi-part GGUFs. They require a tool and a full copy of all data to be split and merged. split-GGUFs can be created and merged without copying any data on a supported file system like BTRFS within a second. Having non-merged files locally is a pain as you cannot easily soft link them to your model’s folder. It's also worth considering that HuggingFace acquired XetHub last summer and once they move away grom Git LFS the 50 GB file limit will be lifted.

For more information read the FAQ under https://huggingface.co/mradermacher/model_requests

mradermacher changed discussion status to closed

Sign up or log in to comment