Split files need to be merged:
Windows:
copy /B MoMo-70B-lora-1.8.6-DPO-q5_k_m.gguf-split-* MoMo-70B-lora-1.8.6-DPO-q5_k_m.gguf
copy /B MoMo-70B-lora-1.8.6-DPO-q6_k.gguf-split-* MoMo-70B-lora-1.8.6-DPO-q6_k.gguf
Linux/Mac:
cat MoMo-70B-lora-1.8.6-DPO-q5_k_m.gguf-split-* > MoMo-70B-lora-1.8.6-DPO-q5_k_m.gguf
cat MoMo-70B-lora-1.8.6-DPO-q6_k.gguf-split-* > MoMo-70B-lora-1.8.6-DPO-q6_k.gguf
- Downloads last month
- 6
Hardware compatibility
Log In
to view the estimation
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.