tensorblock
/

Ryu-4x7B-MoE-bf16-GGUF

Mixture of Experts

Model card Files Files and versions

Ryu-4x7B-MoE-bf16-GGUF

181 GB

1 contributor

History: 5 commits

morriszms's picture

Update README.md

38b979d verified 3 months ago

.gitattributes

2.3 kB

Upload folder using huggingface_hub 9 months ago
README.md

6.51 kB

Update README.md 3 months ago
Ryu-4x7B-MoE-bf16-Q2_K.gguf

8.84 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q3_K_L.gguf

12.5 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q3_K_M.gguf

11.6 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q3_K_S.gguf

10.4 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q4_0.gguf

13.6 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q4_K_M.gguf

14.6 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q4_K_S.gguf

13.7 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q5_0.gguf

16.6 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q5_K_M.gguf

17.1 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q5_K_S.gguf

16.6 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q6_K.gguf

19.8 GB
xet

Upload folder using huggingface_hub 9 months ago
Ryu-4x7B-MoE-bf16-Q8_0.gguf

25.7 GB
xet

Upload folder using huggingface_hub 9 months ago