beezu
/

Anubis-Pro-105B-v1-MLX-6Bit

Model card Files Files and versions Community

beezu commited on Feb 5

Commit

7b2d8a0

·

verified ·

1 Parent(s): 6c3d46c

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -5,9 +5,9 @@ tags:
 base_model: TheDrummer/Anubis-Pro-105B-v1
 ---
-# beezu/Anubis-Pro-105B-v1-Q6-mlx
-The Model [beezu/Anubis-Pro-105B-v1-Q6-mlx](https://huggingface.co/beezu/Anubis-Pro-105B-v1-Q6-mlx) was converted to MLX format from [TheDrummer/Anubis-Pro-105B-v1](https://huggingface.co/TheDrummer/Anubis-Pro-105B-v1) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -18,7 +18,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("beezu/Anubis-Pro-105B-v1-Q6-mlx")
 prompt="hello"

 base_model: TheDrummer/Anubis-Pro-105B-v1
 ---
+# beezu/Anubis-Pro-105B-v1-MLX-6Bit
+The Model [beezu/Anubis-Pro-105B-v1-MLX-6Bit](https://huggingface.co/beezu/Anubis-Pro-105B-v1-MLX-6Bit) was converted to MLX format from [TheDrummer/Anubis-Pro-105B-v1](https://huggingface.co/TheDrummer/Anubis-Pro-105B-v1) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("beezu/Anubis-Pro-105B-v1-MLX-6Bit")
 prompt="hello"