Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,15 @@ tags:
|
|
| 10 |
---
|
| 11 |
# ANEMLL
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
**ANEMLL** (pronounced like "animal") is an open-source project focused on accelerating the porting of Large Language Models (LLMs) to tensor processors, starting with the Apple Neural Engine (ANE).
|
| 14 |
|
| 15 |
The goal is to provide a fully open-source pipeline from model conversion to inference for common LLM architectures running on ANE.
|
|
|
|
| 10 |
---
|
| 11 |
# ANEMLL
|
| 12 |
|
| 13 |
+
PREFILL test for M3 Ultra
|
| 14 |
+
after unzipping (please see below)
|
| 15 |
+
run
|
| 16 |
+
python prefill.py --meta meta.yaml
|
| 17 |
+
|
| 18 |
+
For M3U/M4P see original post:
|
| 19 |
+
https://x.com/anemll/status/1919796143787278623
|
| 20 |
+
|
| 21 |
+
|
| 22 |
**ANEMLL** (pronounced like "animal") is an open-source project focused on accelerating the porting of Large Language Models (LLMs) to tensor processors, starting with the Apple Neural Engine (ANE).
|
| 23 |
|
| 24 |
The goal is to provide a fully open-source pipeline from model conversion to inference for common LLM architectures running on ANE.
|