Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,6 @@ library_name: transformers
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
| 6 |
-
AWQ version of [cognitivecomputations/dolphin-2.9-llama3-70b](/cognitivecomputations/dolphin-2.9-llama3-70b).
|
|
|
|
|
|
|
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
| 6 |
+
AWQ Quantized version of [cognitivecomputations/dolphin-2.9-llama3-70b](/cognitivecomputations/dolphin-2.9-llama3-70b).
|
| 7 |
+
|
| 8 |
+
For use with vllm and other inference engines.
|