Update README.md
Browse files
README.md
CHANGED
|
@@ -41,10 +41,11 @@ Using a 12GB Nvidia GeForce RTX 3060 I got on average around 20 tokens per secon
|
|
| 41 |
|
| 42 |
There are a couple places you can use an exl2 model, here are a few:
|
| 43 |
|
| 44 |
-
- [oobabooga's Text Gen Webui](https://github.com/oobabooga/text-generation-webui)
|
| 45 |
-
- When using the downloader, make sure to format like this: Anthonyg5005/rishiraj-meow-10.7B-exl2**\:QuantBranch**
|
| 46 |
- [tabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
|
|
|
| 47 |
- [ExUI](https://github.com/turboderp/exui)
|
|
|
|
|
|
|
| 48 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
| 49 |
|
| 50 |
## WARNING
|
|
|
|
| 41 |
|
| 42 |
There are a couple places you can use an exl2 model, here are a few:
|
| 43 |
|
|
|
|
|
|
|
| 44 |
- [tabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
| 45 |
+
- [Aphrodite Engine](https://github.com/PygmalionAI/aphrodite-engine)
|
| 46 |
- [ExUI](https://github.com/turboderp/exui)
|
| 47 |
+
- [oobabooga's Text Gen Webui](https://github.com/oobabooga/text-generation-webui)
|
| 48 |
+
- When using the downloader, make sure to format like this: Anthonyg5005/rishiraj-meow-10.7B-exl2**\:QuantBranch**
|
| 49 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
| 50 |
|
| 51 |
## WARNING
|