Upload README.md
Browse files
README.md
CHANGED
@@ -64,14 +64,6 @@ Here is an incomplate list of clients and libraries that are known to support GG
|
|
64 |
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
65 |
|
66 |
<!-- README_GGUF.md-about-gguf end -->
|
67 |
-
<!-- repositories-available start -->
|
68 |
-
## Repositories available
|
69 |
-
|
70 |
-
* [AWQ model(s) for GPU inference.](https://huggingface.co/ekchatzi-core/Mythalion-13B-AWQ)
|
71 |
-
* [GPTQ models for GPU inference, with multiple quantisation parameter options.](https://huggingface.co/ekchatzi-core/Mythalion-13B-GPTQ)
|
72 |
-
* [2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference](https://huggingface.co/ekchatzi-core/Mythalion-13B-GGUF)
|
73 |
-
* [PygmalionAI's original unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/PygmalionAI/mythalion-13b)
|
74 |
-
<!-- repositories-available end -->
|
75 |
|
76 |
<!-- prompt-template start -->
|
77 |
## Prompt template: Alpaca
|
|
|
64 |
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
65 |
|
66 |
<!-- README_GGUF.md-about-gguf end -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
67 |
|
68 |
<!-- prompt-template start -->
|
69 |
## Prompt template: Alpaca
|