IlyaGusev
/

saiga_13b_ggml

IlyaGusev commited on May 22, 2023

Commit

546dfbe

•

2 Parent(s): a404369 8a2eb76

Merge branch 'main' of https://huggingface.co/IlyaGusev/saiga_13b_lora_llamacpp into main

Files changed (1) hide show

README.md CHANGED Viewed

@@ -12,15 +12,16 @@ pipeline_tag: text2text-generation
 Llama.cpp compatible versions of an original [13B model](https://huggingface.co/IlyaGusev/saiga_13b_lora).
 * Download one of the versions, for example `ggml-model-q4_1.bin`.
-* Download [interact_saiga_llamacpp.py]([https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/infer_saiga_llamacpp.py)
 How to run:
 ```
 sudo apt-get install git-lfs
 pip install llama-cpp-python fire
-python3 interact_saiga_llamacpp.py ggml-model-q4_1.bin
 ```
 System requirements:
-* 10GB RAM

 Llama.cpp compatible versions of an original [13B model](https://huggingface.co/IlyaGusev/saiga_13b_lora).
 * Download one of the versions, for example `ggml-model-q4_1.bin`.
+* Download [interact_llamacpp.py](https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/interact_llamacpp.py)
 How to run:
 ```
 sudo apt-get install git-lfs
 pip install llama-cpp-python fire
+python3 interact_llamacpp.py ggml-model-q4_1.bin
 ```
 System requirements:
+* 18GB RAM for q8_0
+* 13GB RAM for q4_1