Text Generation
Russian
conversational
saiga_13b_ggml / README.md
IlyaGusev's picture
Update README.md
8a2eb76
|
raw
history blame
674 Bytes
metadata
datasets:
  - IlyaGusev/ru_turbo_alpaca
  - IlyaGusev/ru_turbo_saiga
  - IlyaGusev/ru_sharegpt_cleaned
language:
  - ru
inference: false
pipeline_tag: text2text-generation

Llama.cpp compatible versions of an original 13B model.

How to run:

sudo apt-get install git-lfs
pip install llama-cpp-python fire

python3 interact_llamacpp.py ggml-model-q4_1.bin

System requirements:

  • 18GB RAM for q8_0
  • 13GB RAM for q4_1