| base_model: 01-ai/Yi-1.5-9B-Chat-16K | |
| inference: false | |
| model_creator: 01-ai | |
| model_name: Yi-1.5-9B-Chat-16 | |
| model_type: yi | |
| pipeline_tag: text-generation | |
| quantized_by: Second State Inc. | |
| license: apache-2.0 | |
|  | |
| # Yi-1.5-9B-Chat-16K-GGUF | |
| ## Original Model | |
| [01-ai/Yi-1.5-9B-Chat-16K](https://huggingface.co/01-ai/Yi-1.5-9B-Chat-16K) | |
| ## Run with Gaianet | |
| **Prompt template** | |
| prompt template: `chatml` | |
| **Reverse prompt** | |
| reverse prompt: `<|im_end|>` | |
| **Context size** | |
| chat_ctx_size: `16384` | |
| **Run with GaiaNet** | |
| - Quick start: https://docs.gaianet.ai/node-guide/quick-start | |
| - Customize your node: https://docs.gaianet.ai/node-guide/customize | |
| *Quantized with llama.cpp b3135* | |