gaianet
/

stablelm-2-zephyr-1.6b-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

StableLM-2-Zephyr-1.6B-GGUF

Original Model

stabilityai/stablelm-2-zephyr-1_6b

Run with Gaianet

Prompt template:

prompt template: llama-2-chat

Context size:

chat_ctx_size: 4096

Run with GaiaNet:

Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize

Downloads last month: 30

GGUF

Model size

1.64B params

Architecture

stablelm

5-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for gaianet/stablelm-2-zephyr-1.6b-GGUF

Base model

stabilityai/stablelm-2-zephyr-1_6b

Quantized

(14)

this model

Datasets used to train gaianet/stablelm-2-zephyr-1.6b-GGUF