GGUF
qwen3
apepkuss79's picture
Update README.md
758dbd8 verified
metadata
base_model: osmosis-ai/Osmosis-Structure-0.6B
license: apache-2.0
model_creator: osmosis-ai
model_name: Osmosis-Structure-0.6B
quantized_by: Second State Inc.

Osmosis-Structure-0.6B-GGUF

Original Model

osmosis-ai/Osmosis-Structure-0.6B

Run with Gaianet

Prompt template:

prompt template: chatml

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quantized with llama.cpp b5501