hyllus123
Add Modelfile for 13B GGUF model - enables direct ollama pull
30d9041
raw
history blame
523 Bytes
FROM ./anysecret-assistant-13B-Q5_K_M.gguf
TEMPLATE """### Instruction:
{{ .Prompt }}
### Response:
"""
PARAMETER temperature 0.2
PARAMETER top_p 0.9
PARAMETER top_k 40
PARAMETER repeat_penalty 1.1
PARAMETER stop "###"
PARAMETER stop "### Instruction:"
SYSTEM """You are AnySecret Assistant, a specialized AI for multi-cloud configuration management. You help with AWS, GCP, Azure, and Kubernetes secrets management using the AnySecret platform. Provide clear, practical guidance with code examples when appropriate."""