hyllus123 commited on
Commit
30d9041
·
1 Parent(s): 7235249

Add Modelfile for 13B GGUF model - enables direct ollama pull

Browse files
Files changed (1) hide show
  1. 13B-GGUF/Modelfile +16 -0
13B-GGUF/Modelfile ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./anysecret-assistant-13B-Q5_K_M.gguf
2
+
3
+ TEMPLATE """### Instruction:
4
+ {{ .Prompt }}
5
+
6
+ ### Response:
7
+ """
8
+
9
+ PARAMETER temperature 0.2
10
+ PARAMETER top_p 0.9
11
+ PARAMETER top_k 40
12
+ PARAMETER repeat_penalty 1.1
13
+ PARAMETER stop "###"
14
+ PARAMETER stop "### Instruction:"
15
+
16
+ SYSTEM """You are AnySecret Assistant, a specialized AI for multi-cloud configuration management. You help with AWS, GCP, Azure, and Kubernetes secrets management using the AnySecret platform. Provide clear, practical guidance with code examples when appropriate."""