Thermostatic commited on
Commit
f4cb39d
1 Parent(s): 31c18f3

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +12 -0
Modelfile ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ FROM ./Thermostatic/Gemma-2-Mini-NeuralTranslate-2b-v0.2-GGUF/unsloth.BF16.gguf
3
+ TEMPLATE """<start_of_turn>user
4
+ {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}<end_of_turn>
5
+ <start_of_turn>model
6
+ {{ .Response }}<end_of_turn>
7
+ """
8
+ PARAMETER repeat_penalty 1
9
+ PARAMETER stop "<start_of_turn>"
10
+ PARAMETER stop "<end_of_turn>"
11
+ PARAMETER penalize_newline false
12
+ PARAMETER num_ctx 4096