GGML_ASSERT(sections.v[0] > 0 || sections.v[1] > 0 || sections.v[2] > 0) failed
#2
by
tgiovs
- opened
I get with this model the error:
GGML_ASSERT(sections.v[0] > 0 || sections.v[1] > 0 || sections.v[2] > 0) failed
ollama config is like this:
body = {
model: MODEL_NAME,
prompt: prompt,
images: [image_base64],
stream: false,
options: {
repeat_penalty: 1.05,
temperature: 0.0,
top_p: 1.0,
min_p: 0.0,
top_k: -1, # -1 means no top-k sampling
n_predict: 15000, # Add n_predict to control max tokens
num_ctx: 24000 # Set context window size
}
}
Not really sure why/where it breaks.