llama.cpp <s> warning

#5
by NoGuyFast - opened

I use mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf with llama.cpp

but if I use the promptformat mentioned in the model card:
<s>[SYSTEM_PROMPT]{system_prompt}[/SYSTEM_PROMPT][INST]{prompt}[/INST]

I get this warning:
RuntimeWarning: Detected duplicate leading "<s>" in prompt, this will likely reduce response quality

if I use [SYSTEM_PROMPT]{system_prompt}[/SYSTEM_PROMPT][INST]{prompt}[/INST] instead, will the model use my system_prompt without issues?

Sign up or log in to comment