llama.cpp <s> warning
#5
by
NoGuyFast
- opened
I use mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf with llama.cpp
but if I use the promptformat mentioned in the model card:
<s>[SYSTEM_PROMPT]{system_prompt}[/SYSTEM_PROMPT][INST]{prompt}[/INST]
I get this warning:
RuntimeWarning: Detected duplicate leading "<s>" in prompt, this will likely reduce response quality
if I use [SYSTEM_PROMPT]{system_prompt}[/SYSTEM_PROMPT][INST]{prompt}[/INST] instead, will the model use my system_prompt without issues?