-
Notifications
You must be signed in to change notification settings - Fork 11.9k
Feature Request: server default system prompt support like -spf in old version support gemma2 #10520
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
give an example of several scenarios I want to implement. Let's assume the startup prompt is 'a', the user system prompt is 'b', and the user prompt is 'c'. |
I'm not sure what you mean by "startup prompt". Models today only have "system prompt" which is optionally the first message in the chat. Thanks to the prompt caching functionality, the system prompt is always reused automatically. |
maybe like this or <|im_start|>system |
This issue was closed because it has been inactive for 14 days since being marked as stale. |
Uh oh!
There was an error while loading. Please reload this page.
Prerequisites
Feature Description
It seems that -p --prompt is not working.
need -spf system prompt file in llama-server,but it has removed。
#9811
We can probably think about reintroducing the option and use the CLI system prompt as default value for the chat template system prompt when it is not passed by the client.
Motivation
default system prompt make model behave better
Possible Implementation
like -spf in old version
The text was updated successfully, but these errors were encountered: