You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I observe that the inference script contains an embedded system prompt. Is it also included in training? I wonder how much the performance will be affected if changing the system prompt.
The text was updated successfully, but these errors were encountered:
I observe that the inference script contains an embedded system prompt. Is it also included in training? I wonder how much the performance will be affected if changing the system prompt.
Embedding system prompts is a common practice that many models would use. However, we didn't use this method since we wanted to make the model more "customizable" with the system prompt. We find system prompts could exert a considerable impact on performance, especially when it comes to details.
I observe that the inference script contains an embedded system prompt. Is it also included in training? I wonder how much the performance will be affected if changing the system prompt.
The text was updated successfully, but these errors were encountered: