Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to modify the system prompt after the playground interactions started #618

Open
slemeur opened this issue Mar 21, 2024 · 1 comment
Assignees
Milestone

Comments

@slemeur
Copy link
Contributor

slemeur commented Mar 21, 2024

After #617, the user will not be able to modify the system prompt, once the playground interactions started.

In this issue, we would to better handle the situation and let the user modify it, but also understand the impact of that change.
In order to allow the comparison of the behavior of the model with a different system prompt, the user should still be able to see the previous interactions (and eventually continue testing with more interactions, with the different system prompts).

Proposal:
When the user changes the system prompt after having started interacting, we should bring the user into a new playground environment with the new system prompt.

We would display a message asking the user what the desired "re-play" stated is.
Two options to be proposed to the end-user:

  • Does the user wants to replay all the messages sent?
  • Or does the user prefer to start from scratch?
@slemeur slemeur added this to the 1.1 milestone Mar 21, 2024
@axel7083
Copy link
Contributor

I would argue that re-playing all the conversation does not really make sense, I would propose that only the first message of the user would be replay, as the responses following it depends on the conversation, which do not have the same history after changing the system prompt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 📅 Planned
Development

No branches or pull requests

3 participants