Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: PlaygroundV2 #535

Open
2 of 7 tasks
axel7083 opened this issue Mar 14, 2024 · 0 comments
Open
2 of 7 tasks

feat: PlaygroundV2 #535

axel7083 opened this issue Mar 14, 2024 · 0 comments
Labels
area/playground kind/epic Issue describing an epic

Comments

@axel7083
Copy link
Contributor

axel7083 commented Mar 14, 2024

With the InferenceManager the playground do not need to handle all the container lifecycle, nor the events it can occurs. It can simply get the InfernceServers available, check if healthy, get the port, and make request on it.

The UI should be responsible of creating/start an inference server if there is none running/stopped.

We have two concept, the Conversation and Playground.

Conversation

We want a dedicated page for the conversation history accessible from the navigation bar. The conversation (post 0.3) should persistent, they need to be stored locally.

One conversation is holding several messages, model options used, timestamps, (etc?.)

  • Designing a Conversation interface
  • Creating a ConversationManager
  • Creating a Conversation store for the frontend
  • Creating a conversation history page

Playground

The playground should be simple, (almost stateless), when submitting a message it should take as argument conversation id, user input and model options (E.g. modeId, temperature...).

cc @jeffmaury @feloy

@axel7083 axel7083 added kind/epic Issue describing an epic area/playground labels Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/playground kind/epic Issue describing an epic
Projects
None yet
Development

No branches or pull requests

1 participant