You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With the InferenceManager the playground do not need to handle all the container lifecycle, nor the events it can occurs. It can simply get the InfernceServers available, check if healthy, get the port, and make request on it.
The UI should be responsible of creating/start an inference server if there is none running/stopped.
We have two concept, the Conversation and Playground.
Conversation
We want a dedicated page for the conversation history accessible from the navigation bar. The conversation (post 0.3) should persistent, they need to be stored locally.
One conversation is holding several messages, model options used, timestamps, (etc?.)
Designing a Conversation interface
Creating a ConversationManager
Creating a Conversation store for the frontend
Creating a conversation history page
Playground
The playground should be simple, (almost stateless), when submitting a message it should take as argument conversation id, user input and model options (E.g. modeId, temperature...).
With the
InferenceManager
the playground do not need to handle all the container lifecycle, nor the events it can occurs. It can simply get the InfernceServers available, check if healthy, get the port, and make request on it.The UI should be responsible of creating/start an inference server if there is none running/stopped.
We have two concept, the
Conversation
andPlayground
.Conversation
We want a dedicated page for the conversation history accessible from the navigation bar. The conversation (post 0.3) should persistent, they need to be stored locally.
One conversation is holding several messages, model options used, timestamps, (etc?.)
ConversationManager
Playground
The playground should be simple, (almost stateless), when submitting a message it should take as argument conversation id, user input and model options (E.g. modeId, temperature...).
PlaygroundManager
should be only responsible of the playground requests #509cc @jeffmaury @feloy
The text was updated successfully, but these errors were encountered: