From a4b26f78b6fa39c2f57db746747ac462bf164fbf Mon Sep 17 00:00:00 2001 From: Jeff MAURY Date: Mon, 25 Mar 2024 10:30:05 +0100 Subject: [PATCH] fix: enhance dashboard with model serving Fixes #652 Signed-off-by: Jeff MAURY --- packages/frontend/src/pages/dashboard.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/packages/frontend/src/pages/dashboard.md b/packages/frontend/src/pages/dashboard.md index 56c5d6e8f..2d6cf7d51 100644 --- a/packages/frontend/src/pages/dashboard.md +++ b/packages/frontend/src/pages/dashboard.md @@ -10,6 +10,10 @@ AI Studio ships with a so-called Recipes Catalog that helps you navigate a numbe AI Studio provides a curated list of open source AI models and LLMs. Once downloaded, the models are available to be used for AI applications, model services and playgrounds. +## Model serving + +Once a model has been downloaded, users can start an inference server for the model. This allow to test the model using a playground environment or to connect applications as the inference server is exposing a well know chat API. + ## Playgrounds The integrated Playground environments allow for experimenting with available models in a local environment. An intuitive user prompt helps in exploring the capabilities and accuracy of various models and aids in finding the best model for the use case at hand.