New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scenario based sample evaluation #526

Open

Lep06fg opened this issue May 2, 2024 · 0 comments

Assignees

Labels

Sprint 2

Collaborator

Lep06fg commented May 2, 2024 •

edited by joanassantos

Scenario: RAG-based knowledge chat

Prepare a Python notebook containing sample data generated by running the accelerator. This notebook should demonstrate how to utilize the obtained metrics, generate histograms, and draw interpretations from the results.
[optional] Develop a Readme file offering guidance on selecting metrics for the scenario, interpreting these metrics, and suggesting potential actions to enhance Copilot.

Repo location: https://github.com/microsoft/rag-experiment-accelerator/tree/development/docs/scenarios

Lep06fg added the Sprint 2 label

kcortinas assigned kcortinas and joanassantos

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment