Question: ragas built-in visualization of results (e.g. HTML exports)?

[jamesbraza]

[x] I checked the documentation and related resources and couldn't find an answer to my question.

Your Question

Let's say I want to evaluate an LLM on a question-answer dataset. Is there like a front end (e.g. HTML exports) for evaluations run with Ragas?

I want to visualize my evaluation dataset:

• Table of question, expected answer, generated answer, pass/fail
• Overall summary metrics like recall, precision, accuracy, F1 score, etc.

Code Examples

N/a

Additional context

Looking for something like https://github.com/promptfoo/promptfoo, but for ragas.

[jjmachan]

Hey @jamesbraza - great to see you again 🙂

you have 2 options

1. if you use any tracing tools - we could use that
2. pandas and matplotlib or streamlit if your local. Actually having a small streamlit app might be interesting

what do you think?

[jamesbraza]

Hello! Yeah thanks for the response and hope all is well.

if you use any tracing tools - we could use that

When you say tracing tools, do you mean something like LangChain's BaseTracer or LangSmith?

pandas and matplotlib or streamlit if your local. Actually having a small streamlit app might be interesting

I was hoping for something built into Ragas, I am trying to avoid building my own front end for evaluation visualization