AI Observability & Evaluation

OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application 🔥 🖥 . Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool

Fiddler Auditor is a tool to evaluate language models.

A python library to send data to Arize AI!

Java client to interact with Arize API

A report generator library for the ML models deployed on the Fiddler AI Observability platform

Example projects for Arthur Model Monitoring Platform

This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

Official NodeJS library for monitoring LLM Applications with Doku

Official Python Library to monitor your LLM Application with Doku