This repo contains example notebooks and accompanying documentation for using Fiddler.

Examples

The goal of these example notebooks is to give you a quick start on various Fiddler capabilities, using different model frameworks and data types. You can also use these as a reference guide to upload your dataset and model along with production traffic that you want to monitor or explain using Fiddler.

To get started

Use the projects in this repo to onboard models and data to illustrate model monitoring and explainability.
This repo contains the projects listed below. You can launch them in a Google Collab environment right from here:

The Basics

1. Model Monitoring Quickstart with Sample Data
2. LLM/GenAI Monitoring Quickstart with Sample Data
3. Managing Model Versions with Fiddler
4. XAI with Surrogate Models
5. Adding Model Artifacts for XAI

Use Case Specific

1. Image/Computer Vision Model Monitoring
2. NLP Model Monitoring - Binary Classification
3. NLP Model Monitoring - Multiclass Classification
4. NLP Model Monitoring with OpenAI Embeddings
5. Class Imbalance Drift Detection
6. Ranking Model - Monitoring and Explainability

License

This project is licensed under the MIT license. See the LICENSE file for more info.

Want to learn more?

Here are some links that you will find useful:

• Documentation
• Fiddler Slack