TWIML-RAG - a TWIML generative_ai community project.

This project aims to create a generative AI dialog application as a learning exercise for our community. The application will consist of a transcription pipeline to transcribe TWIML podcast episodes for human and bot consumption, and the dialog agent/bot itself, which will be available to our community to answer questions about the podcast and its subject area. Both of these aim to offer additional resource for podcast listeners and community members to further their learning and education about ML/AI.

Transcriber

proj/transcriber

Chatbot

rag

flowchart TB
  subgraph TWIML Podcast RAG
    subgraph Transcription Pipeline
        direction LR
        A[Podcast Audio File - mp3 fa:fa-file-audio] --> B["AUDIO-TO-TEXT
        - WhisperX -"]
        A --> C["SPEAKER IDENTIFICATION
        - pyannote.audio -"]
        G[Shownotes] --> H[METADATA]
        I[Web Crawls] --> H
        H --> D
        B --> D[FUSION]
        C --> D
        D --> E[(fa:fa-file Transcription Data Files)]
        E --> F[Pinecone Index]
    end
    subgraph "Chatbot using Augmented Generation"
        direction LR
            P[QUERY] ---> Q[RETRIEVER]
            Q ---> R[GENERATOR]
            Q <-- augmentation --> F
    end
  end