Welcome to use Jupyter Notebooks to explore how to build and customize chatbots across a wide range of platforms, including Intel Xeon CPU(ICX and SPR), Intel XPU, Intel Habana Gaudi1/Gaudi2, and Nvidia GPU. Dive into our detailed guide to discover how to develop chatbots on these various computing platforms.
| Chapter | Section | Description | Notebook Link |
|---|---|---|---|
| 1 | Building Chatbots | ||
| 1.1 | Building Chatbot on Intel CPU ICX | Learn how to create chatbot on ICX | Notebook |
| 1.2 | Building Chatbot on Intel CPU SPR | Learn how to create chatbot on SPR | Notebook |
| 1.3 | Building Chatbot on Intel XPU | Learn how to create chatbot on XPU | Notebook |
| 1.4 | Building Chatbot on Habana Gaudi1/Gaudi2 | Learn how to create chatbot on Habana Gaudi1/Gaudi2 | Notebook |
| 1.5 | Building Chatbot on Nvidia A100 | Learn how to create chatbot on Nvidia A100 | Notebook |
| 1.6 | Building Chatbot on Intel CPU Windows PC | Learn how to create chatbot on Windows PC | Notebook |
| 1.7 | Building Chatbot with RAG | Learn how to create chatbot with RAG | Notebook |
| 2 | Deploying Chatbots | ||
| 2.1 | Deploying Chatbot on Intel CPU ICX | Learn how to deploy chatbot on ICX | Notebook |
| 2.2 | Deploying Chatbot on Intel CPU SPR | Learn how to deploy chatbot on SPR | Notebook |
| 2.3 | Deploying Chatbot on Intel XPU | Learn how to deploy chatbot on Intel XPU | Notebook |
| 2.4 | Deploying Chatbot on Habana Gaudi1/Gaudi2 | Learn how to deploy chatbot on Habana Gaudi1/Gaudi2 | Notebook |
| 2.5 | Deploying Chatbot on Nvidia A100 | Learn how to deploy chatbot on A100 | Notebook |
| 2.6 | Deploying Chatbot with Load Balance | Learn how to deploy chatbot with load balance | Notebook |
| 2.7 | Deploying End-to-end text Chatbot on Intel CPU SPR | Learn how to deploy an end to end text chatbot on Intel CPU SPR including frontend GUI and backend | Notebook |
| 2.8 | Deploying End-to-end talkingbot on Intel CPU SPR | Learn how to deploy an end to end talkingbot on Intel CPU SPR including frontend GUI and backend | Notebook |
| 2.9 | Deploying End-to-end text Chatbot witch caching on Intel CPU SPR | Learn how to deploy an end to end text chatbot with plugin on Intel CPU SPR including frontend GUI and backend | Notebook |
| 3 | Optimizing Chatbots | ||
| 3.1 | Enabling Chatbot with BF16 Optimization on SPR | Learn how to optimize chatbot using mixed precision on SPR | Notebook |
| 3.2 | Enabling Chatbot with BF16 Optimization on Habana Gaudi1/Gaudi2 | Learn how to optimize chatbot using mixed precision on Habana Gaudi1/Gaudi2 | Notebook |
| 3.3 | Enabling Chatbot with BitsAndBytes Optimization on Nvidia A100 | Learn how to optimize chatbot using BitsAndBytes on Nvidia A100 | Notebook |
| 3.4 | Enabling Chatbot with Weight Only INT4 Optimization on SPR | Learn how to optimize chatbot using ITREX LLM graph Weight Only INT4 on SPR | Notebook |
| 4 | Fine-Tuning Chatbots | ||
| 4.1 | Fine-tuning on SPR (Single Node) | Learn how to fine-tune chatbot on SPR with single node | Notebook |
| 4.2 | Fine-tuning on SPR (Multiple Nodes) | Learn how to fine-tune chatbot on SPR with multiple nodes | Notebook |
| 4.3 | Fine-tuning on Habana Gaudi1/Gaudi2 (Single Card) | Learn how to fine-tune on Habana Gaudi1/Gaudi2 with single card | Notebook |
| 4.4 | Fine-tuning on Nvidia A100 (Single Card) | Learn how to fine-tune chatbot on Nvidia A100 | Notebook |
| 4.5 | Finetune Neuralchat on NVIDIA GPU | Learn how to fine-tune Neuralchat on Nvidia GPU | Notebook |
| 4.6 | Finetuning or RAG for external knowledge | Learn how to fine-tune or RAG for external knowledge | Notebook |
| 5 | Customizing Chatbots | ||
| 5.1 | Enabling Plugins to Customize Chatbot | Learn how to customize chatbot using plugins | Notebook |
| 5.2 | Enabling Fine-tuned Models in Chatbot | Learn how to customize chatbot using fine-tuned models | Notebook |
| 5.3 | Enabling Optimized Models in Chatbot | Learn how to customize chatbot using optimized models | Notebook |
| 5.4 | Enabling New LLM Models to Customize Chatbot | Learn how to use new LLM models to customize chatbot | Notebook |
| 6 | Extension API | ||
| 6.1 | Transformers Extension API | Learn how to use transformer extension API | Notebook |
| 6.2 | Langchain Extension API | Learn how to use langchain extension API | Notebook |