Everything about AI/Deep Learning ChatBot - Research, Code and Samples

Introduction

Start with this course - Deep Learning and NLP A-Z™: How to create a ChatBot. This course expects you to know Python and basics of Deep Learning programming. I know Python, however not much of AI/Deep Learning programming. So, after the data cleaning portion in course, I got totally lost in AI/Deep Learning part. The purpose of this github repo is to document my learning process. Following is not in specific order, but by the end of it, I should be expert in ChatBots, be able to determine whether to build, use COTS (commercial off the shelf) or FOSS (Free and Open Source) ChatBot. Lets begin... build vs buy.

Research - Enterprise ChatBots

I am keeping this at the top, because I am proponent of buy over build. You build, only if there are no products out there that meets most of your requirements. Hence, I will research bots available in the market

Research - Build ChatBot

I am starting off with seq2seq as course uses it to build a chatbot. I ran into Google Meena while quick research on seq2seq. Based on initial research, this is the best chat bot available. Lets see how my learning goes and how we meet our goal of selecting or building a chatbot. Update (4/30/2020): FB released their own chat bot that they claim is better than Google's.

Build ChatBot - Samples/Hands On

Serverless BERT with Hugging Face (https://www.philschmid.de/)

Books and Courses

• Free eBook: Python Machine Learning By Example (Packt) - https://www.packtpub.com/free-ebooks/big-data-and-business-intelligence/python-machine-learning-example/9781783553112
• Free online course - Deep Learning for Natural Language Processing (University of Oxford via Independent)
  • Course link - https://github.com/oxford-cs-deepnlp-2017/lectures/blob/master/README.md
  • Pre-Req - http://www.cs.ox.ac.uk/teaching/courses/2016-2017/dl/
• 10 Free Top Notch Natural Language Processing Courses = https://www.kdnuggets.com/2019/10/10-free-top-notch-courses-natural-language-processing.html

Seq2Seq

• Seq2Seq - Wikipedia
• seq2seq model in Machine Learning - GeeksForGeeks.org
• Understanding RNNs, LSTM and Seq2Seq model using a Practical implementation of chatbot in Tensorflow by Harsh Panwar

Google 'Meena'

Towards a Conversational Agent that Can Chat About…Anything

• Blog - https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html
• Paper - https://arxiv.org/pdf/2001.09977.pdf

Facebook 'Blender'

A state-of-the-art open source chatbot

• Blog - https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot
• Paper - https://arxiv.org/pdf/2004.13637.pdf