Machine Learning & Deep Learning

Loose path:

1. Math
2. Programming
3. Machine Learning concepts
4. Specializations

Math

Understanding Math is pivotal. You can never be a good Machine Learning Scientist by skipping the Math.

1. Probability & Statistics Basic Probability and Stats will be helpful in understanding ML algorithms like Naive Bayes.

2. Statistics 101 - Udacity Taught by the founder of GoogleX it's full of exercises in Python so you won't get bored.

3. MIT 18.06 Linear Algebra Prof. Strang is terrific! Not only he'll make you fall in love in Linear Algebra but you'll learn important concepts like SVD and matrix algebra. You might wanna grab this PDF as well. Be sure to also solve the exam question papers from here: link

4. MIT Single Variable Calculus This is my personal favorite book, use it for SVC + MVC link Amazing course but it gets quite tedious in the middle, you might wanna skim some geometry, but the key is to understand how optimization works. Be sure to solve questions from here: link

5. MIT Multi Variable Calculus Understanding vector calculus is necessary for algorithms like SVM, you might wanna skim some parts which are purely theoretical. Be sure to solve questions from here: link

6. (Optional) Stanford Convex Optimization WARNING: Do this course only if you're very good at math. Convex Optimization will teach you numerous functions used in Machine Learning. But this course is extremely heavy on Math!

7. The Book Probability Theory: The Logic of Science is very promising

Introduction to Programming & Algorithms

• Python - Any one, both courses are equally good

  1. Complete Python BootCamp
  2. Complete Python Masterclass

• Algorithms

  Since you'll be coding a lot of algorithms yourself basic understanding is necessary

  1. Basic Algorithms and Complexity Theory

  In case you want to go deeper

  1. Algorithms Stanford I
  2. Algotithms Stanford II

Introduction to Machine Learning

1. Machine Learning by Andrew Ng A must do course, best course of Introduction to Machine Learning so far, light on Math and focuses more on concepts.

2. Amazing Course Highly Recommended - mlcourse.ai A must do course, best course of Introduction to Machine Learning so far, light on Math and focuses more on concepts and is In Python and is supported by an International community of 15k+ Members..

Complete one out of two:

1. Machine Learning A-Z Introductory course on ML focusing on not only Python but also R, one of the best sellers on Udemy.

2. Introduction to Machine Learning - Udacity Sebastian Thrun does an awesome job explaining various approaches in ML. It gets a little boring in the middle but overall it's very good.

Introduction to Machine Learning (Crash-Course By Berkeley and others)

1. Machine Learning Crash Course: Part 1 The basics of machine learning - regression, cost functions, and gradient descent.

2. Machine Learning Crash Course: Part 2 Perceptrons, logistic regression, and SVMs

3. Machine Learning Crash Course: Part 3 Neural networks

4. Machine Learning Crash Course: Part 4 - The Bias-Variance Dilemma The Bias Variance Dilemma

5. Machine Learning Crash Course: Part 5 - Decision Trees and Ensemble Models Decision Trees

6. Logistic Regression Vs Decision Trees Vs SVM: Part I

7. Logistic Regression Vs Decision Trees Vs SVM: Part II

Applied Machine Learning

Two quick courses on applying the theory you learnt. They're short so I recommend doing both of them.

1. Python for Data Science and Machine Learning Bootcamp

2. Machine Learning with Python - Hands On!

Specializations

• Deep Learning

  1. Neural Networks by Geofrrey Hinton This guy is the creator of backpropagation algorithm! Warning: very heavy on Math.

  2. MIT Introduction to Deep Learning

  3. Deep Learning A-Z

  4. Creative Applications of Deep Learning with TensorFlow

  5. Must read book on Deep Learning: Free HTML book by GoodFellow

  6. Must Read book on Deep Learning: Dive into Deep Learning An Interactive Deep Learning Book for students, engineers and researchers

• Big Data & Large Scale Machine Learning

  1. Introduction to Big Data
  2. Spark and Python for Big Data with PySpark
  3. Distributed Machine Learning with Apache Spark

• Natural Language Processing

  1. Introduction to Natural Language Processing UMichigan

  2. Natural Language Processing by Stanford

  3. NLP 2018 Highlights by Elvis

  4. Oxford 2017 NLP Github Resources/Videos etc.

• Self Driving Car

  1. MIT Deep Learning for Self Driving Cars
  2. Self Driving Car Nano Degree

• Scientific Computing

  1. Scientific Computing
  2. High Performance Scientific Computing

Bonus Material

General Neural Network References:

Books/Guides on Deep/Machine Learning: (all excellent)

1. http://neuralnetworksanddeeplearning.com

2. http://machinelearningmastery.com

3. https://www.deeplearningbook.org

Hacker’s Guide to Neural Nets by karpathy(My Favourite)

Tutorials/Videos:

1. Youtube Playlist on “Deep Learning”, t from Oxford U. by Nando de Freitas

2. Andrew Ng’s online course on ML at Stanford comes highly recommended

3. Stanford Tutorial:

Concepts in NN/Deep Learning:

1. Backpropagation, chapter 2 especially

2. Chris Olah on backprop

3. Karpathy on backprop

Recurrent Neural Networks (RNN) (which mostly feature LSTM nowadays):

1. Karpathy post

2. Karpathy talk

3. Excellent annotated Char-NN in Keras tutorial

4. Andrew Trask post/tutorial

5. Denny Britz post

6. Class notes/tutorial (long!)

7. CS class notes (short)

8. Excellent post by Ross Goodwin RNNs

9. Great List of references;

10. RNN in TensorFlow

11. Theano tutorial

12. Batch Normalization to the hidden-to-hidden transitions of our RNNs

13. RNN From Scratch in Python

Traditional RNNs suffer from vanishing/exploding gradient. Hence LSTM & others…

Long Short-Term Memory (LSTM):

1. Tutorial

2. Chris Olah post

3. Zach Lipton post, “Demystifying LSTM” (with Tutorial theano code)

4. Demo: Lightweight Theano-LSTM

5. Massive 33-page review article by Lipton et al

6. LSTM tutorial in Tensorflow

7. Stateful LSTM in Keras for time-series prediction

8. Much-need Docs on stateful LSTM in Keras

9. Tensorflow sequence prediction

10. LSTM Forward And Backward Pass Understanding(Very Good!!)

11. Understanding LSTM's(Pretty Awesome!)

12. Nice Question On Stack On LSTM and Non Time Related Feats

Attention Is All Your Need's

1. Attention Is All You Need - Paper

2. Issues In Keras Github explaining Attention (Very Very Important to read!)

   • keras-team/keras#4962

   • keras-team/keras#1472

3. LSTM Attention in Keras

4. Visualizing Attention In Keras

5. Wild ML Attention Explanation

6. Distll Attention Explanation

7. Git Repo Implemetating Attention in keras

Time Series Analysis (Py and R)

1. Time Series Handbook , a must read for theoretical understanding, it's light

Awesome Blogs Explaining Decision Trees-:

1. Data Aspirant Blogspot

2. Scikit Learn Doc's

3. Data Aspirant Blogpost

4. Analytics Vidhya Blogpost

5. Amazing Visual Explanation Of Decision Trees

Transformers Notes

1. Lilianweng Attention Notes
2. Actual Paper
3. Notes from MLExplained
4. Notes from NLP Harvard
5. Notes from Mchromiak
6. Slides from a Talk by the Authors

BertViz

1. Bert Viz Medium Blog Post

Other Random Stuffs

System Design Distributed Systems

1. https://learning.oreilly.com/videos/distributed-systems-in/9781491924914/9781491924914-video215265
2. https://wiki.nikitavoloboev.xyz/distributed-systems

Decorators

1. python - Making decorators with optional arguments - Stack Overflow
2. https://stackoverflow.com/questions/9204671/pythonic-use-of-dict-in-the-function-self-init-of-a-class/

Asynchronous Messaging (rabbitMQ etc)


1. https://medium.com/better-programming/rabbitmq-vs-kafka-1ef22a041793 (Kafka vs mq P1)
2. https://medium.com/better-programming/rabbitmq-vs-kafka-1779b5b70c41 (Kafka vs mq P2)


Algos (DSA)

1. https://algotree.org/algorithms/tree_graph_traversal/depth_first_search/
2. https://docs.google.com/document/d/1wUCqhVHydWiDk6FJdFLSMpgigNrGcs4OFZg0Wa7JGEw/preview?pru=AAABcwi3bWI*FmXAKBN6rtACnzkERXBguA#

Load Testing


1. https://www.digitalocean.com/community/tutorials/an-introduction-to-load-testing

Stats

1. https://people.richland.edu/james/lecture/m170/ch03-var.html

Multi-Processing

1. https://stackoverflow.com/questions/16181121/a-very-simple-multithreading-parallel-url-fetching-without-queue/27986480#27986480
2. https://medium.com/@bfortuner/python-multithreading-vs-multiprocessing-73072ce5600b

Asyncio


1. https://skipperkongen.dk/2016/09/09/easy-parallel-http-requests-with-python-and-asyncio/
2. https://medium.com/@cgarciae/making-an-infinite-number-of-requests-with-python-aiohttp-pypeln-3a552b97dc95

Tmux

1. https://www.hamvocke.com/blog/a-guide-to-customizing-your-tmux-conf/

Hope it’s Useful...

Thanks For Passing By!!!