Statistical-Machine-Learning-and-Data-Mining

Support Vector Machine

• Files
  • Support Vector Machines.ipynb
• Implement the SVM using scikit-learn
• Implement the SVM using the Sequential Minimal Optimisation (SMO) Algorithm from scratch
  • Reference: http://emilemathieu.fr/blog_svm.html

Discriminant Linear Classifiers

• Files
  • Discriminant Linear Classifiers.ipynb
• Least-Square Linear Classifier
• Fisher's Linear Discriminate
• Perceptron Algorithm

K-Means

• Files
  • K-Means.ipynb
  • Alternative K-Means.ipynb
• Implement K-Means from scratch
• Implement an alternative to k-means from scratch

K-NN

• Files
  • k-Nearest Neighbor Classifier.ipynb
  • kNN from scratch.ipynb
• Implement the k-NN using scikit-learn
• Compared 1-NN to Voronoi cells
• Implement the k-NN from scratch

Gaussian Mixtures

• Files
  • EM Algorithm for Gaussian Mixtures.ipynb
• Implement the EM Algorithm for Gaussian Mixtures