This is a repository where you can find things associated with the AutoML, especially NAS now.

记录下这段时间入坑学习，看过的东西，一个是整理方便自己随时查看，也希望可以有些帮助，不断更新整理中。。。

Literature

• Literature on neural architecture search

Foundation Studies

• Machine Learning basic
  • Course: Machine Learning by Andrew Ng
  • Course Notes: Chinese
• Deep Learning
  • Course: deeplearning.ai, fast.ai
  • Course Notes: Chinese, English
  • Book: Deep Learning by Ian Goodfellow, Chinese Version
• Python
  • Course: University of Michigan, by Charles Severance
• Framework
  • Numpy，Pandas，Sklearn
  • Pytorch: Pytorch Tutorials
• Other Books From SaltTiger
  • SaltTiger: An amazing website where can find many great programming books.
  • Python for Data Analysis, 2nd Edition : Learn Numpy and Pandas
  • Deep Learning Cookbook
  • Deep Learning with PyTorch: Learn Pytorch, but Pytorch Tutorials first.
  • Machine Learning Algorithms
  • Deep Learning for Computer Vision with Python
  • More ... Search by youself.

Neural Architecture Search

• Neural Architecture Search: A Survey
  • Relative blog: 一篇 NAS 介绍
• Neural Architecture Search with Reinforcement Learning
  • Lecture: Quoc Le in in UC Berkeley
  • Slide: Neural Architecture Search with Reinforcement Learning
• Efficient Neural Architecture Search via Parameter Sharing
  • Implement: tensorflow, pytorch
  • Course: video, slide
  • Relative blog: Jeff Dean等人提出ENAS：通过参数共享实现高效的神经架构搜索
• Progressive Neural Architecture Search
• DARTS: Differentiable Architecture Search
  • Implement: pytorch
• Efficient Neural Architecture Search with Network Morphism
  • Implement: keras
  • Website: autokeara
  • Relative blog: AutoKeras: The Killer of Google’s AutoML

Auto ML (#TODO)

Introduce

• Artical by Rachel Thomas in Fast.ai
  • Part I: What do machine learning practitioners actually do?
  • Part II: An Opinionated Introduction to AutoML and Neural Architecture Search
  • Google's AutoML: Cutting Through the Hype

Paper

• Auto ML Pipeline
  • Autostacker: A Compositional Evolutionary Learning System
  • Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science
• Neural Architecture Search
  • Neural Architecture Search with Reinforcement Learning
  • Progressive Neural Architecture Search
  • Efficient Neural Architecture Search via Parameter Sharing
  • Neural Architecture Search: A Survey
• GA & EA algorithm
  • CMA-ES for Hyperparameter Optimization of Deep Neural Networks

Blog

• https://juejin.im/post/5ac9e707f265da2378408c89
• What do machine learning practitioners actually do? · fast.ai
• AutoML 和神经架构搜索初探
• Everything you need to know about AutoML and Neural Architecture Search

Other Resources

• PPT: Neural Architecture Search with Reinforcement Learning
• VIDEO: Neural Architecture Search with Reinforcement, Quoc Le and Barret Zoph
• PPT: Efficient Neural Architecture Search via Parameter Sharing