T81 558:Applications of Deep Neural Networks

The content of this course changes as technology evolves, to keep up to date with changes follow me on GitHub.

Section 2. Spring 2020, Monday, 2:30 PM - 5:20 PM Online & Cupples I / 215
Section 1. Spring 2020, Monday, 6:00 PM - 9:00 PM Online & Cupples I / 215

Course Description

Deep learning is a group of exciting new technologies for neural networks. Through a combination of advanced training techniques and neural network architectural components, it is now possible to create neural networks that can handle tabular data, images, text, and audio as both input and output. Deep learning allows a neural network to learn hierarchies of information in a way that is like the function of the human brain. This course will introduce the student to classic neural network structures, Convolution Neural Networks (CNN), Long Short-Term Memory (LSTM), Gated Recurrent Neural Networks (GRU), General Adversarial Networks (GAN) and reinforcement learning. Application of these architectures to computer vision, time series, security, natural language processing (NLP), and data generation will be covered. High Performance Computing (HPC) aspects will demonstrate how deep learning can be leveraged both on graphical processing units (GPUs), as well as grids. Focus is primarily upon the application of deep learning to problems, with some introduction to mathematical foundations. Students will use the Python programming language to implement deep learning using Google TensorFlow and Keras. It is not necessary to know Python prior to this course; however, familiarity of at least one programming language is assumed. This course will be delivered in a hybrid format that includes both classroom and online instruction.

Objectives

Explain how neural networks (deep and otherwise) compare to other machine learning models.
Determine when a deep neural network would be a good choice for a particular problem.
Demonstrate your understanding of the material through a final project uploaded to GitHub.

Syllabus

This syllabus presents the expected class schedule, due dates, and reading assignments. Download current syllabus.

Module	Content
Module 1 Meet on 01/13/2020	Module 1: Python Preliminaries Part 1.1: Course Overview Part 1.2: Introduction to Python Part 1.3: Python Lists, Dictionaries, Sets & JSON Part 1.4: File Handling Part 1.5: Functions, Lambdas, and Map/ReducePython Preliminaries We will meet on campus this week! (first meeting)
Module 2 Week of 01/27/2020	Module 2: Python for Machine Learning Part 2.1: Introduction to Pandas for Deep Learning Part 2.2: Encoding Categorical Values in Pandas Part 2.3: Grouping, Sorting, and Shuffling Part 2.4: Using Apply and Map in Pandas Part 2.5: Feature Engineering in Padas Module 1 Assignment Due: 01/28/2020
Module 3 Week of 02/03/2020	Module 3: TensorFlow and Keras for Neural Networks Part 3.1: Deep Learning and Neural Network Introduction Part 3.2: Introduction to Tensorflow & Keras Part 3.3: Saving and Loading a Keras Neural Network Part 3.4: Early Stopping in Keras to Prevent Overfitting Part 3.5: Extracting Keras Weights and Manual Neural Network Calculation Module 2: Assignment due: 02/04/2020
Module 4 Week of 02/10/2020	Module 4: Training for Tabular Data Part 4.1: Encoding a Feature Vector for Keras Deep Learning Part 4.2: Keras Multiclass Classification for Deep Neural Networks with ROC and AUC Part 4.3: Keras Regression for Deep Neural Networks with RMSE Part 4.4: Backpropagation, Nesterov Momentum, and ADAM Training Part 4.5: Neural Network RMSE and Log Loss Error Calculation from Scratch Module 3 Assignment due: 02/11/2020
Module 5 Week of 02/17/2020	Module 5: Regularization and Dropout Part 5.1: Introduction to Regularization: Ridge and Lasso Part 5.2: Using K-Fold Cross Validation with Keras Part 5.3: Using L1 and L2 Regularization with Keras to Decrease Overfitting Part 5.4: Drop Out for Keras to Decrease Overfitting Part 5.5: Bootstrapping and Benchmarking Hyperparameters Module 4 Assignment due: 02/18/2020
Module 6 Meet on 02/24/2020	Module 6: CNN for Vision Part 6.1: Image Processing in Python Part 6.2: Keras Neural Networks for MINST and Fashion MINST Part 6.3: Implementing a ResNet in Keras Part 6.4: Computer Vision with OpenCV Part 6.5: Recognizing Multiple Images with Darknet Module 5 Assignment due: 02/25/2020 We will meet on campus this week! (2nd Meeting)
Module 7 Week of 03/02/2020	Module 7: GAN Part 7.1: Introduction to GANS for Image and Data Generation Part 7.2: Implementing a GAN in Keras Part 7.3: Face Generation with StyleGAN and Python Part 7.4: GANS for Semi-Supervised Learning in Keras Part 7.5: An Overview of GAN Research Module 6 Assignment due: 03/03/2020
Module 8 Week of 03/16/2020	Module 8: Kaggle Part 8.1: Introduction to Kaggle Part 8.2: Building Ensembles with Scikit-Learn and Keras Part 8.3: How Should you Architect Your Keras Neural Network: Hyperparameters Part 8.4: Bayesian Hyperparameter Optimization for Keras Part 8.5: Current Semester's Kaggle Module 7 Assignment due: 03/17/2020
Module 9 Meet on 03/23/2020	Module 9: Transfer Learning Part 9.1: Introduction to Keras Transfer Learning Part 9.2: Popular Pretrained Neural Networks for Keras. Part 9.3: Transfer Learning for Computer Vision and Keras Part 9.4: Transfer Learning for Languages and Keras Part 9.5: Transfer Learning for Keras Feature Engineering Module 8 Assignment due: 03/24/2020 We will meet on campus this week! (3rd Meeting)
Module 10 Week of 03/30/2020	Module 10: Time Series in Keras Part 10.1: Time Series Data Encoding for Deep Learning, TensorFlow and Keras Part 10.2: Programming LSTM with Keras and TensorFlow Part 10.3: Image Captioning with Keras and TensorFlow Part 10.4: Temporal CNN in Keras and TensorFlow Part 10.5: Predicting the Stock Market with Keras and TensorFlow Module 9 Assignment due: 03/31/2020
Module 11 Week of 04/06/2020	Module 11: Natural Language Processing Part 11.1: Getting Started with Spacy in Python Part 11.2: Word2Vec and Text Classification Part 11.3: Natural Language Processing with Spacy and Keras Part 11.4: What are Embedding Layers in Keras Part 11.5: Learning English from Scratch with Keras and TensorFlow Module 10 Assignment due: 04/07/2020
Module 12 Week of 04/13/2020	Module 12: Reinforcement Learning Kaggle Assignment due: 04/13/2020 (approx 4-6PM, due to Kaggle GMT timezone) Part 12.1: Introduction to the OpenAI Gym Part 12.2: Introduction to Q-Learning for Keras Part 12.3: Keras Q-Learning in the OpenAI Gym Part 12.4: Atari Games with Keras Neural Networks Part 12.5: How Alpha Zero used Reinforcement Learning to Master Chess
Module 13 Meet on 04/20/2020	Module 13: Deployment and Monitoring Part 13.1: Deploying a Model to AWS Part 13.2: Flask and Deep Learning Web Services Part 13.3: AI at the Edge: Using Keras on a Mobile Device Part 13.4: When to Retrain Your Neural Network Part 13.5: Using a Keras Deep Neural Network with a Web Application We will meet on campus this week! (4th Meeting)
Module 14 Week of 04/27/2020	Module 14: Other Neural Network Techniques Part 14.1: What is AutoML Part 14.2: Using Denoising AutoEncoders in Keras Part 14.3: Training an Intrusion Detection System with KDD99 Part 14.4: Anomaly Detection in Keras Part 14.5: New Technology in Deep Learning Final Project due 05/04/2020

Datasets

Datasets can be downloaded here

Name		Name	Last commit message	Last commit date
Latest commit History 631 Commits
assignments		assignments
data		data
images		images
pdf		pdf
photos		photos
py		py
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
citations.ipynb		citations.ipynb
jeffs_helpful.ipynb		jeffs_helpful.ipynb
manual_setup.ipynb		manual_setup.ipynb
person.json		person.json
t81_558_class_01_1_overview.ipynb		t81_558_class_01_1_overview.ipynb
t81_558_class_01_2_intro_python.ipynb		t81_558_class_01_2_intro_python.ipynb
t81_558_class_01_3_python_collections.ipynb		t81_558_class_01_3_python_collections.ipynb
t81_558_class_01_4_python_files.ipynb		t81_558_class_01_4_python_files.ipynb
t81_558_class_01_5_python_functional.ipynb		t81_558_class_01_5_python_functional.ipynb
t81_558_class_02_1_python_pandas.ipynb		t81_558_class_02_1_python_pandas.ipynb
t81_558_class_02_2_pandas_cat.ipynb		t81_558_class_02_2_pandas_cat.ipynb
t81_558_class_02_3_pandas_grouping.ipynb		t81_558_class_02_3_pandas_grouping.ipynb
t81_558_class_02_4_pandas_functional.ipynb		t81_558_class_02_4_pandas_functional.ipynb
t81_558_class_02_5_pandas_features.ipynb		t81_558_class_02_5_pandas_features.ipynb
t81_558_class_03_1_neural_net.ipynb		t81_558_class_03_1_neural_net.ipynb
t81_558_class_03_2_keras.ipynb		t81_558_class_03_2_keras.ipynb
t81_558_class_03_3_save_load.ipynb		t81_558_class_03_3_save_load.ipynb
t81_558_class_03_4_early_stop.ipynb		t81_558_class_03_4_early_stop.ipynb
t81_558_class_03_5_weights.ipynb		t81_558_class_03_5_weights.ipynb
t81_558_class_04_1_feature_encode.ipynb		t81_558_class_04_1_feature_encode.ipynb
t81_558_class_04_2_multi_class.ipynb		t81_558_class_04_2_multi_class.ipynb
t81_558_class_04_3_regression.ipynb		t81_558_class_04_3_regression.ipynb
t81_558_class_04_4_backprop.ipynb		t81_558_class_04_4_backprop.ipynb
t81_558_class_04_5_rmse_logloss.ipynb		t81_558_class_04_5_rmse_logloss.ipynb
t81_558_class_05_1_reg_ridge_lasso.ipynb		t81_558_class_05_1_reg_ridge_lasso.ipynb
t81_558_class_05_2_kfold.ipynb		t81_558_class_05_2_kfold.ipynb
t81_558_class_05_3_keras_l1_l2.ipynb		t81_558_class_05_3_keras_l1_l2.ipynb
t81_558_class_05_4_dropout.ipynb		t81_558_class_05_4_dropout.ipynb
t81_558_class_05_5_bootstrap.ipynb		t81_558_class_05_5_bootstrap.ipynb
t81_558_class_06_1_python_images.ipynb		t81_558_class_06_1_python_images.ipynb
t81_558_class_06_2_cnn.ipynb		t81_558_class_06_2_cnn.ipynb
t81_558_class_06_3_resnet.ipynb		t81_558_class_06_3_resnet.ipynb
t81_558_class_06_4_keras_images.ipynb		t81_558_class_06_4_keras_images.ipynb
t81_558_class_06_5_yolo.ipynb		t81_558_class_06_5_yolo.ipynb
t81_558_class_07_1_gan_intro.ipynb		t81_558_class_07_1_gan_intro.ipynb
t81_558_class_07_2_Keras_gan.ipynb		t81_558_class_07_2_Keras_gan.ipynb
t81_558_class_07_3_style_gan.ipynb		t81_558_class_07_3_style_gan.ipynb
t81_558_class_07_4_gan_semi_supervised.ipynb		t81_558_class_07_4_gan_semi_supervised.ipynb
t81_558_class_07_5_gan_research.ipynb		t81_558_class_07_5_gan_research.ipynb
t81_558_class_08_1_kaggle_intro.ipynb		t81_558_class_08_1_kaggle_intro.ipynb
t81_558_class_08_2_keras_ensembles.ipynb		t81_558_class_08_2_keras_ensembles.ipynb
t81_558_class_08_3_keras_hyperparameters.ipynb		t81_558_class_08_3_keras_hyperparameters.ipynb
t81_558_class_08_4_bayesian_hyperparameter_opt.ipynb		t81_558_class_08_4_bayesian_hyperparameter_opt.ipynb
t81_558_class_08_5_kaggle_project.ipynb		t81_558_class_08_5_kaggle_project.ipynb
t81_558_class_09_1_keras_transfer.ipynb		t81_558_class_09_1_keras_transfer.ipynb
t81_558_class_09_2_popular_transfer.ipynb		t81_558_class_09_2_popular_transfer.ipynb
t81_558_class_09_3_transfer_cv.ipynb		t81_558_class_09_3_transfer_cv.ipynb
t81_558_class_09_4_transfer_nlp.ipynb		t81_558_class_09_4_transfer_nlp.ipynb
t81_558_class_09_5_transfer_feature_eng.ipynb		t81_558_class_09_5_transfer_feature_eng.ipynb
t81_558_class_10_1_timeseries.ipynb		t81_558_class_10_1_timeseries.ipynb
t81_558_class_10_2_lstm.ipynb		t81_558_class_10_2_lstm.ipynb
t81_558_class_10_3_text_generation.ipynb		t81_558_class_10_3_text_generation.ipynb
t81_558_class_10_4_captioning.ipynb		t81_558_class_10_4_captioning.ipynb
t81_558_class_10_5_temporal_cnn.ipynb		t81_558_class_10_5_temporal_cnn.ipynb
t81_558_class_11_01_spacy.ipynb		t81_558_class_11_01_spacy.ipynb
t81_558_class_11_02_word2vec.ipynb		t81_558_class_11_02_word2vec.ipynb
t81_558_class_11_03_embedding.ipynb		t81_558_class_11_03_embedding.ipynb
t81_558_class_11_04_text_nlp.ipynb		t81_558_class_11_04_text_nlp.ipynb
t81_558_class_11_05_english_scratch.ipynb		t81_558_class_11_05_english_scratch.ipynb
t81_558_class_12_01_ai_gym.ipynb		t81_558_class_12_01_ai_gym.ipynb
t81_558_class_12_02_qlearningreinforcement.ipynb		t81_558_class_12_02_qlearningreinforcement.ipynb
t81_558_class_12_03_keras_reinforce.ipynb		t81_558_class_12_03_keras_reinforce.ipynb
t81_558_class_12_04_atari.ipynb		t81_558_class_12_04_atari.ipynb
t81_558_class_12_05_alpha_zero.ipynb		t81_558_class_12_05_alpha_zero.ipynb
t81_558_class_13_01_flask.ipynb		t81_558_class_13_01_flask.ipynb
t81_558_class_13_02_cloud.ipynb		t81_558_class_13_02_cloud.ipynb
t81_558_class_13_03_web.ipynb		t81_558_class_13_03_web.ipynb
t81_558_class_13_04_retrain.ipynb		t81_558_class_13_04_retrain.ipynb
t81_558_class_13_05_edge.ipynb		t81_558_class_13_05_edge.ipynb
t81_558_class_14_01_automl.ipynb		t81_558_class_14_01_automl.ipynb
t81_558_class_14_02_auto_encode.ipynb		t81_558_class_14_02_auto_encode.ipynb
t81_558_class_14_03_anomaly.ipynb		t81_558_class_14_03_anomaly.ipynb
t81_558_class_14_04_ids_kdd99.ipynb		t81_558_class_14_04_ids_kdd99.ipynb
t81_558_class_14_05_new_tech.ipynb		t81_558_class_14_05_new_tech.ipynb
tensorflow-gpu.yml		tensorflow-gpu.yml
tensorflow.yml		tensorflow.yml

License

thebinaryrealm/t81_558_deep_learning

Folders and files

Latest commit

History