GSoC_2015_project_deep_learning

Deep learning

Mentors

• Theofanis Karaletsos
• Sergey (github: lisitsyn, IRC: lisitsyn)

Difficulty & Requirements

Pretty difficult. Requires:

• C++ programming
• Understanding what neural nets are and how do we learn them
• OpenCL programming is a plus

Description

Details

Waypoints and initial work

Optional

Why this is cool

Deep learning is everywhere

Useful resources

• "Neural Networks for Machine Learning" by Geoffrey Hinton (https://www.coursera.org/course/neuralnets)
• "Deep learning" by Yoshua Bengio, Ian Goodfellow and Aaron Courville (http://www.iro.umontreal.ca/~bengioy/dlbook/)

Entrance level tasks

• Implement new initializations for neural nets as per MSR paper
• Add leaky ReLU neural layer
• Reproduce "Text understanding from scratch" neural model with a notebook
• Support DotFeatures in neural networks