Skip to content

week6 (temporal difference) - fix slides, adjust seminar descriptions #4

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

week6 (temporal difference) - fix slides, adjust seminar descriptions #4

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
38ae172
lectures fix
neychev Oct 17, 2017
c85d4c3
Update README.md
neychev Oct 17, 2017
fc09b4f
fix qlearning intro videos
neychev Oct 17, 2017
4ca1693
rm hw instructions
neychev Oct 17, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Binary file added 2017/lectures/6_temporal_difference.odp
View file
Open in desktop
Binary file not shown.
Binary file modified 2017/lectures/6_temporal_difference.pdf
View file
Open in desktop
Binary file not shown.
16 changes: 7 additions & 9 deletions 2017/seminars/6_rl_value_methods/README.md
View file
Open in desktop
@@ -1,13 +1,13 @@
#### __Lecture slides__ - [here](https://yadi.sk/i/54qWKtDB3NDeuh)
#### __Lecture slides__ - [here](https://github.com/neychev/ml-mipt-part2/blob/master/2017/lectures/6_temporal_difference.pdf)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

поправь, пожалуйста адрес, чтобы указывал на общий реп

### Materials
* Russian materials:
- Recap of value iteration & Q_learning - [video](https://yadi.sk/i/I7XcP6vU3ExNrT)
- Q-learning seminar - [video](https://yadi.sk/i/XbqNQmjm3ExNsq)
- Recap of value iteration & Q_learning - [video](https://yadi.sk/i/cVawsPkK3EtGJj)
- Q-learning seminar - [video](https://yadi.sk/i/dQmolwOy3EtGNK)
- More on value-based methods - [video 2](https://yadi.sk/i/I7XcP6vU3ExNrT)
- Sarsa & stuff - [seminar2](https://yadi.sk/i/XbqNQmjm3ExNsq)
* English materials:
- Lecture by David Silver (english) - [video part I](https://www.youtube.com/watch?v=PnHCvfgC_ZA), [video part II](https://www.youtube.com/watch?v=0g4j2k_Ggc4&t=43s)
- Alternative lecture by Pieter Abbeel (english) - [video](https://www.youtube.com/watch?v=ifma8G7LegE)
- Lecture by Pieter Abbeel (english) - [video](https://www.youtube.com/watch?v=ifma8G7LegE)
- Alternative lectures by David Silver (english) - [video part I](https://www.youtube.com/watch?v=Nd1-UUMVfz4) [video part II](https://www.youtube.com/watch?v=PnHCvfgC_ZA), [video part III](https://www.youtube.com/watch?v=0g4j2k_Ggc4&t=43s)
- Alternative lecture by John Schulmann (english) - [video](https://www.youtube.com/watch?v=IL3gVyJMmhg)
- Blog post on q-learning Vs SARSA - [url](https://studywolf.wordpress.com/2013/07/01/reinforcement-learning-sarsa-vs-q-learning/)

Expand All @@ -16,11 +16,9 @@
* Eligibility traces from Sutton's book - [url](http://incompleteideas.net/sutton/book/ebook/node72.html)
* Blog post on eligibility traces - [url](http://pierrelucbacon.com/traces/)

### Assignments
### Coding practice

This week's practice will require you to pick __either ./seminar_main or ./seminar_alternative__ as first part and then __go to ./homework__ and follow instructions in [the notebook](https://github.com/yandexdataschool/Practical_RL/blob/fall17/week3/homework/homework.ipynb)

Below are some guidelines on what to do in seminar_main/_alternative.
This week's practice will require you to pick __either ./seminar_main (python2,local machine) or ./seminar_alternative(otherwise)__.

### ./seminar_main
_this assignment borrows code from awesome [cs188](http://ai.berkeley.edu/project_overview.html)_
Expand Down