Skip to content

lcao300/cliff_walk

Repository files navigation

Cliff walk example code

This repo contains the code for a simple, model-free reinforcement learning implementation of the cliff walk from Sutton and Barto. Both SARSA and Qlearning are implemented.

How to run

In MATLAB, run parameters.m

SARSA

Here is the final path for the SARSA agent: Final path for SARSA agent

Here are the updates to the Q values for the SARSA agent: Q updates for SARSA agent

Q Learning

Here is the final path for the Q learning agent: Final path for Q learning agent

Here are the updates to the Q values for the Q learning agent: Q updates for Q learning agent

To Do

Update the image saver and gif maker file names.