This is as an exercise to practice with RL. I wanted to build the agent and the environment without any libraries.
I choose golang because I am learning the language.
I choose tic-tac-toe because in my foolish youth I coded an "AI" full of if that play tic-tac-toe. I wanted see how it would work with RL.
go get github.com/artonge/RL-tic-tac-toe
or
git clone github.com/artonge/RL-tic-tac-toe
then
go build
./RL-tic-tac-toe [--plot]
--plot is for generating a plot in a png file
Two agents play against each other. For the first part of the program, both of them are learning to play as they play. We can see that their results are the same. But at the half, the second agent 'forget' what it has learned and also stop learning. It then become clear that one of them knows how to play and the other does not. The learning is basic, each time an agent wins, it update the value of all the state it has played for the game. The value is a incremental mean.
| Both learning | o forget | o forget and stop learning |
|---|---|---|
| x wins 52.1% of the times | x wins 78.9% of the times | x wins 99.2% of the times |
| o wins 47.3% of the times | x wins 20.4% of the times | o wins 0.66% of the times |
 |
 |
It does not take long for an agent to learn. I first, after the second agent forgot what it has learned, I was letting it learning again. The consequence was that the distinction between the two agents wins wasn't clear. That is why I also make the second agent to stop learning.
- Make the output better. A graph showing the learning curves of the agents ?