Implementation of "Batch stationary distribution estimation" link.
The example MC seems to converge to the true stationary function after 100 epochs:
[Epoch 95] V: -0.132449, Tau(0): 0.003317, Tau(1):0.003726, Tau(2):0.006164
[Epoch 96] V: -0.140039, Tau(0): 0.003322, Tau(1):0.003732, Tau(2):0.006174
[Epoch 97] V: -0.147585, Tau(0): 0.003328, Tau(1):0.003739, Tau(2):0.006186
[Epoch 98] V: -0.155087, Tau(0): 0.003335, Tau(1):0.003747, Tau(2):0.006200
[Epoch 99] V: -0.162546, Tau(0): 0.003343, Tau(1):0.003756, Tau(2):0.006216