R package for simulating, estimating, and modeling with Markov chains

This is a collection of scripts and functions that serve as exercises for understanding and writing various numerical methods from scratch.

Exercises and experiments with Bayesian statistics and markov chains.

Section 14 of a tentative book on Markov chains with detailed analysis of eigenvalues of Markov chains of random walks.

Telegram bot that builds Markov chains for subreddits

Section 12 of a tentative book on Markov chains with examples of application of Gibbs sampling

A Java-based Markov-Chain text generator

A simple implementation of markov chaining and stochastic processes applied to text analysis and natural language, written as an extra-curricular school project, in Python and C++

Creating a Twitter Bot using Dan Shiffman's tutorial and scraped data from NYUAD Confessions and C&C using BS4 and Selenium Webdriver. Fed the results into an RNN model to generate "confessions"

This project focuses on comparing different Reinforcement Learning Algorithms, including monte-carlo, q-learning, lambda q-learning epsilon-greedy variations, etc.

String generator based on Markov process

An Open Source Tool for Analyzing Discrete Markov Chains.

Max patch to generate midi patterns based on Markov Chains.

Generate funny logs with Markov chains

Section 2 of tentative book on theory and examples of Markov Chains

Training a Markov chain model.

Sample Python Program, trained using Markov Chains to generate random sentences based on start word

Generalizations of Deep Weight Prior

Section 3 of a tentative book on theory and examples of Markov Chains