Markov chains (discrete-time Markov processes on discrete state spaces)

Markov chains (discrete-time Markov processes on discrete state spaces)

Introduces discrete-time Markov chains: states, transition probabilities, the memoryless property, transition matrices, and reaching an equilibrium/stationary distribution.