Description
Markov chains are used to model probabilities using information that can be encoded in the current state. Something transitions from one state to another semi-randomly, or stochastically.
Summary
- What is a Markov Chain?
- To determine the transition probabilities, you have to "train" your Markov Chain on some input corpus.
- Observations can be made, but these observations are not usually sufficient to uniquely determine the state of the model.
- Applications in Artificial Intelligence There are quite a few applications of Markov Chains to AI -- Markov Chains are useful basically when you want to model something that's in discrete states, but you don't understand how it works.