The outcomes of rolling a six-sided die are: 1, 2, 3, 4, 5, 6. A probability of zero means an outcome is impossible. A probability of 1 means an outcome is certain ...
A Markov chain is a sequence of random variables that satisfies P(X t+1 ∣X t ,X t−1 ,…,X 1 )=P(X t+1 ∣X t ). Simply put, it is a sequence in which X t+1 depends only on X t and appears before X t−1 ...