Science:Math Exam Resources/Courses/MATH152/April 2017/Question B 02/Hint 1
Let be the probability of moving to state if you are in state . Then the transition matrix matrix is defined by .
When has a single eigenvector for the eigenvalue , we call the probability eigenvector as the equilibrium probability.