Let p i , j {\displaystyle p_{i,j}} be the probability of moving to state i {\displaystyle i} if you are in state j {\displaystyle j} . Then the transition matrix matrix is defined by P = [ p i , j ] {\displaystyle P=[p_{i,j}]} .