I'm not sure if this course uses left or right multiplication of transition matrices, but in either case many of the solutions are wrong and/or incomplete.
Hi Alistair,
Thanks for pointing out the mistake. Hope now all are fixed[[1]]
Best, Ziming