Suggestion

Hi,

It a pleasure to read your page, I think you have given fantastic citations and mastered at using latex to represent formulas. Also, you gave detailed example and pseudo-code to explain what you want to mean. You really helped me a lot in understanding this topic.

The only suggestion is that your page might be too technical as a wiki page, maybe you can add some applications of MDPs to help readers better understand this field.

Best regards,

Jiahong Chen

Thanks Jiahong for your feedback. I agree with you and we would try to put some applications of MDP to improve the page even more. We would love to hear if you have any other valuable comments and/or ideas to improve the page