Talk:Better caching using reinforcement learning

Very good article covering memory pages allocation using UCB. I felt that UCB was a great fit to the problem and I'm excited to see more of your results :)

Some things you can improve are:

1. Explain concepts like Radix tree and LRU list
2. Avoid references without explanation as much as possible for easier reading

I would grade it 18/20

Thanks Kevin. I will incorporate the changes.

Regards, Surbhi

Hi Surbhi,

Your Wiki page was very well written and the topic was also very intriguing. Overall I don't have much to say, just a few minor points that you may correct are as follows:

• Some small sections of the page were incomplete, for example, firstly the section before abstract, where we need to write one sentence summary and secondly before "Additional things that we can do in this project" section, you have written "more coming". Thirdly "Related Pages" section needs some content addition.
• Also, I was expecting some kind of graphs or figures to better explain your technique or the results. Figures and graphs help in giving a better understanding of the textual content.
• Some minor grammatical mistakes were also found on the page. I suggest the use of Grammarly tool, I myself use it, its great!

I like that you acknowledged and thanked the collaborators for this project.

Thanks, Ekta Aggarwal

Hi Ekta,

Thank you for going through the wiki and making helpful suggestions. I will do the needful.

Regards, Surbhi

Comments

The application of RL techniques in the cache management mechanism is very interesting. From reading the page, I could generally understand how UCB was applied to the problem. However, some of the text need paraphrasing as they did not flow smoothly and some sentences needed multiple reads to grasp the idea (understandable though, as this is a rough draft). In the discussion of the results, it would be better to display the results as a table or a graph, since the terminal stdout is harder to parse. Other than that, I think the content is focused and the idea is intriguing; the page will be much better with a cleaner write-up.

Scheme

• The topic is relevant for the course. 5
• The writing is clear and the English is good. 3
• The page is written at an appropriate level for CPSC 522 students (where the students have diverse backgrounds). 5
• The formalism (definitions, mathematics) was well chosen to make the page easier to understand. 4
• The abstract is a concise and clear summary. 4
• There were appropriate (original) examples that helped make the topic clear. 3
• There was appropriate use of (pseudo-) code. -
• It had a good coverage of representations, semantics, inference and learning (as appropriate for the topic). 3
• It is correct. 5
• It was neither too short nor too long for the topic. 5
• It was an appropriate unit for a page (it shouldn't be split into different topics or merged with another page). 5
• It links to appropriate other pages in the wiki. -
• The references and links to external pages are well chosen. 3
• I would recommend this page to someone who wanted to find out about the topic. 4
• This page should be highlighted as an exemplary page for others to emulate. 3
• If I was grading it out of 20, I would give it: 16

Thank you Kumseok! I will make the changes in the results and paraphrasing as well.

Regards, Surbhi