# LaTeX code for Cognitive walkthrough report

\documentclass[a4paper,11pt]{article}
\usepackage{ulem}
\usepackage{a4wide}
\usepackage[dvipsnames,svgnames]{xcolor}
\usepackage[pdftex]{graphicx}

\usepackage{hyperref}
% commands generated by html2latex

\begin{document}

\textbf{Cognitive Walkthrough Evaluation of GWrit}

Gwrit, the Game of Writing project has developed an online writing environment used in class. This environment allows users to write online and use some analysis tools during their writing. Gamification is also an interesting feature of GWrit, which make tedious writing task as an interesting game. We are going to develop an open version of GWrit, which would be widely spread not only in university. To build the open version of GWrit, we first need to evaluate the usability of the system.

One of the usability evaluation method is cognitive walkthrough.

Cognitive walkthrough (CW) is a method used to evaluate the usability by predicting how a user will understand an interaction in the design stage.   We use CW method to focus on how easy the system is to learn. By walking through a list of representative tasks, we identify a number of potential problems of the system.In the cognitive walkthrough evaluation of GWrit, several tasks were identified, most of them could be walked through.

We have four representative task as following.

Task 1: Get an Account and Explore Course

Task 2: Write an Introduction and submit it for review

Task 3: Use analysis tools to analyze writing

Findings \& Recommendations:

In task 1, users may fail to recognize the ???course??? button is for viewing all the courses. So, make ???course??? button more detailed, such as changing to ???View all courses???.

In task 1, after user select a certain course and click join in, user may not able to find the connection between ???My course??? and the result of adding course. So, make an automatically forwarding here. After adding a course, the page will go to ???my course??? page automatically.

In task 2, after user submit writing, they may fail to find the submitted writings. So, we can add a button linked to view submitted writings.

In task 3, when user use word cloud to analyze their writing, they may not know the hovering function for viewing the frequency of a certain word. So, we can add a brief description of this function as a floating text.

In task 3, users may not know what the concordance analysis is.  So, we can add a brief description of concordance as a floating text.

In task 4,users may not know the project title is linked to the submitted works. So users may find difficult to follow the right action step by step to find the commenting board.  So, we can add a button in the page linked to the submitted writings.

\textbf{Cognitive Walkthrough Script:}

User profile:

Persona 1: Thackary

Thackary is new to GWrit. English is not his first language and he is new to Canada. He doesn???t have a lot of experience with computers or the internet and he is worried about having to both learn to write at a university level and use an online system at the same time.

Scenario 1.1 Get an Account and Explore CourseThe first part of the scenario is his logging in and trying to find the course and the first tasks.

\\Scenario 1.3 Use analysis tools to analyze writingActions:1. He clicks projects in the homepage, and find out the task called ???Essay 101??? he doesn???t finished last time. Success story: Users can find the writing page based on their previous experience in GWrit. 2. He clicks ???Essay 101???, and goes to the writing page. Success story: Users can find the writing page based on their previous experience in GWrit.3. He add something to the notes board, and after finished, he clicks the ???Analytics???  button in the right column.He first clicks ???word cloud??? in the drop list. Then the word cloud shows up, he hovers over a certain word to see the time it occurs in the writing.Failure story: Criterion:  Will the user know that the correct action is available?Problem noticed.Users may not know the hovering function for viewing the frequency of a certain word.4. He clicks ???concordance??? in the drop list. He types in a word to find and the context length, then the concordance of the word shows up.Failure story: Criterion:  Will the user try to achieve the right effect?Problem noticed.Users may not know what is concordance analysis. 5. He clicks ???readability??? in the drop list, and the statistic and the average grade of the readability based on different formula show up. Success story: Users can find the button easily and the result of analysis is intuitive.Recommendations:Action 4. Add a brief description of this function as a floating text.Action 5. Add a brief description of concordance as a floating text.

Scenario 1.4 Post commentsActions:1. He login GWrit, and selects the course he is in, and then clicks a project title in the left column, then clicks ???view other submissions??? .Failure story:Criteria:  Will the user associate the correct action with the effect one is trying to achieve? Problem noticed. Users may not know the project title is linked to the submitted works. So users may find difficult to follow the right action step by step to find the commenting board. 2. He clicks other user???s name to see their writing.Success story: Users can click the link correctly by experience.3. He click the commenting icon, and leave some message to this writing.Success story: Users can easily type in comment in the text area by experience.Recommendations: Action 1. Add an intuitive button linked to the submitted works.

Conclusion:The usability evaluation on GWrit using CW leads to the identification of several problems. The problems include some control of actions are not available, such as ???view submission??? is difficult to find after user submit their writings. Second, the connection  between the correct action and the goal is weak. the reason may be the ambiguity of some functions and the definition of buttons. So, based on the evaluation result, we should have some buttons defined clearly and add some interpretive texts for certain functions.

\\

\\Ps. The four questions to ask in a cognitive walkthrough:Q1: Will the user realistically be trying to do this action?Q2: Is the control for the action visible?Q3: Is there a strong link between the control and the action?Q4: Is feedback appropriate?1. Will the user try to achieve the right effect? 2. Will the user know that the correct action is available? 3. Will the user associate the correct action with the effect one is trying to achieve? 4. If the correct action is performed, will the user see that progress is being made toward solution of one???s task?

\end{document}