Content
View differences
Updated by Marc Alcobé about 2 years ago
# 📔 Project Overview
With the new project of creating an OpenProject mobile app a first spike of it has been developed in Flutter with some basic project management on the go functionalities:
* See work packages lists
* Edit work packages
* Create new work packages
* Notification centre
* Basic user settings
# 🛠️ The setup
## **Product to be tested**
[**Figma prototype**](https://www.figma.com/proto/arGHBRVi6WLJDLTv0YoOoo/Mobile-App?page-id=163%3A41139&type=design&node-id=172-41140&viewport=521%2C305%2C0.16&t=JTkXNmTaa3aetqYc-1&scaling=min-zoom&starting-point-node-id=172%3A41140&mode=design): advanced mobile app prototype ahead of the current Flutter spike.
## Business Case
### Problem:
The current problems faced are:
1. There is no validation that the current approach is correct.
2. No sure if the current functionalities implemented are what our users want in mobile.
3. No assurance that the navigation and UI is easy to use for our users.
4. No prior validation on designs have been performed to decide which direction the app takes.
### Goals:
* Test the navigation inside the application.
* Ensure the most basic tasks in mobile are easy to perform.
* Gather feedback on the UI elements and how the app looks like.
* Identifying problems in the design of the product.
* Uncovering opportunities to improve.
* Uncover possible new functionalities that the users are missing.
* Learning about the target user’s behavior and preferences.
### KPIs:
* **Time-on-task:** how long does it take for participants to complete a usability task?
* **Likes, dislikes, and recommendations:** direct insights into what participants thought and felt about the usability of your designs.
* **Critical errors:** these are errors that impact the success of the usability task. Whether aware or not, these errors prohibit participants from successfully completing the task.
* **Non-critical errors:** these are minor deviations from the usability test goal, like navigating to the wrong tab or scrolling past the required action.
* **Misclick rate:** times the user has clicked on the “wrong” place to try to complete the task.
* **Search vs Navigation:** how many times the user has tried to use the search function to not navigate the app
* **User error rate:** identifies the number of times a user makes a mistake while performing a task.
* **Error-free rate:** the percentage of participants that complete the usability task with no errors whatsoever; think of this as a north star metric.
* **Successful task completion:** this is the percentage of tasks that are successfully completed by participants overall, regardless of how they got there.
* **System Usability Scale (**[**SUS**](https://maze.co/collections/ux-ui-design/ux-kpis/)**):** The SUS is a post-test questionnaire given to a participant after a usability test is over. It consists of ten questions that address the usability and learnability of a system. Participants can answer each question using a five point scale, ranging from “I strongly agree” to “I strongly disagree.”
What is the reason we are doing this test? What are the benefits of testing this? What would be the risk in not testing? (Bullet points work well here)
## Type of test
Remote moderated qualitative usability tests (with mobile screen recording). Ideally we will perform multiple rounds of iteration of 5 participants each.
## Tools
* BigBlueButton
* Figma
* Screen mirroring app for mobile (to be defined)
## Participants
This time the test will be performed internally at OpenProject therefore the participants will be company employees. Each round of testing will be performed with 5 participants, then the prototype will be refined and tested again:
<figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Operative system</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Testing date</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p">Parimal Satyal</p></td><td class="op-uc-table--cell"><p class="op-uc-p">UX-UI Designer</p></td><td class="op-uc-table--cell"><p class="op-uc-p">iOS</p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr></tbody></table></figure><figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Operative system</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Testing date</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr></tbody></table></figure>
## Facilitator
<figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Responsibilities</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p">Marc Alcobé</p></td><td class="op-uc-table--cell"><p class="op-uc-p">UX-UI Designer</p></td><td class="op-uc-table--cell"><p class="op-uc-p">Moderate, take notes and analyse results</p></td></tr></tbody></table></figure>
# 📝 The plan
## Test Tasks
TBD
# 📑 Documentation
## Test script
\[document that will be shared with the participants to do the test\]
## Test notes
\[facilitator makes notes during the session. Do so here\]
## Recordings
\[add the link to the recordings here\]
## Analysis, Findings and Recommendations
\[add the link to the conclusion of the test here\]
With the new project of creating an OpenProject mobile app a first spike of it has been developed in Flutter with some basic project management on the go functionalities:
* See work packages lists
* Edit work packages
* Create new work packages
* Notification centre
* Basic user settings
# 🛠️ The setup
## **Product to be tested**
[**Figma prototype**](https://www.figma.com/proto/arGHBRVi6WLJDLTv0YoOoo/Mobile-App?page-id=163%3A41139&type=design&node-id=172-41140&viewport=521%2C305%2C0.16&t=JTkXNmTaa3aetqYc-1&scaling=min-zoom&starting-point-node-id=172%3A41140&mode=design): advanced mobile app prototype ahead of the current Flutter spike.
## Business Case
### Problem:
The current problems faced are:
1. There is no validation that the current approach is correct.
2. No sure if the current functionalities implemented are what our users want in mobile.
3. No assurance that the navigation and UI is easy to use for our users.
4. No prior validation on designs have been performed to decide which direction the app takes.
### Goals:
* Test the navigation inside the application.
* Ensure the most basic tasks in mobile are easy to perform.
* Gather feedback on the UI elements and how the app looks like.
* Identifying problems in the design of the product.
* Uncovering opportunities to improve.
* Uncover possible new functionalities that the users are missing.
* Learning about the target user’s behavior and preferences.
### KPIs:
* **Time-on-task:** how long does it take for participants to complete a usability task?
* **Likes, dislikes, and recommendations:** direct insights into what participants thought and felt about the usability of your designs.
* **Critical errors:** these are errors that impact the success of the usability task. Whether aware or not, these errors prohibit participants from successfully completing the task.
* **Non-critical errors:** these are minor deviations from the usability test goal, like navigating to the wrong tab or scrolling past the required action.
* **Misclick rate:** times the user has clicked on the “wrong” place to try to complete the task.
* **Search vs Navigation:** how many times the user has tried to use the search function to not navigate the app
* **User error rate:** identifies the number of times a user makes a mistake while performing a task.
* **Error-free rate:** the percentage of participants that complete the usability task with no errors whatsoever; think of this as a north star metric.
* **Successful task completion:** this is the percentage of tasks that are successfully completed by participants overall, regardless of how they got there.
* **System Usability Scale (**[**SUS**](https://maze.co/collections/ux-ui-design/ux-kpis/)**):** The SUS is a post-test questionnaire given to a participant after a usability test is over. It consists of ten questions that address the usability and learnability of a system. Participants can answer each question using a five point scale, ranging from “I strongly agree” to “I strongly disagree.”
What is the reason we are doing this test? What are the benefits of testing this? What would be the risk in not testing? (Bullet points work well here)
## Type of test
Remote moderated qualitative usability tests (with mobile screen recording). Ideally we will perform multiple rounds of iteration of 5 participants each.
## Tools
* BigBlueButton
* Figma
* Screen mirroring app for mobile (to be defined)
## Participants
This time the test will be performed internally at OpenProject therefore the participants will be company employees. Each round of testing will be performed with 5 participants, then the prototype will be refined and tested again:
<figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Operative system</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Testing date</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p">Parimal Satyal</p></td><td class="op-uc-table--cell"><p class="op-uc-p">UX-UI Designer</p></td><td class="op-uc-table--cell"><p class="op-uc-p">iOS</p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr></tbody></table></figure><figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Operative system</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Testing date</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td><td class="op-uc-table--cell"><p class="op-uc-p"></p></td></tr></tbody></table></figure>
## Facilitator
<figure class="table op-uc-figure_align-center op-uc-figure"><table class="op-uc-table"><thead class="op-uc-table--head"><tr class="op-uc-table--row"><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Name</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Role</p></th><th class="op-uc-table--cell op-uc-table--cell_head"><p class="op-uc-p">Responsibilities</p></th></tr></thead><tbody><tr class="op-uc-table--row"><td class="op-uc-table--cell"><p class="op-uc-p">Marc Alcobé</p></td><td class="op-uc-table--cell"><p class="op-uc-p">UX-UI Designer</p></td><td class="op-uc-table--cell"><p class="op-uc-p">Moderate, take notes and analyse results</p></td></tr></tbody></table></figure>
# 📝 The plan
## Test Tasks
TBD
# 📑 Documentation
## Test script
\[document that will be shared with the participants to do the test\]
## Test notes
\[facilitator makes notes during the session. Do so here\]
## Recordings
\[add the link to the recordings here\]
## Analysis, Findings and Recommendations
\[add the link to the conclusion of the test here\]