Test Plan/Protocol Example

UX Research Test Plan | Usability Studies for Employee Portal

Goal

Users should an easy time finding information they need and a starting place to complete tasks.

Research Objectives

• Can users easily find a place to start their task on the portal?
  • Do they feel confident they found a good place to start?
• Are they able to find information they need quickly to complete their assigned task?
• What pain points, if any, emerge in these processes?

Stimuli

Portal test site: (Link)

Methods

Remote, unmoderated usability studies based on most viewed pages and helpdesk analytics for most common tasks for HR and IT.  UzerZoom platform tests to record 15-20 minute sessions for 12 scenario/task sets. 10-12 participants to be recruited from (company employees) mixed personas, roles and experience for each test. Up to 120 unique participants.

Test Protocol

For these sessions, participants will be given a scenario and asked to complete tasks using and capture any confusions/pain points during the process.

We will record participants’ feedback with video and audio, and the moderator will ask follow-up questions to clarify their actions, comments, and feedback.

We will be asking participants to complete the tasks and answer the questions below. This protocol is not suitable for collecting benchmark metrics such as time-on-task rates or tests of statistical significance.

Test Details

Warm-Up and Background

Thank you for participating in this study. Your feedback will help us design better experiences for everyone at the company. Please read the instructions carefully and speak out loud while completing your task.

Note: The following section changes with different scenarios and task questions reflecting other Usability tests. Examples of other test subject matter included:

• Technology Support for a malfunctioning computer
• Taking a Leave of Absence
• Leader Resources
• Timesheets
• Paychecks
• HR/IT Tickets and Shipments
• Continuing Education Credit Requirements

Scenario

Imagine you have a new family member and realize you need to make changes to your health insurance but first you want to see an overview of all your current benefits with the company.

Task Instruction

Find where you can view your current benefits, then find how and where to make a change to your health insurance. Your task is complete when you find the link that will take you to a report of your current benefits, you understand how to make a change to your insurance and you see a link that will take you to a place to make that change.

Tasks and Questions

1. [verbal] You will now see a homepage screen of a website. Without selecting anything yet, what are your first impressions of the page?
2. [click test] Please look at the page and decide where you might start your tasks of finding your current benefits and making a change? Go ahead and click on up to 3 places you think you could start your task.
3. [rating] How confident do you feel that you found a good place to start to find what you need to complete your task? On a scale of 1-7, where 1 is not confident at all, and 7 is very confident.
4. [verbal] [timeout 7 minutes] Please pick one a starting point and look for a way to find all the benefits you are currently enrolled in and find a place to make a change to your health insurance. Please talk out loud while completing our tasks. When you feel your task is complete click next.
5.  [rating] How easy was it to find the information you needed and complete your task? On a scale of 1-7, where
6. [written] Was there anything in particular that you liked about using the site?
7. [written] Was there anything in particular you disliked about using the site?
8. [written] Do you have any ideas about what might make it easier for you to complete your task on the site? (optional)
9. [written] Do you have any comments you would like to make about the site?
10. [rating matrix] Please rate your agreement with the following statements about your experience on the site during this test. On a scale of 1-7, where 1 is strongly disagree and 7 is strongly agree.
    • This site easy to use.
    • I was able to find what I needed to complete my task.
    • This site is attractive.
    • I would need to learn a lot or get help to use this site.
    • I would like to use this site often.

Wrap-Up

You have completed this test session. Thank you for your time and feedback.