Usability Testing

Description

Watch users try realistic tasks on your product to find usability problems and design opportunities before you ship.

Usability testing reveals where people struggle while attempting realistic tasks with a prototype or service. In a moderated session, a researcher observes the participant and may ask them to explain their thinking. Use it to investigate confusing language, layouts or interactions and identify improvements. Agree research questions, recruit likely users and prepare believable tasks that do not reveal the solution. Explain that the service is being tested, then mostly watch and listen rather than guiding participants. Record observations and follow up on unclear behaviour. Plan accessible sessions, including participants’ own assistive technology when appropriate.

Attributes

Loss type
Active
Data
Mixed
Effort
Days

Steps

  1. Define research questions, target user segments and success criteria for each task.
  2. Write 5 to 8 realistic task scenarios that avoid interface vocabulary and leading cues.
  3. Recruit participants who match the target users, typically 5 to 8 per segment for formative rounds or 20 or more for summative measurement.
  4. Pilot the protocol with one participant and fix ambiguous tasks.
  5. Run sessions with a consistent script, observing behaviour and recording success, time, errors and comments.
  6. Log each problem with evidence and rate severity by frequency, impact and persistence.
  7. Report prioritised problems with recommendations and retest after redesign.

Sources

  • Handbook of Usability Testing
  • Rocket Surgery Made Easy
  • How to Conduct a Quantitative Usability Test (Sauro)
  • Quantifying the User Experience (Sauro & Lewis)
  • Drachen, A., Mirza-Babaei, P. & Nacke, L. (eds), Games User Research (2018)
  • Garcia-Ruiz, M. (ed.), Games User Research: A Case Study Approach (2016)

Videos

Related talks

Also known as

  • user testing
  • UT
  • usability test
  • usability tests
  • Task-based usability testing

Categories

  • User Research
  • Usability & Evaluation