Usability testing is a user research method in which participants attempt to complete realistic tasks on a website or product while observers measure success rates, task completion times, and errors to identify usability problems.
Quick Answer
Usability testing is a user research method in which participants attempt to complete realistic tasks on a website or product while observers measure success rates, task completion times, and errors to identify usability problems.
5 participants reveal ~85% of usability problems in qualitative discovery studies.
Write task scenarios as goal-oriented prompts, not step-by-step instructions.
Think-aloud protocol is the single highest-return technique in moderated usability testing.
Key Takeaways
5 participants reveal ~85% of usability problems in qualitative discovery studies.
Write task scenarios as goal-oriented prompts, not step-by-step instructions.
Think-aloud protocol is the single highest-return technique in moderated usability testing.
How Usability Testing Works
Usability testing is the gold standard for discovering how real users experience a website or product. Participants are given realistic task scenarios ("Find the pricing for the enterprise plan and begin a demo request") and observed as they attempt to complete them, with facilitators noting hesitations, errors, wrong paths, and verbal expressions of confusion or frustration. Moderated usability tests involve a live facilitator (in-person or via video call) who can probe for deeper reasoning — "What were you expecting to happen there?" Unmoderated tests use tools like Maze, UserTesting.com, or Lookback to present tasks to a larger pool of participants asynchronously, providing video recordings and quantitative completion metrics.
Why Usability Testing Matters for B2B Marketing
Nielsen's famous finding that 5 users identify approximately 85% of usability problems is widely cited as justification for small-sample testing — but this applies to qualitative problem discovery, not quantitative performance benchmarking. For benchmark studies comparing two designs or measuring task completion rates with statistical confidence, 20-30 participants per variant are typically required.
Usability Testing: Best Practices & Strategic Application
Best practices include writing tasks as realistic scenarios (not leading questions like "Click the Services button" but goal-oriented prompts like "You're looking to hire an agency for website redesign — find information about that on this site"), recruiting participants who match the actual target persona, running a pilot test with 1-2 participants before the full study to catch task wording issues, and using a think-aloud protocol (asking users to narrate their thoughts) for maximum insight in moderated sessions.
Agency Perspective: Usability Testing in Practice
MV3 uses remote moderated usability testing via video call for B2B clients when qualitative depth is needed, and Maze for unmoderated tests when quantitative task completion data across larger samples is the priority. Usability test findings are synthesized into an affinity diagram and translated directly into the CRO hypothesis backlog.
Frequently Asked Questions: Usability Testing
Usability testing is a user research method in which participants attempt to complete realistic tasks on a website or product while observers measure success rates, task completion times, and errors to identify usability problems.
For qualitative problem discovery, 5 participants per distinct user segment is sufficient to identify ~85% of usability issues (Nielsen, 2000). For quantitative benchmark studies measuring task completion rates, use 20-30 participants to achieve statistically meaningful results.
Moderated testing has a live facilitator who can ask follow-up questions and probe for reasoning — better for understanding why users behave as they do. Unmoderated testing is asynchronous, cheaper, and reaches more participants faster — better for quantitative task completion data and recruitment from hard-to-reach demographics.
Each usability problem observed maps to a CRO hypothesis: "If we [change X] to address [observed user confusion], we expect [behavior change Y] to result in [conversion improvement Z]." Usability tests provide the qualitative evidence that explains why quantitative analytics show drop-off.
MV3 Marketing helps B2B companies apply these strategies to drive measurable pipeline growth. Our team executes web design for technology, SaaS, and professional services companies.
ID used to identify users for 24 hours after last activity
24 hours
_gat
Used to monitor number of Google Analytics server requests when using Google Tag Manager
1 minute
_gac_
Contains information related to marketing campaigns of the user. These are shared with Google AdWords / Google Ads when the Google Ads and Google Analytics accounts are linked together.
90 days
__utma
ID used to identify users and sessions
2 years after last activity
__utmt
Used to monitor number of Google Analytics server requests
10 minutes
__utmb
Used to distinguish new sessions and visits. This cookie is set when the GA.js javascript library is loaded and there is no existing __utmb cookie. The cookie is updated every time data is sent to the Google Analytics server.
30 minutes after last activity
__utmc
Used only with old Urchin versions of Google Analytics and not with GA.js. Was used to distinguish between new sessions and visits at the end of a session.
End of session (browser)
__utmz
Contains information about the traffic source or campaign that directed user to the website. The cookie is set when the GA.js javascript is loaded and updated when data is sent to the Google Anaytics server
6 months after last activity
__utmv
Contains custom information set by the web developer via the _setCustomVar method in Google Analytics. This cookie is updated every time new data is sent to the Google Analytics server.
2 years after last activity
__utmx
Used to determine whether a user is included in an A / B or Multivariate test.
18 months
_ga
ID used to identify users
2 years
_gali
Used by Google Analytics to determine which links on a page are being clicked
