RP004 Reset Button Usability Test

Intro

The purpose of this study is to understand user behaviors, expectations, and experiences with the reset button on the project creation pages of the TDM Calculator website. The objective of this study is to understand how users understand and interact with the reset button and develop recommendations for the design team for the location and design of the button on the TDM Calculator website.

Contents

1. Prerequisites
   1. Test Plan
2. Preparation
   1. Website Overview Page
   2. Target Users
   3. Sample Project Landing Pages
3. Recruitment
   1. End Users
4. Interview Logistics
   1. Interview Materials
   2. Tool Setup
   3. UXR Training
5. Results
   1. Interview Records
   2. Data Analysis
   3. Findings
6. Additional Resources
   1. Guide to Usability Testing
   2. Referenced Resources
   3. Contact Us

1 - Prerequisites

i - Test Plan

• Created test plan in response to DR: Users are unsure how to start over projects completely
  • TDM: RP004 Reset Button Research Plan
    • Referenced prior usability testing RP003: Tooltip Discoverability Usability Test to reuse and update relevant testing materials and tools.
    • Discussed recruitment with PM and previous team lead.
    • Created RP004: Participant Tracker - De-Identified from the templates used in previous rounds of testing.

2 - Preparation

i - Website Overview Page

• Reused the overview webpage [webpage needs update], which presents the TDM Calculator project.
  • Introduces LA TDM Calculator Project with details about:
    • TDM and TDM Calculator
    • TDM Program Update
    • Current status of TDM Calculator
    • Resources from LADOT

ii - Target Users

• Utilized HfLA community to represent users for usability testing.
  • DR Determining who to recruit for the reset button usability testing

iii - Sample Project Landing Pages

• Reused dev landing page from RP003: Tooltip Usability Testing.
• Created two versions of the landing page to determine if participant feelings about the reset button differed based on the amount of effort needed to input the test case project description.
  • RP004: Landing Page 1 - contains a simplified test case project description.
  • RP004: Landing Page 2 - contains a full test case project description.

3 - Recruitment

i - End Users

• Sent out a recruitment message via Slack that allowed participants to sign up for usability testing time slot via a Google Calendar link.
• Received 10 responses from the HfLA community; the TDM Calculator UXR team interviewed 8 participants.
• Recorded participant appointments on the RP004: TDM Participant Tracker - De-Identified
  • Full participant tracker in the PII drive contains information about each participant’s name, interviewer, testing date and time, and landing page assignment. Contact research lead for access if needed.

4 - Interview Logistics

i - Interview Materials

• Referenced prior usability testing RP002: Usability Testing 2.
• Created RP004: Reset Button Testing Script
  • Interview script for 1:1 interviews includes intro, site testing, and closing questions, which helps UXR to follow the same procedures for all interview sessions and make notes accordingly as interviews proceed. A copy of this template is created for each interview and the link placed into the Usability Testing Session Table.
• Used the TDM background image for each interview session.

ii - Tool Setup

• Used HfLA Slack channels for recruitment.
• Used the TDM-UX@Hackforla.org email address to set up a Google Calendar event that allowed participants to select the time slot that worked best for them.
• Used HfLA Zoom account to conduct and record interviews.
• Used Zoom's built-in transcription feature to transcribe recordings.

iii - UXRs Training

• UXR leads reviewed RP002: TDM UXR Team Lead Responsibilities for Usability Testing to ensure consistency between previous testing procedures and the reset button testing.
• Created RP004: Researcher Instructions to ensure all interview procedures follow the same format and to address any issues with the process before conducting live interviews.

5 - Results

i - Interview Records

• Saved interview records in the PII drive. Contact research lead for access if needed.

ii - Data Analysis

• Utilized FigJam to analyze data:
  • Created a sticky note grid using the questions in the RP004: Reset Button Testing Script and organized participant responses to the questions.
  • Created affinity diagram to further code interview responses based on trends and themes in the responses.

iii - Findings

• Created Round 4 User Testing Insights Presentation to discuss findings and potential solutions with stakeholders.

6 - Additional Resources

ii - Referenced Resources

• GitHub Issue #1344 - User Testing for Reset Button
• GitHub Wiki page for all prior TDM Calculator usability testing
• TDM Calculator Research Plan Template
• TDM Calculator Participant Tracker Template
• TDM Calculator UXR Presentation Template

iii - Contact Us

• Our Slack channel: #tdm-ux.

Return to Contents