[TESTING] Usability Testing

 Introduction

Usability testing is a vital step in evaluating our Book MyBus app prototype. It enables us to understand user interactions, identify areas for improvement, and ensure the app aligns with our persona’s needs. For this activity, we conducted two cycles of usability testing with participants who shared similarities with our persona, Tom Harris.

This post outlines the methods, findings, and improvements made based on the usability testing process.

Testing Objectives

• Evaluate the accessibility features and ease of use for users with limited motor skills.

• Identify potential usability issues in the prototype.

• Gather actionable feedback to improve the app’s design and functionality.

Testing Process

We tested the prototype with three users who closely resembled our user persona. Each participant interacted with the app to complete three predefined tasks:

1. Log in using voice commands or keyboard shortcuts.

2. Select the bill to pay using large, easy-to-click buttons.

3. Confirm payment with minimal navigation.

Testing Environment

The usability tests were conducted in-person during our class sessions. Each session lasted approximately 2-3 minutes, and we recorded the interactions to analyze user behavior and feedback. The test was moderated to ensure participants understood the tasks but were free to navigate the app independently.

Video Recording & Screenshots (3 users)

User 1:

User 2:

User 3:

Usability Testing Methodology

Procedures

Users completed tasks in a controlled environment following a detailed task sheet, with performance recorded using predefined metrics. Each session was captured via photo and video for analysis. Post-task feedback was collected through surveys, focusing on usability aspects like ease of use and satisfaction. Users were assured of confidentiality to encourage honest insights, providing a robust dataset for evaluating usability and identifying improvements. There's Usability Questionnaire (Google Form) used to gather participant feedback.

Testing Metrics

1) Task Success: Whether the user successfully completes the task.
2) Time on Task: The time taken to complete each task.
3) User Feedback: Positive and negative comments from users.

Tools and Equipment

1) The laptop used to access Figma.
2) Tablet to take note of the user’s comment.
3) Mobile phone camera.

Usability Questionnaire (Google Form) 

To gather detailed user feedback, we designed a Google Form as the usability questionnaire. This form allowed users to share their experiences and rate the app’s features after completing the assigned tasks.

Usability Questionnaire's Question

Perceived Usefulness

1. The app helps me accomplish tasks more effectively 

2. Using the app enhances my productivity. 

3. The app provides all the necessary features for my needs. 

4. The app improves my ability to complete tasks accurately. 

5. I would recommend this app to others for similar tasks.

Perceived Ease of Use

1. The app is easy to use and navigate. 

2. Learning to use the app was straightforward. 

3. I can complete tasks in the app without confusion. 

4. The app’s interface is visually appealing and well-organized. 

5. The app responds quickly and functions smoothly.

Open-ended feedback

1. What aspects of the app did you like the most?

2. What improvements would you suggest for the app?

Results

User1:

User 2:

User 3:

Findings

Based on the responses from the three users in the usability questionnaire, all users expressed satisfaction with the app and its accessibility features. They highlighted the ease of navigation, the effectiveness of the voice input, and the clarity of the interface.

No specific improvements were suggested in their feedback, indicating that the current design meets the needs of users, including individuals with accessibility challenges. This positive feedback reinforces the app’s effectiveness in providing a seamless and inclusive experience.

Strengths:

1. Voice Integration: Users appreciated the voice-to-text functionality, finding it intuitive and reliable.
2. Clear Navigation Flow: Large buttons and minimal interaction steps ensured tasks were completed quickly and with minimal effort.
3. Error Prevention: The confirmation pages and error-proof forms reduced user mistakes during tasks like entering payment details.

Improvement made

Although the usability feedback was overwhelmingly positive, we identified small enhancements that could further optimize the user experience:

1. Enlarged Buttons:

• Reason: Larger buttons improve accessibility for users with severe motor skill limitations, reducing the likelihood of errors during interaction.
• Action Taken: Increased button size slightly across all screens for easier tapping and improved visibility.

For example:

Before:

After:

These changes were implemented to future-proof the app and ensure it accommodates a broader range of accessibility needs. While the initial design was well-received, continuous refinement ensures that the app remains user-centered and inclusive.

Privacy and Confidentiality:

Users were assured of their privacy and the confidentiality of their feedback, fostering honest and open responses.

Summary

The usability testing phase was crucial in evaluating the accessibility and user-friendliness of the Book MyBus app. Through two cycles of testing, we gathered valuable insights from three users with accessibility challenges similar to our user persona, Tom Harris.

The results showed that the app successfully met its objectives, providing a seamless experience with features like large buttons, voice-to-text functionality, and a clear navigation flow. Users expressed satisfaction with the app, noting its ease of use and intuitive design.

While no major issues were identified in the feedback, minor improvements—such as enlarging buttons, enhancing feedback for actions were implemented to further optimize the user experience. These refinements ensure the app remains accessible and inclusive for a diverse range of users.

Overall, this activity reaffirmed the importance of iterative design and user feedback in creating a functional and accessible app. The positive testing outcomes highlight the app's potential to serve as a reliable and user-friendly solution for bus booking. 

Thank you!