Testing the paper prototypes

After creating paper prototypes we have evaluated those prototypes by conducted four different testing sessions with users. We have selected 3 main tasks for these sessions and provided to users to perform those tasks.

Here the list of our selected three main testing tasks scenarios: Testing Tasks and paper prototypes screenshots.

Summary

Overall, the testing procedure was quite good, the three tasks were easy, self descriptive, presentable and have some common functionality as well. All the tasks were performed by users with minor difficulties, we have also received lot of small suggestions and 1 big suggestion/change. It was also challenging to perform these tasks on paper prototypes by acting like blind user.

Search Location, was our first task it was more a like filtering task to find particular room. All users performed it but felt that it is very hectic and laborious job for blind people to navigate on multiple screen for selecting/searching desired place.

This was the main concern of users, and it poked us to rethink for another approach to perform this functionality as more reliable and perform-able for blind users.

Our second testing tasks, Bookmark location was simple and performed easily, because all the steps were same and we only need to add 1 more step to perform this task, a Bookmark Location popup window on search results.

The main concerned was raised by users is that why popup window?  What would be if I want to listen to the voice messages again? These were valid concerns because popup window appeared immediately after last instruction and then instruction disabled and users cannot perform until they click on back button or bookmarked this location button.

Our last task, Selection from Bookmarked Locations, all the users performed without any difficulties, but 1-2 users were concerned about a delete feature for old bookmarked locations which was not included. This called for modification to include a delete option to remove already bookmarked location.

Most commonly appeared issues

  1. Too much time taking process for searching a particular location.
  2. Popup window for location bookmarking
  3. No autoplay for voice messages
  4. Delete bookmarked locations
  5. What happens when a user doesn’t know the room number?
  6. Back and home buttons on top of the screen

Post Test

After our testing with 4 users we have also performed one post testing after implementation of an issue #1 (search location). We added speak-able keypad with big numeric buttons like below image and the user said it is good, easy and more applicable for blind users

5

User also suggested one more thing to add voice recognition for searching particular area/location, but this is a big and more complex change but we plan to have this included in our future tasks list.

Test #1 Feedback

  1. Remove navigation screens for filtering location
  2. Add search location by entering room/area address
  3. Add voice recognition
  4. Autoplay instructions
  5. Add map on screen with all locations and user know about location by clicking on map
  6. Current location indicator when user lost or want to know surroundings

Test #2 Feedback

  1. Remove navigation screens for filtering location
  2. Add search location by entering room/area address
  3. Autoplay instructions
  4. Remove popup window
  5. Add button on top or bottom (we have done this by adding the bookmark option in instructions list at the end)

Test #3 Feedback

  1. Remove navigation screens for filtering location
  2. Add search location by entering room/area address
  3. Remove navigation screens for filtering location
  4. Add search location by entering room/area address
  5. Add voice recognition
  6. Delete bookmarked locations

Test #4 Feedback

  1. Announce initial location
  2. Search by map by tapping on screen
  3. Remove navigation screens for filtering location
  4. Add search location by entering room/area address
  5. Add voice recognition along filtering process
  6. Delete bookmarked locations
  7. Generate voice messages on hover and long press for selection