DROID HOMES
USABILITY TESTING
Context: Droid Homes is a complete Smart Homes solution. It is an android mobile application that helps users to access home utilities (switches and electrical appliances) remotely using their smartphones. Droid Homes provide a personalized way of automating one's home. They provide features such as a live thermostat, remote access to all appliances and switches and an alarm system, they also provide the user with an embedded house floor plan. Droid Homes let users use the application and their regular switches simultaneously. It also has a feature called geo-fence which allows users to get notifications on their smartphones when they leave the house with any switches on.
THE CHALLENGE
Startups are always changing; making improvements and adding features to their core products. However, changing by addition often makes products more complex; essential features and experiments compete for focus and users get lost in different flows.
Since the beginning of 2016, DroidHomes introduced a lot of new features; from geofencing to inspire newcomers to remote operating feature in a product to give the unique feature to operate the light switches during the trip; even the business model was changed.
A user testing was crucial to check the product health; making sure users still achieve their goals by using DroidHomes Mobile Application.
Our high-level goals were to:
1. Map usability problems to make the experience more frictionless and intuitive.
2. Understand user behavior & get the main doubts about the product.
MY ROLE
I worked as a UX Researcher on this project. Some of my responsibility included:
-
Conduct pilot testing and observation.
-
Evaluate the overall effectiveness of the system by asking a user to perform the basic task.
-
Keep the user engaged so that they don’t discontinue the use of the application
THE PROCESS
Understanding the
Application
User Interviews
Identify the Pain points of the user
Suggestions for the future
User Testing and Evaluation
Brainstorming Session
TARGET AUDIENCE
Who were the users?
User Demographics of the product:
People looking for a smart home system which lets them control and monitors their appliances remotely and does not want to change any existing installations in the house can use the product.
AGE
The product is targeted at people of age group ranging from 18 - 60 years.
GENDER
The product can be used by anyone irrespective of their gender.
EDUCATION LEVEL
PROFESSION
The product mainly targets customers who are house/flat owners, builders, architects and interior designers.
INCOME
Since the product is for house owners, most people with income above average level are targeted.
HOME/ BUSINESS LOCATION
Can be installed in the home as well as office spaces.
LANGUAGE
The product requires users to know the English language.
PERSONAS
Age: 25
Work: Software Engineer working in a multinational software company
Family: Single
Location: Indianapolis
Character: Curious about new technologies
Frustrations
-
Has to travel 3 hours every day to the office using public transportation
-
Work in various shifts and sometimes he also visits client locations for work issues
-
Forget to turn off the home appliances because of his busy work schedule which led to many dangerous situations
-
Increase in electricity bill
-
Had to travel back several times
-
Delayed client meetings and untimely office hours have led to a delay in project deadlines. This has eventually affected his work performance
Goals
-
Understand the application more and how it operates
-
Utilize maximum features in the application so that he can concentrate on his work
-
Learn about the features which will tell him the status of the light switches
Age: 46
Work: Works from home as a Tax Consultant
Family: Widow
Location: Chicago
Character: Old enough but easily accept the change
Frustrations
-
Restrictions in the moments because of the accident and complicated injuries
-
Not familiar with the latest technological applications
-
Difficult to access all the switches
-
Her apartment is enforced by strict rules, she is not allowed to make any changes to the electrical circuits
Goals
-
Turn on/off light switches remotely
-
Utilize the alarm feature as it turns on/off light switches according to the time user has set
USER RESEARCH
EVALUATION METHODS
We as a team evaluate the application, Droid Homes using Think aloud test, Heuristic Evaluation and Cognitive Walkthrough.
Think aloud test
Heuristic Evaluation
Cognitive Walkthrough
This protocol used to gather information from the user. In this case, we asked the users to use the mobile application and gave a certain task to complete. While completing the task I observe the users and noted down their thoughts.
As an evaluator examine the interface of the I tried to judge its compliance with the recognized usability principles.
The method used to identify the usability issues in the interactive system. While examining the application my focus was on how easy it is for new users to accomplish tasks with the system.
RESULTS
1. The task of creating colors in mood lamps had the lowest completion rate.
2. Users faced the problems while selecting the switched when given the task of setting alarm.
3. A system was not giving the appropriate feedback.
ISSUES
Issues
-
Room layouts are non-functional
-
Misguiding mood lamps button
-
Incorrect title
-
Time zone issue
-
Selection of days
-
Add button- from where the user can more timings
-
The current state of switches- whether it is ON/OFF
Recommendations
-
3D view of the room which communicates the status of light visually
-
Provide an accurate title to each screen
-
Display time from where the user is operating the application
-
Show the days the user has selected
-
Select the contrasting colors
ADDITIONAL SUGGESTIONS
-
The navigation can be improved
-
The floor plans can be presented to the users in the 3D view
-
More functionalities can be developed to keep pace with similar existing market applications such as door locks, fire alarms, and anti-theft systems.
USER FEEDBACK
THE GOOD
-
“I tend to leave some of my switches on when I am in a hurry to leave for work. This app will definitely help me to access my switches from office.”
-
“I liked the mood lamp feature as it would help me to adjust the light color in my child’s room.”
-
“This app will not only help normal users, but it will also help people who are handicapped and tend to rely on others to access the switches.”
-
“Easy to use once I can anticipate it’s quirks.”
THE BAD
-
“The application only supports Android platform. iOS users like me cannot use it.”
-
“Would prefer not to use this application unless I have no other alternatives.”
-
I would not have known that there were 3 states of switches in an alarm screen unless I was made aware of it by you guys!”
-
“Application was not easy to use due to inconsistencies with navigation and tiny buttons.”
-
“We would like to see the 3D view of the room instead of 2D images that do nothing.”
It can be used by anyone depending on their capabilities of adapting to technologies.
Interview + Observation
-
We conducted our interviews and usability testing on 10 participants who fit the primary user profile of Droid Homes.
-
To know their demographic information, we created an online demographic questionnaire survey which revealed various characteristics of our participants.
USER RESEARCH
Observations
Interview
Participants