Lean User Testing Methods : Test Before You Build


User testing is a vital part of UX Design, and in some cases overlooked due to the belief it’s too expensive or it will take too much time. You can sketch, conceptualize, research and design all you want but at the end of the day, the proof is in the testing. How your intended audience interacts with your product, what motivates them to return and engage and how they perceive it is the pure definition of UX. With so many affordable testing resources now available, it can be done quickly and with minimal costs. Test early, get it out there and get feedback.

Guerilla testing is a popular topic in the debate of how to conduct user testing. This model speaks of testing constantly and using friends, co-workers or even random test subjects at a local coffee shop. As this approach may work in instance such as organizing content or concept testing, we find that the best results of in-person or remote testing come from people who are actually going to be interested in using your product. Stay focused on your core demographic and test to that audience. Testing random subjects that will never use or engage in your product may not always produce the most effective result in the long run.

Every project has different goals, needs and budgets; therefore some projects may require special types of testing. Here we explore the concept of Lean User Testing, coupled with Lean UX principles:

1. Define the Product Goals

The first step to conduct with your client is to define the product goals. This is key for a results driven process. This may seem like a no-brainer but a strong concept with clearly defined requirements can keep your team focused, cut down on debate time and keep everyone energized. Typically there are three types of product goals: creating an addiction/habit, meeting a certain business structure or owning an experience.

2. Tree Testing & Card Sorting

Tree Testing allows you to see how well users will interact with and find elements in a website or application’s hierarchy. It reveals whether the information architecture is easy to understand and can help with naming conventions that make sense to the user. This is extremely beneficial if the client insists on creating clever or unique navigational titles. Within tree testing, the user is given questions and looks for items in established categories, similar to actual browsing behavior. This can dramatically improve the navigation or taxonomy. Card sorting allows users to organize items into groups and then categorize and label the groups.

Optimal Workshop is a great platform to test both tree testing & card sorting.

3. In Person Focus Groups

Testing concepts, content, experience and design may be the most effective solution in-person, but it also can be the most time consuming and expensive route to go. To actually watch someone use your product and see their immediate emotional reactions can be something that you miss from remote user testing. To produce the best results, the interviewer must not be biased to your product or the user have any background information before the testing session. This way no party is being swayed to certain opinions as they use your product for the first time and can honestly react. For smaller companies that cannot seek a 3rd party testing vendor, Craigslist can be a good option to round up your specific demographic to participate in a user testing group. This can get tedious on your own however and can be very time consuming. The most effective methods are those that allow you watch and interview real users while they interact with your product or service. Focus groups allow you to extensively see a group of users interacting with each other to discuss an idea or a concept. This can lead to new levels of inspiration as you will gain more insight from the ideas of the group.

4. Remote Focus Groups

With the advancement of online testing resources, this can prove to be the most cost and time effective solution for start-ups or smaller agencies on tight budgets. Remote testing allows you to conduct testing from the comfort of your own desk, by computer or telephone. This can also be implemented throughout the whole process of development, from beginning to end.

User Testing is a great option as it records a video showing the user as they use your site/app and captures their thoughts and touchpoint as they interact with it. You pick the core target audience and assign the user a task to perform that can be run on desktop, tablet or mobile device. You can hear the tone in their voice as you watch the ease or struggle while they navigate. The only downside to this may be that the users thought process might not seem as clear as it would in-person.

5. Google Analytics & A/B Testing

A great way to keep on testing, refining and making your product better is to gather analytics and re-asses user pain points. Then create A/B versions to test against each other and gather new analytics on how to improve your product. To put your design to the test you’ll need to subject it to actual website traffic by randomly assigning visitors one of two design options (A & B) To determine these differences you need to test each design. Tracking how customers are using the interface is detrimental to a product’s ongoing success. You can get metrics that track Call to Action clicks, high exit paths and generate funnels to see how long customers engage.

Another option with even more power than Google A/B Testing is Optimizely.

There are currently a great number of online & in person testing facilities and sites that offer many  other options that we have not touched upon. As UX strives to simplify, testing can be done simply as long as the right goals and structure are setup initially and a clear goal is set. If the testing becomes too complex and drawn out then the product has become too complex.

The Strategy Behind Delight

Jeremy Duimstra

Technology, user experience and interface design are converging to transform the digital world around us. People using technology have come to expect to be delighted when they spend their precious time in front of a screen. At MJD, we’ve found four essential ingredients that go into making a user experience pleasurable: Personalization; Being In Context; Intuitive; and Minimalism.

No one wants to be a “user”. We are all unique individuals with different experiences and expectations of the technology we choose to use. One of the first attempts at personalizing our digital experiences brought the creation of user profiles. Create a profile and be greeted by name the next time you login – neat! The profiles that we’ve all created have now been augmented by big data. Every social network “like”, every purchase, and every search builds the digital information around each of us, so the experience feels like a real, even human-like interaction. While there are privacy concerns at play here, we are seeing evidence that people will give some of this information away in exchange for highly personalized, and thus useful, experiences.

Take retail subscriptions for example. Big data and artificial intelligence algorithms can determine exactly when my wife and I are two diapers away from a minor household catastrophe. When the delivery of a new case of diapers arrives at our door the very day that we’re about to run out, I am not only delighted, I have become a raving fan of that service. The e-commerce site seems to know me. That’s true personalization.

The second theme we’re seeing in the design of digital products is the delivery of content that is in context with your current environment. The sensors in our devices know a great deal about us. An alarm can go off in the morning, accompanied by music that fits the mood of our calendar that day. As we get in the car for the morning commute, our mapping app can inform us that traffic is heavy and recommend an alternate route. While driving by our favorite coffee shop, our loyalty point app can let us know that we have a free cuppa Joe beckoning. All of these prompts are done in context of the place and time in which we’re currently present.

Having an intuitive interface isn’t just a no-brainer; it should actually require no brain. The technology needed to build even relatively small digital products is incredible. Thankfully, we have decades of hardware and software design to build upon for each new thing that we produce. But that layering also creates exponentially complex systems. Those systems need to be hidden from the user interface. The best interfaces are the most simple and the most intuitive, while accessing the robust technology under the hood. Which leads us to our final, crucial ingredient of a pleasurable digital experience – minimalism.

In our view, pleasure isn’t derived from interfacing with a digital contraption of some kind but, rather, by enhancing a human experience. It’s important to strip the clutter from someone’s life, not just their user interface. The best products simply make things easier; they minimize the noise and chaos of everyday life. The hardest thing to do as digital designers is to collapse a feature set. We fall into the same trap as our clients by attempting to create a product that does all things for all people. Truly delightful products do a minimal number of things extremely well.

Ultimately, pleasure – the pleasure in experiences, things, gadgets and even people — will influence how much and even how often we choose to interact with them. This delight is the driving force that pushes us to fulfill our most basic needs. By incorporating these four essential ingredients into their digital products, companies will enhance the pleasure of their users’ experiences and meet those needs at the core level.

2016 Best Places to Work in San Diego!

Jeremy Duimstra

MJD was recently named as one of the Best Places to Work in San Diego. The annual list of the Best Places to Work in San Diego was created by the San Diego Business Journal, Best Companies Group, and their sponsor Kaiser Permanente.

This survey and awards program was designed to identify, recognize, and honor the best employers in San Diego, benefiting the county’s economy, workforce, and businesses. The list is made up of 100 companies split into four categories: 42 small-sized companies (15-49 US employees), 28 medium-sized companies (50-249 US employees), 18 large-sized companied (250-1,999 US employees), and 12 mega-sized companies (2,000 or more US employees). MJD has been named one of this year’s Best Places to Work in San Diego in the Small Business category.

MJD has experienced tremendous growth over the last few years, and continue to hire in both their San Diego and Los Angeles locations. See a list of current openings.

To be considered for participation, companies had to fulfill the following eligibility requirements:

  • Be a for-profit, not-for-profit business or government entity;
  • Be a publicly or privately held business;
  • Have a facility in San Diego County;
  • Have at least 15 employees in San Diego County;
  • Be in business a minimum of 1 year.

Companies from across the county entered the two-part survey process to determine the Best Places to Work in San Diego. The first part consisted of evaluating each nominated company’s workplace policies, practices, philosophy, systems, and demographics. The second part consisted of an employee survey to measure the employee experience. The combined scores determined the top companies and the final ranking. Best Companies Group managed the overall registration and survey process in San Diego, analyzed the data, and determined the final rankings.

The list-making companies will be honored at an awards ceremony on August 11. A special issue of the San Diego Business Journal that profiles the companies selected as the Best Places to Work in San Diego will be published on August 22.

For more information on the Best Places to Work in San Diego program, visit www.BestPlacestoWorkSD.com.