Skip to content

Agile User testing a mobile app prototype with Userlytics and Justinmind: your checklist

 By Userlytics
 Aug 01, 2017

Agile User testing a mobile app prototype with Userlytics and Justinmind: your checklist

testing mobile app

Before building anything, you should always understand the requirements, design a solution, and test it. User testing allows you to determine if people are going to understand or like your product. The earlier you get the feedback, the sooner you can know what people are struggling with and what is worth fixing. Your goal is to verify ideas and correct mistakes before spending time and money developing a solution.

Agile environments break down problems into manageable steps and quickly create solutions. This invites the process of designing and user testing early and consistently before investing in development resources.

Prototype testing asks participants to view prototypes or wireframes on a device. Often you’re testing how viable a design is. It is good to test early on static images, wireframes, or functional prototypes. Tester feedback will help with the success of the app, as you will be making incremental updates.

Use this checklist to help you create your next prototype and test it using Userlytics and Justinmind.

Creating your Mobile Prototype

Add realistic information
Content drives a lot of decision-making for users, and it also helps clarify information and definitions. Make sure you replace any placeholder text with meaningful text, and provide useful images.

When creating a prototype, ensure that there is consistency. Focusing on the design and flow, you want to make sure all of the text makes sense, the labels are consistently updated, and all of the links and buttons that you want to work, work.

Using Justinmind
One of the most advanced tools available to create a prototype is Justinmind, which allows you to create interactive prototypes without code. If you’re not sure what your app will look like, it comes with a lot of polished user interface elements and kits to use. This will save you time from creating a design from scratch, and allow you to focus on the flow and layout. If you need some inspiration, Justinmind also provides useful templates to build from.

Prevent users from having to figure out the correct path by making everything that is clickable, look clickable. With Justinmind, you can create clickable hotspots, regions, or links; and add events to make them look clickable.

Preview event effects

When you’re ready to add more fidelity to your prototype, select interactions for your elements. Not only can you customize with user events, but you can add mobile gestures and transitions. These micro-interactions can improve the user’s experience and make it feel realistic with effects. You can also link files from Illustrator, Photoshop, or Sketch and not worry about outdated assets.

Add mobile gestures

When you want to create a mobile prototype, Justinmind integrates both portrait and landscape mode. Add responsive design by creating separate screens and applying user data to produce a result using expressions. Or integrate conditions, which makes it easy to account for error cases without interfering with the main user flow. You can also use dynamic panels to reveal different information based on the user interaction.

Add transition effects to dynamic panels

Testing the prototype
Go through the prototype and make sure what you want to work actually works. You may have forgotten a link or mistyped something. To avoid getting feedback from minor issues and wasting everyone’s time, spend the time to go through your prototype. This involves testing on multiple browsers and even devices. Justinmind allows you to test many different mobile devices, which can save you time from simulating it on a browser.Creating your test

Imagine a situation where you would like to bring people into your office and ask them to test a prototype you created, but you need to:

  • Include participants outside of your geographic area
  • Observe participants in their natural environment
  • Receive feedback in a reasonable time frame
  • Find a reasonably priced test method
  • Test in a scalable manner
  • Iterate on your prototype

Combining the iterative and easy design power of Justinmind with the scalable & personalized user testing capability of Userlytics allows you to do just that.

The goal with running your test is to see if people can understand and interact with your application with a minimum (or no!) obstacles and misunderstandings. The results will help improve your navigation, content, and layout.

Use the right words
Avoid leading tasks or questions and situations where people can give you “it depends”, or simple answers like “yes” or “no”. Encourage open-ended questions that make sense.

Ask people directly what they have done in the past, not about hypotheticals or what they would do. When asking about frequency, specify a time frame like “In the past two weeks, how often did you purchase something from a grocery store?”

Unless you want to test the user’s knowledge of technical jargon, define key terms or concepts in the questions themselves. Instead of asking someone where the “Help Centre” is, ask them to find where they could find answers to their questions.

Think about the format
Create well-defined tests using a neutral language. Know what your objectives are – are you testing for comprehension, or comparing your Justinmind designs? The format of your test will change drastically depending on your objectives. If you want to test a feature, set specific and closed-ended tasks. If you want general opinions about your app, set open-ended tasks

Break up your steps by asking several specific questions rather than a broad one. Instead of asking about people’s overall satisfaction with a website, you can ask about specific things like the quality of information or visual design. To understand your interface, provide descriptive instructions like “you want to purchase bananas” rather than prescriptive ones “go to the menu and click fruit.”

Consider if you want to use direct or scenario tasks, where you can directly instruct users to accomplish a task or provide a scenario to achieve the task. There are also closed or open-ended tasks, where closed-ended tasks have one successful outcome and open-ended tasks can have many paths that lead to a successful outcome.

Make sure you provide enough context for testers. To ensure feedback is provided at the proper time and place, remind users where they should be by providing a URL or an explanation to know where testers should be when answering a question.

Ask for users’ opinions throughout the application and at the end of the test by answering survey questions, and providing a rating scale. Also ask for their comfort level and how difficult they saw a task.

Figure out your target users. User testing platforms like Userlytics are flexible and allow you to define your test audience with advanced screeners and demographic filters. You may be interested in a specific demographic like location and require screeners like expertise or background or behaviour.

Also figure out the number of users you are testing. Depending on your needs, five participants can be sufficient, but 10-15 can be normal. Regardless of the number, it is more important to have numerous test iterations throughout the design cycle rather than many participants in each iteration.

Emphasize that you’re testing the system, not the user. Ask a question like “the site caused me to feel confused” with a “Yes” or “No”, instead of asking if users were confused.

Nielsen Norman Group provided a list of writing good usability tasks and a usability test checklist.

Using Userlytics with Justinmind

Instead of dealing with cameras and apps, Userlytics leverages the technologies a participant will likely have. When testing on mobile, there’s a cool feature where you can project your mobile device screen onto a computer, where the instructions are also displayed, without blocking the limited real estate of a mobile device.

Pilot testing with Justinmind
Before testing with multiple users, always run a pilot test in case you can improve a few prototype glitches and clarify wording. Make changes to the user testing script so you can make the testing experience optimal and ensure you’re testing the right things.

It’s very easy to create tests with Userlytics, all you need to do is make your Justinmind prototype public and copy the URL.

hyperlinked inline video annotations of key user experience issues

Analyzing with Userlytics
When analyzing videos, Userlytics allows you to write annotated notes about a participant’s video, directly online, and automatically added to an aggregate list with each annotation hyperlinked directly to the relevant video and timeline moment. You can write about how they struggled during a task or whether they were unsure how to proceed. After your notes, look for trends and organize your findings into categories like location or task. You may need to jump back to a part of the video, which can be done with Userlytics. After, you can determine the severity of the issue and bring back your findings to your team.

picture-in-picture user testing videos
annotating user testing videos

Tests should be shared to ensure that your teammates understands the issues. Userlytics compiles the metrics, annotations, and videos so you can easily share with others, on a project by project basis. Justinmind also allows you to share prototypes and provide contextual comments.

prototype user testing with justinmind & userlytics
mobile prototyping
mobile prototype user testing

Smaller tests may only need to be shared with other designers, but you should bring in other teams for bigger tests.


Didn’t find what you were searching for?

Related posts

You have been working hard and investing a budget on your latest product -you can't wait to get it in front of end users after an arduous design process. But you're also aware that the success of a product or service depends
AB Testing UX As businesses strive to stand out in competitive markets, their success hinges upon understanding and catering to the needs of their users. After all, an exceptional user experience not only fosters customer loyalty but also drives conversions and ultimately
Designing Meaningful Experiences in a Globalized World In today's interconnected world, it is crucial to design products and services that cater to diverse audiences. To achieve this, user research must be situated within the context of global design, considering the social, economic,
As UX researchers and designers, we understand the critical role that user experience research plays in creating successful products that meet the needs of our customers. However, conducting research is only the first step in the process - effectively communicating the findings
In the world of user experience (UX) research and design, stakeholder buy-in is crucial for success, though it is often a point of contention for practitioners who aim to prioritize UX in their organization. Without the support of stakeholders, UX research can
In today's digital landscape, creating a seamless and captivating user experience (UX) has become the cornerstone of success, regardless of the industry you are in. Testing digital assets is one of the most critical aspects to staying competitive. However, it is not
It’s no secret that a well thought out and engaging digital user experience increases sales as well as a loyal customer base. But what happens when your customer base extends into different countries and cultures? Do you copy, paste, and translate your
For years if not decades top management executives from large corporations have talked about how the user experience (UX) of their customers is a top priority. However, a quick & easy user test of even some of the most important and well
What’s the difference between a great user experience and a tolerable one? One might say the high-level stuff, like layout and design, but ultimately it’s in the details, or microinteractions. Microinteractions often make or break a digital user experience. When done well
Accessibility is a crucial aspect of creating digital products that can be used by as many people as possible. When designing a digital product, it's important to consider accessibility so that everyone, including those with disabilities, can access and use the product
They say finding love is one of the hardest things to do as a human being. We’ve been fed this narrative our entire lives, with movies, books, and songs all focusing on how impossible it is to find “the one.” Even in
User Experience (UX) has become a critical differentiating factor for businesses. To meet users' evolving expectations, UX research plays a pivotal role in understanding user behavior, pain points, and preferences. In this context, with the rapid advancements in Artificial Intelligence (AI), UX
UX designers strive to create intuitive, seamless, and delightful experiences for users —whether for websites, mobile apps, or prototypes. And one of the key components in achieving this goal is user research, a crucial phase where UX experts strive to understand users,
Things to be Thankful for: Advantages of Professional Peer Support in UX Research Thanksgiving is a time to reflect on all the things we are thankful for. As user researchers, we are thankful for the ability to connect with our peers and
2022 has been a busy and exciting time at Userlytics. We’ve launched several new features and capabilities, including sentiment analysis, accessibility testing, the ULX score, and VR testing. These newly implemented tools were designed to enhance your experience and provide you with
As staples of nearly all research conducted today, many people think they know about the differences between qualitative (qual) and quantitative (quant) testing. However, in the context of user research, these two methodologies are often used interchangeably. So, when to use one
Understanding what democratizing user research means is not as simple as searching for the definition online, or asking a colleague for a quick summary. In a general sense, the universal definition is “providing all stakeholders with access to user insight and UX
It's no secret that a good website or app user experience is crucial for boosting sales. In an offline location such as a store or restaurant, being physically present may keep a prospect even if the experience is subpar. But in an
In the ever-evolving realm of user experience (UX) design, research acts as the compass that guides designers towards creating delightful and intuitive digital experiences. As UX designers, we understand the vital role research plays in uncovering user insights, informing design decisions, and
As a UX researcher or designer, it's important to have a clear understanding of your target customer before beginning a remote UX study. Target user research is crucial for designing user-centric products and services. It helps ensure that the end result aligns
User research is an essential part of the UX design process. It helps us to understand our users, their needs, and their pain points. It provides the foundation for ultimately shaping the success of a product or service. However, without a systematic
In remote user experience and usability testing, there are a variety of factors that contribute to valuable, authentic user data that can be used to improve your brand’s user and customer experience. Among those factors are the quality and authenticity of the
Are you thinking about doing some user testing on your website, app or prototype? Are you currently weighing up the different options available to you? Should you use a free video-conferencing tool or a paid user testing platform? What are the differences
If you visited a complex website and found everything you were looking for with ease, it was unlikely a coincidence. A well-designed website structure is often the result of careful user research and testing, following information architecture principles and best practices. So
While remote user experience testing significantly enhances researchers' ability to reach test participants, these participants’ technical skills and access to technology can often vary greatly. Therefore, it is important to design and administer remote tests that facilitate participants' varying technical skills and
Userlytics prides itself in being a truly global platform. With over one million panel testers in over 150 countries, we are happy to say that we are able to find and test your target customers, wherever they may be. With the inception
In today’s highly digital world, cybersecurity is of the utmost importance when running day to day business operations. As usability testing grows in popularity, so does the need to choose a UX platform that values your company's privacy and security. But how
Userlytics makes user experience testing easy, efficient and fun with its state-of-the-art no-download web recorder. This revolutionary user experience testing recorder allows participants to jump right into usability tests directly with a simple click of a button; this means you can more
2021 is a year dedicated to the customer. Businesses are moving away from organizational-centric strategies and thinking more and more about the needs of their customers. But what exactly do customers want? Customers want their experience with brands and digital assets to
Moderated testing sessions are a great opportunity to get thorough and instant feedback from users all around the world. This type of testing involves a live, online interview where you are face-to-face with your users via webcam, asking them questions, guiding them
Researching the ins and outs of your business is integral to setting your company up for success. Increasingly, fine-tuning and improving your customers’ brand experience has become one of the top priorities for businesses. With customer expectations being at an all-time high,
Are you a UX researcher who mainly conducts in-person studies and you’re looking for some online alternatives to get you through this unusual period of lockdown and social distancing? Or perhaps you’re someone who is starting their path down UX enlightenment, looking
Given the current world health and associated economic crisis, Userlytics ran a qualitative moderated ("Live Conversations") user experience study with participants in the US to determine how respondents’ online shopping behavior has changed as a result of the pandemic. The following is
Picture this: an online shopping user clicks on a product they like but the description does not say everything they need to know before making online purchases; key features, pricing and availability, or shipping and return information -strike 1. To find out
The Best and Worst UX in the Travel Industry Finding the best flight deals online can be an exhilarating experience. Almost every booking site today promises the lowest fares available and, in some cases, even a price match guarantee. With such a
Last November 18th our CEO was interviewed by Ditsa Keren, of Website Planet; Here are some excerpts from the interview: “If we take a step back and think about how software has evolved over the past 15 years, the cost and time
Designers are prone to falling into the trap of cluttering their interfaces. Limitations of space often push them to the wall, and they find themselves trying to fit everything they can into a tiny usable space. The unique problem that the modern
How Can Bad UX Influence Your Conversion Funnel? Source: Shengjun Shi Regardless of whether you sell a product, offer a service or run a blog, any visitor comes to your site with simple goals like consuming or gathering more information. The user experience
From initial concept to finished draft, tips on how to craft an effective unmoderated user study A user test is a little bit like cake: you know what a great one looks like, but you’re not quite sure how to go from
Apple has recently entered the race with its Homepod. Which of the two current leaders, Amazon's Alexa (Echo) or Google Home, provides the best user experience? Interactive Voice Response (IVR) systems used by banks and utility companies provide some of the clearest
February 22th, 2018 Usability testing data is a sure-fire way to eliminate guess-work and focus on making the UX design process more effective. These types of user tests can help you figure out if your audience can adequately use your website or mobile app. Additionally, they help
In theory, every company these days is customer-centric and has a mobile-responsive design process, and yet a surprising amount of companies haven't updated their online stores or platforms accordingly. Many of them are not leveraging the benefits user testing can bring to their business. Today's
Online shopping is not a new concept. According to statistics, about 80% of Americans are shopping online these days, some exclusively, with zero visits to actual physical stores. With years of experience of e-commerce design and user research, one would think major e-commerce sites
Turning visitors and prospects into paying customers is about more than good advertising and slick SEO. Users are savvy enough to tell the difference between good and bad UX, and it can often be the differentiating factor between a single visit and
Are you delivering the best user experience for your website and mobile app visitors? You may think your website or app offers seamless navigation, intuitive form usage, and an effective way for users to interact with the information being provided. However, the real question is: What
By Mark Hall, Guest Blogger.An e-commerce and Customer Research Expert who has consulted for over 20 years with a wide range of clients including AT&T, American Express, Edmunds, SpyTec and the California Lottery. When not working, Mark enjoys playing saxophone, mountain biking
Everybody working in the IT industry has seen a number of case study videos, where users talk about glitches in software, unavailable options in apps, and their ideal features and interfaces. Running a remote unmoderated usability study seems to be an easy way
The conflict between qualitative and quantitative user experience research methodologies has its origin in a time when computers were only a dream, and with the emergence of the social sciences over a century ago. It lies in a struggle that is much older than
How to tell the difference, and when to bring both into your projects In the world of User Experience Research, there’s often some confusion surrounding the difference between User Studies (and user research in general) and User Acceptance Testing (UAT). In the
Quantifying how good a user experience is, or how well a site meets the needs of its users, can be a difficult task. We can look objectively at metrics like time on task, or success/failure rates to determine user behavior, but they

Let’s work together on your next UX study.

Create positive user experiences and keep customers loyal to your product and brand.

Analytics tells you what,
Userlytics tells you WHY.