Skip to content

Best Practices for Remote Moderated UX Testing

 By Userlytics
 Mar 01, 2021

Best Practices for Remote Moderated UX Testing

Moderated testing sessions are a great opportunity to get thorough and instant feedback from users all around the world. This type of testing involves a live, online interview where you are face-to-face with your users via webcam, asking them questions, guiding them through tasks, and viewing what they do on screen as they respond to your instructions. Although the process may initially seem intimidating, you don’t need to have years of training or experience to be a great moderator for remote usability testing!

How to Prepare Before your Sessions

To prepare for a moderated testing session, the best approach is to practice beforehand and focus on your goals. What do you want to know more about? What specific issues do you need to test? What do you want to accomplish? The more fine-tuned your goals are, the easier it will be to develop questions and tasks for the user to complete during your session.

Write down your questions and tasks. Practice your moderation with a few dry runs. Stay flexible; knowing your product forward and backwards will help you stay present throughout the session. The types of questions you ask may depend on the specific user and the decisions they make. In your practice runs, go through all the steps and play out any scenarios you might encounter. Prepare yourself to encounter potential problems. The more you practice, the better; this will prepare you for a myriad of situations and outcomes.

Starting the Session

Start the session off by introducing yourself to the test participants, and explaining that you are a moderator and will be asking them some questions. Make the participant feel comfortable by letting them know you are simply asking for their feedback and opinion on the product. Make sure to remind your participants that you want genuine, honest feedback; there are no right or wrong answers. Explain only what the user absolutely needs to know about your product: for example, that you are working with a prototype, or there are some parts of your product that aren’t finished. Try not to explain too much about what you are testing to prevent any bias; you want a fresh pair of eyes on the platform being tested and an open mind.

Asking a few background questions or starting with an icebreaker can make things feel more personal and comfortable. Once you have introduced yourself and heard from your user, one of the best ways to start off a session is by setting up a scene or giving a scenario. For example:

“Imagine you are looking for a coffee machine that fits your tastes.”

“Let’s say you were conducting a search for a new camera and you came across this page.”

Providing a scenario sets the stage. It gives users a starting point from which they can begin their personal user journey. It also helps them better understand where they are in the product, and gives them a goal or purpose.

Asking the Tough Questions

In moderated sessions, the moderator is always a potential source of bias. The best way to avoid this is to be as neutral as possible. Conduct your session as if you were a scientist. You are not a part of the user journey; you are an observer of it. Do not ask leading questions that might influence the user’s answers, for example, question like:

“What do you like about this product?” (Assumes the user likes it)

“What about this product was difficult to use?” (Assumes the user has found it difficult)

Instead, use expectation questions. Ask the user what they expect to happen. Ask them if it meets their expectations. Request that the user show their usual or past methods of naturally doing things.

Ask “what” and “how” questions like “What would you do next?” And “How would you find this?” 

When a user makes a statement, like “This part is confusing,” ask probing questions such as “What about it makes it confusing?” or “Where would you find more information?” Getting deeper into the user’s thoughts and behaviors will get you better feedback. Probing questions are good to use throughout the entire session. Asking your participants probing questions any time you hear a comment that interests you, or any time you or the user want further clarification.

Respond to questions with questions. If the user asks a question like “Is this supposed to be this way?” respond by asking “Is that what you think it should look like?” or “What did you expect it to look like?” Don’t answer their questions directly unless they encounter some kind of technical issue or bug that you may need to guide them through.

Additionally, avoid yes or no questions. Avoid asking questions that can be answered with a single word. Some good examples for question starters:

“What do/did you think about…”

“What are the pros and cons of…”

“How difficult or easy was…”

“What would you do if…”

Letting the User Go

The best moderated session is one where the user journey is completed in the most natural way, while insights are picked up along the duration of the test. You may find that, for some parts of your session, being quiet and allowing the user to do as they naturally would is your best bet. Setting up a scenario or scene helps out with this; situate the user to start, and let them do as they normally would from there, asking probing and expectation questions along the way.

Keep your goals in mind throughout the test. What do you want to learn from this session? What do you expect the user to do, and what tasks do you need them to complete? Practice makes perfect, and there’s no such thing as being over-prepared. Keeping your goals in mind throughout the entire process will get you better insights, and in turn, allow you to more easily incorporate those findings into your product.

About the Author: Userlytics


Since 2009 we have been helping enterprises, governmental organizations, non-profits, agencies and startups optimize their user experience, or UX. With our state-of-the-art platform, massive global participant panel and unlimited accounts/seats for democratizing user research, we are the best all-in-one solution for remote user testing.

Schedule a Free Demo

Didn’t find what you were searching for?

Related posts

What’s the difference between a great user experience and a tolerable one? One might say the high-level stuff, like layout and design, but ultimately it’s in the details, or microinteractions. Microinteractions often make or break a digital user experience. When done well
Accessibility is a crucial aspect of creating digital products that can be used by as many people as possible. When designing a digital product, it's important to consider accessibility so that everyone, including those with disabilities, can access and use the product
They say finding love is one of the hardest things to do as a human being. We’ve been fed this narrative our entire lives, with movies, books, and songs all focusing on how impossible it is to find “the one.” Even in
Artificial intelligence, or AI, has recently made headlines due to a host of powerful and engaging tools that have gone viral across social media. Take ChatGPT, the chatbot whose revolutionary technology allows it to do everything from answering complex queries to generating song
If you're in the market for a remote user testing solution, you've probably come across a few of the following names, such as UserTesting, UserZoom, Playbook UX, UserBrain, UserFeel, LookBack, TryMata, Optimal Workshop, and DScout. All of these platforms have their advantages
Things to be Thankful for: Advantages of Professional Peer Support in UX Research Thanksgiving is a time to reflect on all the things we are thankful for. As user researchers, we are thankful for the ability to connect with our peers and
2022 has been a busy and exciting time at Userlytics. We’ve launched several new features and capabilities, including sentiment analysis, accessibility testing, the ULX score, and VR testing. These newly implemented tools were designed to enhance your experience and provide you with
As staples of nearly all research conducted today, many people think they know about the differences between qualitative (qual) and quantitative (quant) testing. However, in the context of user research, these two methodologies are often used interchangeably. So how does one know
Understanding what democratizing user research means is not as simple as searching for the definition online, or asking a colleague for a quick summary. In a general sense, the universal definition is “providing all stakeholders with access to user insight and UX
It's no secret that a good website or app user experience is crucial for boosting sales. In an offline location such as a store or restaurant, being physically present may keep a prospect even if the experience is subpar. But in an
For many researchers working in UX, quantitative data analysis can cause a lot of anxiety. UX researchers provide interpretations that can impact businesses with said data, which can be an overwhelming amount of pressure. There are many reasons UX researchers are often
As a UX researcher or designer, it's important to have a clear understanding of your target customer before beginning a remote UX study. This helps you make informed decisions about what to test, how to test it, and who to target your
If you’re a UX researcher, you probably already know how important it is to carefully consider every step of a research plan: You need to make sure you understand the problem space, choose the most suitable research methods, identify and recruit the
In remote user experience and usability testing, there are a variety of factors that contribute to valuable, authentic user data that can be used to improve your brand’s user and customer experience. Among those factors are the quality and authenticity of the
Are you thinking about doing some user testing on your website, app or prototype? Are you currently weighing up the different options available to you? Should you use a free video-conferencing tool or a paid user testing platform? What are the differences
If you visited a complex website and found everything you were looking for with ease, it was unlikely a coincidence. A well-designed website structure is often the result of careful user research and testing, following information architecture principles and best practices. So
While remote user experience testing significantly enhances researchers' ability to reach test participants, these participants’ technical skills and access to technology can often vary greatly. Therefore, it is important to design and administer remote tests that facilitate participants' varying technical skills and
Userlytics prides itself in being a truly global platform. With over one million panel testers in over 150 countries, we are happy to say that we are able to find and test your target customers, wherever they may be. With the inception
In today’s highly digital world, cybersecurity is of the utmost importance when running day to day business operations. As usability testing grows in popularity, so does the need to choose a UX platform that values your company's privacy and security. But how
Userlytics makes user experience testing easy, efficient and fun with its state-of-the-art no-download web recorder. This revolutionary user experience testing recorder allows participants to jump right into usability tests directly with a simple click of a button; this means you can more
Researching the ins and outs of your business is integral to setting your company up for success. Increasingly, fine-tuning and improving your customers’ brand experience has become one of the top priorities for businesses. With customer expectations being at an all-time high,
Are you a UX researcher who mainly conducts in-person studies and you’re looking for some online alternatives to get you through this unusual period of lockdown and social distancing? Or perhaps you’re someone who is starting their path down UX enlightenment, looking
INTRODUCTION Given the current world health and associated economic crisis, Userlytics ran a qualitative moderated ("Live Conversations") user experience study with participants in the US to determine how respondents’ online shopping behavior has changed as a result of the pandemic. The following
Imagine a scenario where a user is shopping online and stumbles across a product she likes, but the product’s description doesn’t tell her everything she needs to know before making a purchase (strike 1). To find out more, the user decides to
The Best and Worst UX in the Travel Industry Finding the best flight deals online can be an exhilarating experience. Almost every booking site today promises the lowest fares available and, in some cases, even a price match guarantee. With such a
Last November 18th our CEO was interviewed by Ditsa Keren, of Website Planet; Here are some excerpts from the interview: “If we take a step back and think about how software has evolved over the past 15 years, the cost and time
Designers are prone to falling into the trap of cluttering their interfaces. Limitations of space often push them to the wall, and they find themselves trying to fit everything they can into a tiny usable space. The unique problem that the modern
How Can Bad UX Influence Your Conversion Funnel? Source: Shengjun Shi Regardless of whether you sell a product, offer a service or run a blog, any visitor comes to your site with simple goals like consuming or gathering more information. The user experience

Let’s work together on your next UX study.

Create positive user experiences and keep customers loyal to your product and brand.

Analytics tells you what,
Userlytics tells you WHY.