Skip to content

Top 5 Ways To Deal with Non-Technical Participants in Remote Testing

 By Userlytics
 Nov 04, 2021
 67 Views

Top 5 Ways To Deal with Non-Technical Participants in Remote Testing

While remote user experience testing significantly enhances researchers’ ability to reach test participants, these participants’ technical skills and access to technology can often vary greatly. Therefore, it is important to design and administer remote tests that facilitate participants’ varying technical skills and access to technology. Designing tests with non-technical participants in mind will allow more participants to successfully complete your usability tests, and will bring you higher quality test metrics.

A number of standards and considerations have been proposed by various scholars for guiding the design and implementation of remote UX research (Benfield & Szlemko, 2006; Birnbaum, 2004; Granello & Wheaton, 2004; Reips, 2002). In this article, we’ll go over the five best practices for enhancing the success of your remote testing when addressing the needs of non-technical participants.

1. Keep tasks clear and easy to understand

Throughout your usability tests, use simple and consistent layouts with easy to read fonts for enhancing navigation and accessibility. In addition, use straightforward and easy to understand instructions and descriptions to reduce any misunderstanding of the tasks and test activities. This is especially important in remote unmoderated testing environments due to the reduced or absent interaction with participants. Including a pretest that goes over technical requirements and expectations before the start of the test can also greatly reduce any participants misunderstandings or issues.

2. Use established web-based research tools and services

Well established web-based research tools and services can greatly enhance the reliability and usability of your remote testing. For instance, Userlytics offers two excellent options for allowing non-technical participants to take part in remote testing easily: 1) Its No-Download Web Recorder, and 2) Its Overlay Web Recorder. Both recorders allow participants to join a test with only an invitation link and a commonly used web browser from the comfort of their own homes at their preferred availability.

Below, we’ll go over what makes these two web recorders so accessible and easy to use:

1. No-Download Web Recorder

  • Does not require download of any extensions or plugins
  • Supports Chrome, Firefox, Safari, and Microsoft Edge and any of the major operating systems including Windows, MacOS, and ChromeOS
  • Allows studies to be conducted with participants in corporate environments (e.g., behind firewalls) and further enhances access to previously difficult to reach participants.

Please refer to our blog post on The advantages of the No-Download Web Recorder for more details.

2. Overlay Web Recorder

  • Specifically designed for remote user experience testing of websites and prototypes
  • Requires download of a web browser extension (one-click quick process)
  • Supports Google Chrome and Microsoft Edge, and with support for Firefox and Safari soon
  • High stability (near ZERO system crash rate in product testing)
  • Floating tasks window design 

Please refer to our help post on How and When to use our Overlay Web Recorder for more details.

3. Specify technology requirements

The technology variance among participants can sometimes present an issue in remote testing settings. Participants may take part in usability tests using a variety of computers, operating systems, internet connections and web browsers. It is therefore important to clearly define the technological requirements of your remote usability tests and to ensure all the participants are meeting them at the beginning of each test. This can drastically reduce potential technical difficulties during tests, which can lead to frustration and ultimately dropout.

Userlytics provides clear technology requirements (e.g., browser, internet connection, video resolution) for participants so that they can ensure they meet the requirements of participating in remote tests. In addition, unmoderated tests taken on Userlytics’ Overlay Web Recorder include a computer configuration test so that participants can make sure their technology meets the required standards. Outlining technology requirements can facilitate a positive remote testing experience by significantly reducing potential technical difficulties.

4. Apply special techniques to increase engagement and reduce dropout

Most participant dropouts often take place at the beginning of remote usability experiments. There are multiple factors that influence participants to dropout, such as loading time, layout design, functionality of testing materials, and technology requirements. Below, we go over ways to enhance your participants’ motivation and engagement in order to reduce test dropouts:

1. Provide clear experiment overview

Provide a clear overview of the goals, purposes and procedures of your usability tests at the beginning. This allows participants to understand the context and purposes of the experiments and to mentally and physically prepare themselves for the tasks ahead. This overview can also facilitate participants’ experiences of competence and autonomy, which in turn can enhance intrinsic motivation and engagement.

2. Provide time estimation and progress

Provide a time estimation for the experiments and update participants with their progress throughout the testing process. Doing so allows participants to understand how much time and effort are required for completing the tasks.  A progress update can also facilitate participants’ sense of accomplishment, which can result in more motivation and desire to participate in ongoing tests.

3. Rewards

Image from https://techdaily.ca/

Rewards can provide extra incentives for participants to take part in and complete remote usability tests. In addition, non monetary rewards, such as feedback and appreciation, can help make the whole experience more satisfying from a psychological point of view.

5. Pilot test your experiment

Before a full launch of your usability tests, pilot tests should be conducted to ensure the materials are being displayed correctly across different computers, monitors and browsers. Remote testing platforms like Userlytics are designed to promote compatibility across different forms of technology, with the goal of providing a uniform experience across all platforms and settings. Run pilot tests with a variety of different participants to make sure your test instructions are well understood among consumers of different trades and backgrounds This is particularly important in unmoderated remote testing environments, where there is no face-to-face interaction with participants. Participants should be observed closely during the test, and if necessary, should be interviewed afterward to learn more about their experiences.

Concluding Thoughts

Remote usability testing enhances access to a large number of diverse participants across geo-cultural boundaries, technical skills and settings. It is crucial to consider participants’ needs in order to maximize the advantages of remote experiments (e.g., better generalizability and external validity). This post compiles the five best practices for addressing the needs of non-technical participants based on existing literature. We have also described how remote testing platforms like Userlytics can implement these top practices into your next remote testing session. Although it can be challenging to design and conduct remote UX experiments, including an appropriate screener, script length, and branching logic, Userlytics offers the assistance of senior user experience researchers to design the optimal test plan for your goals. 

References

Benfield, J. A., & Szlemko, W. J. (2006). Internet-based data collection: Promises and realities. Journal of Research Practice, 2(2), D1-D1.

Birnbaum, M. H. (2004). Human research and data collection via the Internet. Annu. Rev. Psychol., 55, 803-832.

Granello, D. H., & Wheaton, J. E. (2004). Online data collection: Strategies for research. Journal of Counseling & Development, 82(4), 387-393.

Reips, U. D. (2002). Standards for Internet-based experimenting. Experimental psychology, 49(4), 243.

Article written by Frankie Tam

About the Author: Collaborations

Collaborations

Our blog collaborators are a diverse group of professionals with extensive knowledge and experience in the field of user experience. They include UX researchers, designers, thought leaders, and industry professionals who are passionate about sharing their insights and expertise with others.

As collaborators, they contribute thoughtful and inspiring content that covers various aspects of the UX space, including emerging trends, best practices, and practical tips. Their articles are designed to help readers stay up-to-date with the latest developments in UX, as well as improve their own skills and knowledge in the field.

Read More Articles by Our Collaborators

About the Author: Userlytics

Userlytics

Since 2009 we have been helping enterprises, governmental organizations, non-profits, agencies and startups optimize their user experience, or UX. With our state-of-the-art platform, massive global participant panel and unlimited accounts/seats for democratizing user research, we are the best all-in-one solution for remote user testing.

Schedule a Free Demo

Didn’t find what you were searching for?

Related posts

What’s the difference between a great user experience and a tolerable one? One might say the high-level stuff, like layout and design, but ultimately it’s in the details, or microinteractions. Microinteractions often make or break a digital user experience. When done well
Accessibility is a crucial aspect of creating digital products that can be used by as many people as possible. When designing a digital product, it's important to consider accessibility so that everyone, including those with disabilities, can access and use the product
They say finding love is one of the hardest things to do as a human being. We’ve been fed this narrative our entire lives, with movies, books, and songs all focusing on how impossible it is to find “the one.” Even in
Artificial intelligence, or AI, has recently made headlines due to a host of powerful and engaging tools that have gone viral across social media. Take ChatGPT, the chatbot whose revolutionary technology allows it to do everything from answering complex queries to generating song
If you're in the market for a remote user testing solution, you've probably come across a few of the following names, such as UserTesting, UserZoom, Playbook UX, UserBrain, UserFeel, LookBack, TryMata, Optimal Workshop, and DScout. All of these platforms have their advantages
Things to be Thankful for: Advantages of Professional Peer Support in UX Research Thanksgiving is a time to reflect on all the things we are thankful for. As user researchers, we are thankful for the ability to connect with our peers and
2022 has been a busy and exciting time at Userlytics. We’ve launched several new features and capabilities, including sentiment analysis, accessibility testing, the ULX score, and VR testing. These newly implemented tools were designed to enhance your experience and provide you with
As staples of nearly all research conducted today, many people think they know about the differences between qualitative (qual) and quantitative (quant) testing. However, in the context of user research, these two methodologies are often used interchangeably. So how does one know
Understanding what democratizing user research means is not as simple as searching for the definition online, or asking a colleague for a quick summary. In a general sense, the universal definition is “providing all stakeholders with access to user insight and UX
It's no secret that a good website or app user experience is crucial for boosting sales. In an offline location such as a store or restaurant, being physically present may keep a prospect even if the experience is subpar. But in an
For many researchers working in UX, quantitative data analysis can cause a lot of anxiety. UX researchers provide interpretations that can impact businesses with said data, which can be an overwhelming amount of pressure. There are many reasons UX researchers are often
As a UX researcher or designer, it's important to have a clear understanding of your target customer before beginning a remote UX study. This helps you make informed decisions about what to test, how to test it, and who to target your
If you’re a UX researcher, you probably already know how important it is to carefully consider every step of a research plan: You need to make sure you understand the problem space, choose the most suitable research methods, identify and recruit the
In remote user experience and usability testing, there are a variety of factors that contribute to valuable, authentic user data that can be used to improve your brand’s user and customer experience. Among those factors are the quality and authenticity of the
Are you thinking about doing some user testing on your website, app or prototype? Are you currently weighing up the different options available to you? Should you use a free video-conferencing tool or a paid user testing platform? What are the differences
If you visited a complex website and found everything you were looking for with ease, it was unlikely a coincidence. A well-designed website structure is often the result of careful user research and testing, following information architecture principles and best practices. So
Userlytics prides itself in being a truly global platform. With over one million panel testers in over 150 countries, we are happy to say that we are able to find and test your target customers, wherever they may be. With the inception
In today’s highly digital world, cybersecurity is of the utmost importance when running day to day business operations. As usability testing grows in popularity, so does the need to choose a UX platform that values your company's privacy and security. But how
Userlytics makes user experience testing easy, efficient and fun with its state-of-the-art no-download web recorder. This revolutionary user experience testing recorder allows participants to jump right into usability tests directly with a simple click of a button; this means you can more
Moderated testing sessions are a great opportunity to get thorough and instant feedback from users all around the world. This type of testing involves a live, online interview where you are face-to-face with your users via webcam, asking them questions, guiding them
Researching the ins and outs of your business is integral to setting your company up for success. Increasingly, fine-tuning and improving your customers’ brand experience has become one of the top priorities for businesses. With customer expectations being at an all-time high,
Are you a UX researcher who mainly conducts in-person studies and you’re looking for some online alternatives to get you through this unusual period of lockdown and social distancing? Or perhaps you’re someone who is starting their path down UX enlightenment, looking
INTRODUCTION Given the current world health and associated economic crisis, Userlytics ran a qualitative moderated ("Live Conversations") user experience study with participants in the US to determine how respondents’ online shopping behavior has changed as a result of the pandemic. The following
Imagine a scenario where a user is shopping online and stumbles across a product she likes, but the product’s description doesn’t tell her everything she needs to know before making a purchase (strike 1). To find out more, the user decides to
The Best and Worst UX in the Travel Industry Finding the best flight deals online can be an exhilarating experience. Almost every booking site today promises the lowest fares available and, in some cases, even a price match guarantee. With such a
Last November 18th our CEO was interviewed by Ditsa Keren, of Website Planet; Here are some excerpts from the interview: “If we take a step back and think about how software has evolved over the past 15 years, the cost and time
Designers are prone to falling into the trap of cluttering their interfaces. Limitations of space often push them to the wall, and they find themselves trying to fit everything they can into a tiny usable space. The unique problem that the modern
How Can Bad UX Influence Your Conversion Funnel? Source: Shengjun Shi Regardless of whether you sell a product, offer a service or run a blog, any visitor comes to your site with simple goals like consuming or gathering more information. The user experience

Let’s work together on your next UX study.

Create positive user experiences and keep customers loyal to your product and brand.

Analytics tells you what,
Userlytics tells you WHY.