share

DESIGN

5min read

Short Guide to Quick Accessibility User Testing. Part 1

Introduction

If you want to know how to advocate for user testing, check out the introductory article from the series here. In the following post, I will present short guide to quick accessibility user testing, based on our project with Papereed. You can read more about the project here.

About Papereed

Papereed is a Swedish web service which enables listening to audio recordings of narrators reading articles from magazines. Polidea was responsible for designing and developing the mobile version of the product—the application available on iOS. Thanks to it, users can create playlists of articles and save them on their phones in order to listen to them offline.

Background

The main goal of the user testing was to verify whether our assumptions concerning accessibility features were right. We wanted to make sure that the design mirrored the needs of the users suffering from vision impairment, those who are blind and fully sighted. Papereed’s objective was to discover potential problems and opportunity areas based on the already working product. We decided to start with MVP version of the app. When the first milestone was behind us, we were ready for the evaluative research of the product. The testing scope was quite narrow: our client wanted to conduct the study in short time, with the maximum of 7 participants. This time we had a real challenge to face: testing with a specific group of users.

4CAE37FB-493F-4C09-8D97-84B3711EE5C0

See how to engage users
with flawless UX/UI in our free
product design guide!

Set your goal

It’s very important to understand the end goals of all design actions you decide to perform. So before starting our work on user testing, we asked ourselves the basic question:

Why do we need this research?

Papereed was to prove that the iOS application is fully accessible. They had a clear goal to achieve and we had it always in mind. It set the direction for creating testing scenarios and structuring the report. We picked up a couple of scenarios: 5 tasks of various complexities to perform while using the application. We tested the real product, not a prototype. This decision influenced the final range of the chosen scenarios. Naturally, we already had some assumptions concerning certain features that may be problematic for visually impaired and blind users. We wrote them down preparing a set of focus points—the most important elements in the Papereed iOS version we had to test carefully.

Choose the right methodology

Before you start working on a research study, be sure to clarify what should be the outcome, who will be the testing participants, how big is your budget and a team and how much time you have to deliver it. Only then you will be able to pick up the appropriate research method: the most efficient way to find answers to all your testing questions. As far as Papereed case is concerned, we have decided to conduct In-Depth Interviews (IDI). Why? Here come the 2 main reasons.

1. IDI are useful in case of a challenging recruitment

Private setting of our user testing was one of its core elements. We wanted to create a comfortable environment, allowing our participants to relax and talk openly about their everyday habits. Thanks to IDI we were able to elicit candid responses and make our responders feel at ease. We conducted 6 structured, in-depth interviews with 6 users: 2 blind users, 3 visually impaired and 1 fully sighted user. They were of different ages, genders and their levels of technological know-how also varied.

2. IDIs offer deeper insights

With one-on-one talks we could devote full attention to each participant. We observed their body language while they were using the tested app. We also had time to investigate new and interesting subjects that appeared spontaneously during the interviews which allowed us to gather deeper responses. Each participant had more time to share thoughts and feelings. Also, there was no group influence factor.

Hint: Want to make it even quicker? Schedule all interviews for one day and prepare templates for your notes. After several interviews you will notice that some things come up regularly.

Recruitment time! Define your criteria

Prepare a wish list to identify the responders for your research. You can use an open source document prepared by Michael Margolis, an UX Research Partner at Google Ventures: Worksheet: Writing a User Research Participant Screener

The support of a recruitment agency

We did not hesitate even for a minute. It saved us lots of time! Recruiting companies have lists of contacts, professional teams and years of experience. Nevertheless, we needed to prepare the letter of intent. It introduced the idea of Papereed accessibility testing and clarified our goals. We also stressed the importance of accessibility in mobile apps.

You can always DIY

When you’re trying to recruit very specific and less common types of users, you should look for them in the appropriate professional associations, community groups, student or university clubs. Prepare a screener questionnaire based on the criteria you defined at the very beginning and send it everywhere! Sometimes the official letter of intent can be helpful as well.

Hint: Don’t forget to recruit more people just in case some of the users resign. Inform them that they are on the waiting list. Send reminders to everyone one day before the study.

Now you’re ready to conduct the study. Stay tuned for the next blogpost with the detailed scenario of our testing!

Further reading and inspirations:

Lots of great content on user testing by Lena Egede

Technology is about humans! MCE 2017 Talk by Lena Egede

The UX Academy with Sarah Doody

Articles by Michael Margolis from Google Ventures

share


MagdaUI Designer

LEARN MORE

Contact us if you have any questions regarding the article or just want to chat about technology, our services, job offers and more!

POLIDEA NEWSLETTER

Sign in and expect sharp insights, recommendations, ebooks and fascinating project stories delivered to your inbox

The controller of the personal data that you are about to provide in the above form will be Polidea sp. z o.o. with its registered office in Warsaw at ul. Przeskok 2, 00-032 Warsaw, KRS number: 0000330954, tel.: 0048 795 536 436, email: hello@polidea.com (“Polidea”). We will process your personal data based on our legitimate interest and/or your consent. Providing your personal data is not obligatory, but necessary for Polidea to respond to you in relation to your question and/or request. If you gave us consent to call you on the telephone, you may revoke the consent at any time by contacting Polidea via telephone or email. You can find detailed information about the processing of your personal data in relation to the above contact form, including your rights relating to the processing, HERE.

Data controller:

The controller of your personal data is Polidea sp. z o.o. with its registered office in Warsaw at ul. Przeskok 2, 00-032 Warsaw, KRS number: 0000330954, tel.: [0048795536436], email: [hello@polidea.com] (“Polidea”)

Purpose and legal bases for processing:

 

Used abbreviations:

GDPR – Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016
on the protection of natural persons with regard to the processing of personal data and on the free movement
of such data, and repealing Directive 95/46/EC (General Data Protection Regulation)

ARES – Polish Act on Rendering Electronic Services dated 18 July 2002

TL – Polish Telecommunications Law dated 16 July 2004

1)        sending to the given email address a newsletter including information on Polidea’s new projects, products, services, organised events and/or general insights from the mobile app business world |art. 6.1 a) GDPR, art. 10.2 ARES and art. 172.1 TL (upon your consent)

Personal data:name, email address

2)       statistical, analytical and reporting purposes |art. 6. 1 f) GDPR (based on legitimate interests pursued by Polidea, consisting in analysing the way our services are used and adjusting them to our clients’ needs, as well as developing new services)

Personal data:name, email address

Withdrawal of consent:

You may withdraw your consent to process your personal data at any time.

Withdrawal of the consent is possible solely in the scope of processing performed based on the consent. Polidea is authorised to process your personal data after you withdraw your consent if it has another legal basis for the processing, for the purposes covered by that legal basis.

Categories of recipients:

Your personal data may be shared with:

1)       authorised employees and/or contractors of Polidea

2)       persons or entities providing particular services to Polidea (accounting, legal, IT, marketing and advertising services) – in the scope required for those persons or entities to provide those services to Polidea

 

Retention period:

1)       For the purpose of sending newsletter to the given email address – for as long as the relevant consent is not withdrawn

2)       For statistical, analytical and reporting purposes – for as long as the relevant consent is not withdrawn

Your rights:

 

Used abbreviation:

GDPR – Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016
on the protection of natural persons with regard to the processing of personal data and on the free movement
of such data, and repealing Directive 95/46/EC (General Data Protection Regulation)

According to GDPR, you have the following rights relating to the processing of your personal data, exercised by contacting Polidea via [e-mail, phone].

1)       to access to your personal data (art. 15 GDPR) by requesting sharing and/or sending a copy of all your personal data processed by Polidea

2)       to request rectification of inaccurate personal data
(art. 16 GDPR) by indicating the data requiring rectification

3)       to request erasure of your persona data (art. 17 GDPR); Polidea has the rights to refuse erasing the personal data in specific circumstances provided by law

4)       to request restriction of processing of your personal data (art. 18 GDPR) by indicating the data which should be restricted

5)       to move your personal data (art. 20 GDPR) by requesting preparation and transfer by Polidea of the personal data that you provided to Polidea to you or another controller in a structured, commonly used machine-readable format

6)       to object to processing your personal data conducted based on art. 6.1 e) or f) GDPR, on grounds relating to your particular situation (art. 21 GDPR)

7)       to lodge a complaint with a supervisory authority,
in particular in the EU member state of your habitual residence, place of work or place of the alleged infringement if you consider that the processing
of personal data relating to you infringes the GDPR
(art. 77.1 GDPR)

No obligation to provide data:

Providing your personal data is not obligatory, but necessary for Polidea to provide you the newsletter service

Refusal to provide the above data will result in inability to receive the newsletter service.

Profiling

In the process of providing the newsletter service, we make decisions in an automated way, including profiling, based on the data you provide.

 

“Profiling” means automated processing of personal data consisting of the use of your personal data to evaluate certain personal aspects relating to you, in particular to analyze or predict aspects concerning your personal preferences and interests.

 

The automated decisions are taken based on the analysis of clicked and viewed content. They affect the targeting of specific newsletter content to selected users registered to receive the newsletter service, based on the anticipated interests of the recipient.