Digital Assessment Research: Evolving Accessibility and Inclusion

View all tags
Understanding digital assessment experiences for students with SEND

We believe that all students should be able to best show what they know and can do in exams – regardless of whether those exams are taken onscreen or on paper, and irrespective of each student’s unique background, ability or needs.    

That’s why we’ve been using a range of methods to research how different learners with special educational needs and disabilities (SEND) experience digital assessments. The findings can help us better understand if, where, and how technology can enhance accessibility and inclusion in exams.

At a glance

  • We partnered with Assessment MicroAnalytics™ to investigate how students with SEND experience digital assessment.
  • The study included eye-tracking, webcams and interviews with both students and educators to give us a fuller view of students’ experiences.
  • Findings show students have a strong preference for digital assessments – including feedback on the benefits of multi-modal and interactive designs, as well as the importance of personalisation options.
  • Insights revealed that there is room for improvement in helping students process and navigate information and tools within digital assessments, but also that existing IT infrastructure pose challenges to schools in supporting their students with accessible assessment experiences.
  • As well as already using this research to inform our onscreen exams, we’ll continue research to enhance accessibility and inclusion, and share our findings to support the evolution of digital assessment at Pearson and across the wider sector.

What was the research about?

In recent years, there has been a growing interest across the sector in the use of technology to support educational assessments, including onscreen assessment. 

Even before we made onscreen GCSE and International GCSE exams available in 2022, 69% of teachers surveyed said that “more accessible assessments for learners with SEND” was one of the most important reasons they’d consider using onscreen exams.

Currently, one in five learners in England have SEND, and/or are receiving additional learning support with an Education, Health and Care Plan. And with almost 625,000 exam access arrangement requests approved in the 2023/2024 academic year, it’s vital we ensure that assessment formats can support all students. 

Our research study focused on:

  • Exploring how a group of learners with mild to moderate SEND engaged with a short series of GCSE-style examination items onscreen.
  • Analysing the detailed and nuanced interactions by students
  • Learning from their responses to embed user-led design into our ongoing development of digital assessment options.

By taking an in-depth look at student interactions in this way, we can keep learner-centered research and insights at the heart of our development of onscreen exams, ensuring that they are as accessible as possible. We are also enhancing the sector’s understanding of how students with SEND and additional learning needs experience digital assessments.

How was the research conducted?

In 2021/22 we partnered with specialist data analysts Assessment MicroAnalytics™ to explore the user experience of a digital assessment platform for secondary learners with various SEND conditions such as dyslexia, ADHD and ASD.

27 students aged 13–15 from three mainstream secondary schools took part and were supported by eight SEND specialist teaching staff as they completed a digital test with a range of 12 GCSE exam questions that required varied interactions onscreen.

While the platform did have some in-built accessibility tools, we didn’t assume that the content was fully accessible to all students in our sample group. We recorded all responses to the assessment with a variety of data collection methods including eye-tracking, webcams capturing facial expressions, verbal interactions and gestures, think-aloud testimonies and retrospective interviews.

What were the key findings?

Our research found that students who took part in the study overwhelmingly preferred digital assessment to paper-based alternatives, while educators also remarked on the benefits.

Preferences and ways of using the technology highlighted through more detailed analysis revealed:

  • 96% of participating students expressed a clear preference for digital assessment. This held strong across all the types of SEND categories represented in the study.
  • Educators also expressed a clear view that the digital mode would be highly beneficial for learners with SEND.
  • Learners used different and varied strategies to answer the digital questions, as identified by eye-tracking and webcams. These strategies differed among learners, including those who shared the same SEND diagnoses.
  • Students particularly enjoyed questions that allowed them to engage with multi-modal interactive designs, along with the ability to correct their errors cleanly and adjust platform features to better suit their individual needs.
  • Personalisation options were widely used, with over half of the students changing font size and overlay colour preferences.

A few key challenges were also noted that will help inform improvements moving forward:

  • The students experienced some difficulties with processing and accessing information in the questions, as shown by eye-tracking data.
  • Scrolling when the screen text was enlarged was found to be a problem in some cases, as this made it hard to retain information.
  • There were also some issues with the accessibility of digital tools – e.g. drawing tools within the platform.
  • In interviews, teachers highlighted challenges around their current IT infrastructure and general hardware resource provision in schools. In the three schools that took part, none of the learners with SEND had access to specialist accessibility software.

Overall, the study group’s responses highlighted the importance of universal design and personalisation options for onscreen exams. These were found to reduce stress and mitigate errors and ultimately improve the assessment experience for users with a wide range of learning needs.

What do these findings mean for Pearson and the wider sector?

Our findings suggest that onscreen formats can open the door to achieving a more equitable assessment environment for all learners – especially learners with SEND. They also emphasise the need to refine digital platforms and onscreen assessments in ways that fully accommodate the diverse needs of students – a crucial insight to be further incorporated into our work going forward.

As part of broadening our understanding of learning and assessment experiences for students with SEND, it’s important that future research focuses on a range of SEND conditions and accessibility needs.

More widely, these findings underscore the need to collaborate across the sector. As far as we are aware, Pearson is one of the few organisations conducting such detailed research into the digital assessment experiences of learners with SEND. But as we seek to put these lessons into practice, we’re committed to sharing data, insights and information so that all schools, colleges, students, families, educators and policymakers can engage in the process of refining and enhancing assessments.

What are Pearson’s next steps on this?

This research is part of a comprehensive series of studies considering various aspects of onscreen exams – from accessibility and inclusion through to comparability and feedback from teachers and students.

As such, we’ll not only be looking at this study in isolation but in relation to our wider research and evidence base as we create a full and informed picture of assessment opportunities.

Our next steps include (but are not limited to):

  • Extending our research to include projects that focus on a wider range of SEND conditions not represented in this initial study, such as physical impairments and severe intellectual disabilities.
  • Exploring and ensuring compatibility with assistive technologies used by many students with SEND, such as screen readers and adaptive keyboards.
  • Implementing updates to our digital assessment platform, such as increasing default font size, reducing scrolling requirements and exploring further options for personalisation.
  • Informing sector-wide conversations and recommendations by continuing to share our research, as we strive to improve assessment practices, ensuring fairness and accessibility across all assessment modes.

About the research

Date: November 2022

You may also be interested in...

Onscreen exam updates

Would you like to be the first to know about our latest digital assessment news and ways you can get involved in research?

Sign up for updates

Share your thoughts

Get in touch with us through our social media channels to have your say:

X (Twitter) LinkedIn Facebook