The role of AI in English assessment

Pearson Languages
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

For example, Pearson’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in Pearson’s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation. 

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

Pearson English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

Plus, there’s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments. 

More blogs from Pearson

  • A business woman sat at a table in a office writing notes

    Hard skills vs. soft skills: The impact of language learning

    提交者 Charlotte Guest
    Reading time: 6 minutes

    Hard skills and soft skills play a crucial role in defining career success and progression. The difference between hard skills and soft skills is that hard skills are teachable, technical, measurable abilities specific to particular jobs, while soft skills are more interpersonal, universal and related to personality traits. While hard skills refer to the technical knowledge and specific abilities required to perform a job, soft skills are more intangible. They encompass the interpersonal attributes and personality traits that enable individuals to communicate effectively, work collaboratively and adapt to changes in the workplace environment.

    In this blog post, we will explore how learning a new language can significantly enhance both hard and soft skills, making you a more versatile and effective professional in today’s multifaceted work environment.

    Understanding the balance of hard and soft skills

    Hard skills might get your foot in the door, showcasing your qualifications for a position. Developing hard skills to stand out from other job seekers is crucial; take advantage of classes, webinars and workshops offered by your current employer to develop hard skills and learn new technical skills. Examples include proficiency in a particular software, certification in a specific field, or mastery of a technical domain. However, it’s the soft skills, such as effective communication, collaboration, critical thinking and emotional intelligence, that propel you through the door and into the realms of career advancement. Recent research underscores the growing importance of English proficiency as a pivotal element in this dynamic, equally vital for enhancing both sets of skills.

    What are examples of soft skills?

    Soft skills encompass a wide range of attributes that can significantly impact workplace efficiency and harmony. Examples of essential soft skills include:

    Communication: The ability to convey information clearly and effectively is paramount. This includes both verbal and written communication, as well as active listening skills.

    Teamwork: Collaborating well with others, often with diverse backgrounds and perspectives, to achieve common goals.

    Problem-solving: The capability to analyze situations, identify problems and devise effective solutions.

    Adaptability: The readiness to adjust to new conditions, workflows, or technologies, demonstrating flexibility in the face of change.

    Critical thinking: The process of objectively analyzing information to make informed decisions.

    Emotional intelligence: The ability to understand, manage and utilize one's emotions constructively while also recognizing and influencing the emotions of others.

    What are examples of hard skills?

    Hard skills are quantifiable, teachable abilities specific to a job or industry. These skills are typically acquired through formal education, training programs and practical experience. Some examples of essential hard skills include:

    Computer programming: Proficiency in coding and programming languages, such as Python, Java, C++, or HTML/CSS is crucial for software development and web design roles.

    Data analysis: The ability to interpret complex data sets using tools like Excel, SQL, or R, providing valuable insights and informing decision-making processes.

    Graphic design: Mastery of design software such as Adobe Photoshop, Illustrator, and InDesign, enabling the creation of visual content for various media.

    Foreign language proficiency: Fluency in a second language can be an asset in international business, for example, in translation services or customer support roles.

    Project management: Knowledge of project management methodologies (e.g., Agile, Scrum) and tools (e.g., Microsoft Project, Jira) to plan, execute and oversee projects effectively.

    Technical writing: The skill of crafting clear, precise documentation and instructional materials, essential in industries such as engineering, IT and pharmaceuticals.

  • A group of women celebrating with confetti

    The Global Scale of English: A decade of innovation in language education

    提交者 Pearson Languages
    Reading time: 4 minutes

    This month marks 10 years since the launch of the Global Scale of English (GSE) and what a journey it has been. As we celebrate this important milestone, it’s time to reflect on everything that has been achieved over the past decade and to take pride in the work that has contributed to the advancement of language learning, teaching and assessment around the world.  

  • business people in a board room with a graph on the wall behind

    Language proficiency and succession planning: Developing future leaders

    提交者 Berenice Lopez
    Reading time: 7 minutes

    In today’s fast-paced business landscape, proactive succession planning is essential for HR professionals. Preparing the next generation of leaders is a business-critical initiative, to ensure organizational continuity, agility and long-term success.

    Succession planning is often high up on the HR agenda, as it also promotes progression, reduces business disruption, and attracts top talent. There are many components to effective succession planning, including skills development, but one skill that’s often overlooked in this process is communication. One often overlooked yet highly influential component of effective succession planning is language proficiency.

    At Pearson ELL, we believe strongly in the power of language and have designed our succession planning strategy with this in mind. The focus is on creating multilingual leaders who are not only proficient in their respective fields but also have a deep understanding of global culture and market dynamics.

    In this blog post, we explore how communication skills and specifically language proficiency plays a pivotal role in succession planning and the development of future leaders. We’ll also provide actionable insights for HR professionals and managers on integrating language development into their succession strategies. As well as some insights from our very own ELL HR team.