The impact of COVID-19 on primary assessments
James Pembroke, Data Analyst at Insight/Sig+, analyses the changes and impact of assessment, post-COVID, on schools and pupils in 2022.
When a nationwide lockdown was announced in March 2020, it was hard to imagine quite how disruptive it would be. What most of us thought would be a short-term inconvenience – a temporary blip – ran into weeks and then months. The impact on schools was obviously huge: overnight, the entire system of education was turned upside down and teachers had to adapt quickly to the ‘new normal’. For many children, the kitchen table became the classroom and the teacher a disembodied face on a screen; parents struggled to balance the demands of work with the learning needs of their children. Even now we have not fully calculated the cost in terms of so-called ‘learning loss’.
The consequences of absent assessment
To establish the extent of the impact on learning caused by this protracted period of disruption, we need reliable assessment data. Unavoidably, however, nearly all forms of statutory assessment were cancelled over the past two years. This means we have no data from the foundation stage profile, key stage 1 assessments, key stage 2 tests, GCSEs, and A Levels. Interestingly, the only statutory assessment administered in state schools in England in 2019/20 and 2020/21 was the phonics screening check, but even this was delayed and shifted to the Autumn term of the following year. Because the DfE did not provide a new version of the check, schools were instructed to choose a previous year’s test. This combination of timing and choice means that the results of these assessments are incomparable with those of previous years and the DfE have not, as of yet, made the national figures public.
Another consequence of this two-year hiatus has been the delayed roll out of new forms of assessments. After a stuttering start, the reception baseline – following a trial, pilot, and ‘early adopter’ years – was finally rolled out across primary schools in September 2021. This will provide the baseline for future progress measures but not until 2028 when the current cohort of reception pupils reaches the end of key stage 2. The multiplication tables check, planned to begin in summer 2020, was also delayed and became statutory in June 2022. Despite the suggestion that this would be a low stakes assessment, we now know that the results will be made available to Ofsted and it will no doubt become part of the accountability framework, much like the phonics check. And finally, the final removal of the remaining P scales and their replacement with the Engagement Model takes effect this year. This applies only to pupils who are not engaged in subject specific study and working below the pre-key stage standards, and will therefore mainly affect special schools, but it is nevertheless an important development.
Schools have therefore had two years without statutory assessment and the associated accountability measures used to monitor school performance. The risk is, therefore, that data has taken a backseat and that schools have become accustomed to its absence.
The return of data-driven results
Reports of the death of data are greatly exaggerated: all forms of statutory assessment are back this year, and the measures will follow. Despite the promise of another year without ‘league tables’ – for primary schools at least – this autumn will see the return of performance measures in the Analyse School Performance system and Ofsted’s Inspection Data Summary Report. The slumbering grizzly bear of accountability is beginning to stir from its hibernation, and with the DfE certain to maintain the expected standards set in previous years, it is highly likely that many schools will see a drop in their results.
In the absence of statutory assessment, it is perhaps of little surprise that an increasing number of schools turned to standardised tests to plug the gap, to provide national reference to their internal assessments, calculate the extent of any learning deficit, and to measure progress and closing of gaps as pupils returned to the classroom. Research carried out for the DfE by the Education Policy Institute and Renaissance Learning (1), based on the results of Star online adaptive tests, reveals that progress slowed throughout 2020/21 and overall attainment was below the levels predicted from the trajectories of same-aged pupils in previous years. By the end of the 2020/21 spring term, primary-aged pupils had experienced a total ‘learning loss’ of 2.2 months in reading and 3.4 months in maths when compared with the results of previous cohorts unaffected by lockdowns. These are averages: pupils from disadvantaged backgrounds and those in areas of higher deprivation were more adversely affected.
Whilst learning loss is a misnomer – pupils still made progress – scores are in many cases significantly lower than expected and, despite notable improvements in both reading and maths in the summer term, gaps are likely to take some time to close, especially for the most disadvantaged pupils. Evidently, many children are going to require additional support for some time to come to address the gaps that have arisen during the past two years.
Using assessment to drive teaching and learning
Richard Selfridge was teaching Year 6 when the pandemic began and has been busy with small group catch up work across Key Stage 2 this academic year: "After the worst of the initial lockdowns and partial school closures of 2020, it became clear from both the informal and formal assessments made as pupils returned to school that the effects of the disruption were complex and unevenly distributed.
Whilst we treated the results of assessments with caution, given the uncertainty in interpreting the impact of the pandemic, some patterns did emerge: Pupils who were in the early stages of learning to decode written words – those in Reception/Year 1 in March 2020 – had a lot of ground to make up; the gaps between groups of pupils with and without SEND and either in receipt of or not of Free School meals had widened considerably; the impact on what might be called the ‘socialising into school behaviours’ was considerable – many Year 2 and 3 children came back into school having to learn how to learn alongside others all over again, as did substantial numbers of children in other year groups.
Much of the work in the past year has been underpinned by our assessment of wider needs as well as assessments of academic development. Standardised assessments have been an integral part of our work to identify pupils who need more support to get back on track and this has underpinned our targeted work to support groups of pupils. In this academic year, pre and post intervention assessment has been key in identifying the effective actions, as well as those interventions that are proving to be less effective."
The need for high-quality, accurate and reliable assessment has never been greater but with gaping holes in the statutory assessment record and ongoing issues of reliability, we need to bolster internal assessment practices. Don’t get side-tracked trying to second guess government progress measures and distant end of key stage results. Use data to effectively monitor each pupil’s progress over time and identify those in need of further support. Data is not dead; we just need better data.
(1) Department for Education, Understanding Progress in the 2020/21 Academic Year, October 2021
James Pembroke is a Consultant Data Analyst with 16 years’ experience in primary, secondary and post-16 sectors.
Take a look at our full blog series for more perspectives on Primary Assessment.