Why measuring progress is overrated
Last time you were observed teaching a lesson, did your observer focus on ‘measuring progress’ in their feedback? What exactly did they mention? Did you believe them? Did you feel proud or ashamed of the feedback? Did either of you ‘grade’ the quality of the teaching or even the teacher? Was the amount or rate of learning measured? Was the observation a positive, or even a useful experience? Teachers across many schools have had experiences such as these. It is one of the factors contributing to a crisis in recruitment and retention of high-quality teachers across many countries. But it is a factor that can be eliminated very simply. Ban lesson observations from discussions on student progress. They simply do not work.
What does ‘progress’ even mean?
In this post, I hope to convince you that measuring progress in lesson observations is a waste of time. There, I said it. Do I have a chip on my shoulder? Yes. Why? Because students in every school are at risk of a second-rate education. This is due largely to teachers altering their lessons to ensure short-term success within a lesson, at the expense of better progress over the long-term.
There, I said it. Do I have a chip on my shoulder? Yes. Why? Because students in every school are at risk of a second-rate education. This is due largely to teachers altering their lessons to ensure short-term success within a lesson, at the expense of better progress over the long-term.
This problem is exacerbated even further during lesson observations. In many schools, the ‘rate’ or ‘amount’ of progress within the lesson is still being ‘measured’ by SLT and external inspectors alike. However, the problem with aiming for short-term success is that the long-term needs of the students are put aside. This is simply for the sake of teachers trying to demonstrate excellent progress in front of observers. After all, nobody wants to be judged as anything less than brilliant! Observations are a snapshot, a small-scale sample. They simply cannot be used as evidence of student progress.
Fortunately, many high-performing schools are taking on board ever-increasing levels of educational research, in order to raise the achievement of students. Organisations such as the Sutton Trust have researched what factors make the greatest difference to learning. Schools have developed Learning Improvement Plans in response to this research. Now it’s time for Senior Leadership Teams (SLT) to examine whether or not lesson observations are useful enough in improving student progress, to justify the problems they also generate.
So, what’s wrong with measuring progress?
To really understand this question, it’s important to go back to first principles and to ask these fundamental questions:
- What is the purpose of education?
- What role should teachers play in education?
- What role should students play in their own education?
- What else matters?
1. What is the purpose of education?
The ‘purpose’ of education, in my mind, comes down to one simple idea. Education should aim to provide a person with the knowledge and skills to ensure they are able to flourish and succeed once they have left education. In order to achieve this aim, educators should measure progress. But only when it helps education over the long-term. We should evidence the development of students’ knowledge, but there are far better methods than old-fashioned lesson observations. Monitoring student folders is far more accurate. It can’t be staged and it allows teachers to teach in their own way, using their own professional judgement to guide them.
Artificial situations have also been created by teachers, in order to ‘demonstrate’ their own teaching ‘skills’. But a teacher’s aim is to promote learning as their first priority! The cause of this mismatch in priorities is that in too many cases teachers feel they must ‘perform’ to the latest standards, or use the latest methods ‘preferred’ by external inspectors or SLT.
Finally, too many teachers provide students with everything they need in order to pass an exam. This can be useful, but only insofar as it equips the students with the skills they need after leaving school. However, students are often so spoon-fed that they don’t know how to learn or how to solve problems even though they managed to achieve good grades in their exams.
A good education system should create resilient problem-solvers. A focus on measuring progress, however, often makes teachers less likely to spend enough time on challenging tasks. This is because the task may not provide positive ‘progress’ data in time for the termly data-window when assessment results are submitted. Instead, many teachers favour shorter and less rigorous tasks, where they can demonstrate repeated intervention, rather than allowing students to learn resilience.
2. What role should teachers play in education?
There is often a debate about whether the teacher should be the ‘sage on the stage’ or the ‘guide on the side’. I don’t think it matters, so long as you change it up now and again. Students need both direct instruction and the freedom to tackle things in their own way. That way, they benefit from having an expert in the room and from having the space to be creative in how they learn. A focus on measuring progress in a lesson can sometimes interfere with this process, creating unnecessary constraints on the structure of lessons.
Teachers should be able to teach in whatever way they like, so long as by the end of the course, students are able to demonstrate that they can achieve well in the exam and go on to lead successful lives. After all, isn’t this what matters most to our students?
3. What role should students play in their own education?
Learning how to learn is arguably the most important skill a student can learn at school. It happens when we give students a variety of levels of challenge, over time, with varying levels of support. Independent learning is crucial, whether through homework or through students’ own wider reading around the subject. Students often overlook their own role in their own education. Therefore it is vital that we teach students explicitly about their own role in the learning process.
Unfortunately, though, students often overlook their own role in their education. Therefore it is vital that we teach them explicitly about this. I would even argue that it should be done before you begin teaching subject topics. That way, it won’t be viewed by the students as a simplistic reaction to a badly completed homework, or as a trendy add-on following a course we’ve been on.
One consequence of creating a culture of independent learning is that some students will do it extremely well. Sometimes my own students will turn up to a lesson, having taught themselves the topic at home.
4. What else matters?
Teachers are in education for the long haul. So are students. Observers should be too, but often they become distracted by short-term thinking, rather than planning for the future. The consequence is that lesson observations are added to the workload of teachers and SLT.
However, a quick cost-benefit analysis shows that the number of hours put into lesson observation schedules does not make enough positive difference to long-term teaching, to justify the expense. Teachers are worn out. SLT are worn out. We can’t really use the ‘data’ gathered as it doesn’t really measure progress accurately. Our paperwork is then filed away for external inspection teams. This is so that SLT can at least be seen to have tried to monitor and make an impact on student progress.
Meanwhile, lessons are taught with ‘education’ as a secondary priority.
But there is one last nail in the coffin of lesson observations: external inspectors now take less and less account of what they see in lesson observations when making judgements on progress. Sir Michael Wilshaw, an experienced headteacher and the head of Ofsted (at the time of writing), has frequently bemoaned the way that many teachers feel they ought to measure progress, often several times per lesson and especially during inspection visits. Bite-sized chunks of learning are used too often, at the expense of students taking their time on more challenging tasks. I mentioned this earlier, but you can read more about his experience in this Telegraph article.
In essence, Wilshaw views the process of measuring progress as a much more long-term one. Progress ‘measurements’ should take into account long-term data trends and evidence of students making progress over time. The individual lesson observation plays such a superficial role in the measurement of progress, that we might as well abandon it altogether.
So there you have it. If you want to measure progress then leave lesson observations out of it. They are quite frankly, not fit for purpose.
If you want to know more (from a true expert on the subject) then I recommend the brilliant book Making Good Progress (Amazon affiliate link) by Daisy Christodoulou. In her book, she gives practical advice in simple terms, based on extensive research. You’d be hard-pressed to find a better book on this subject. It’s had a huge impact on the way I teach and I know I’d be a poorer teacher without having read it.
I’d love to know your thoughts on this. Leave a reply below or send me a message @guruteaching on Twitter.
And don’t forget to click on the share buttons below!