What is TDTS?
The Thinking, Talking, Doing Science (TDTS) training programme was devised by Bridget Holligan, Director of Education and Engagement at Science Oxford and Helen Wilson at Oxford Brookes University. It’s initial development, delivery and evaluation was funded by the Education Endowment Foundation (EEF). The EEF invests in evidence-based projects that focus on tackling the attainment gap, and TDTS was its first primary science project.
TDTS was evaluated during 2013-15 via a Randomised Controlled Trial (RCT) – a phase known as an ‘efficacy trial’. The evaluation was carried out by the Institute for Effective Education at the University of York. Teachers of Year 5 pupils from 42 Oxfordshire primary schools took part, with half of them (the ‘intervention’ schools) receiving the training in 2013-14 and the other half (the ‘control’ schools) in 2014-15, after all the attainment and attitude data from pupils had been gathered.
Oxford Brookes University
Efficacy trial success
The results for this first trial were reported in summer of 2015 showed that overall, the Year 5 pupils in schools using the TDTS approach made approximately three additional months’ progress in science. The programme had a particularly positive effect on girls and on pupils with lower prior attainment (4 months’ progress) and there were indications that the approach had most impact on pupils eligible for free school meals (5 months’ progress).
Pupils who received TDTS also reported a significant increase in positive attitudes to science, science lessons and practical work. Teacher feedback revealed that all participating teachers had made changes to their classroom practice as a consequence of the training at that they enjoyed teaching science more.
“It’s fantastic when our evaluations produce solid evidence that a particular approach has a positive impact on attainment. It’s especially rewarding when they boost children’s attitudes towards learning too. But the reality of robust educational research is that these results are the exception and not the rule.”
Sir Kevan Collins, CEO, Education Endowment Foundation
“The available evidence indicates that the programme can be implemented at scale through a train-the-trainers model, that it is valued by teachers exposed to the programme, and it changes their teaching practices in a manner consistent with the hypothesis.”
EEF Report, 2018
Effectiveness trial results
As a result of this success, TDTS was labelled a ‘promising project’ by the EEF, who subsequently funded a larger scale RCT of TDTS called an ‘effectiveness trial’ from 2016-18. This was designed to explore whether the impact of TDTS could be replicated at scale, via a ‘train the trainer’ model in seven regions of England. Seven delivery partners were recruited and the American Institutes for Research was the external evaluator.
Over 9000 pupils and 380 teachers in 205 schools across England participated and the findings showed that, on average, pupils’ interest in, and self-efficacy towards, science increased.
There was also a small impact on attainment among children eligible for school meals although this study found that there was no apparent impact on attainment across the whole sample. TDTS remains a ‘promising project’ for the EEF, with discussions ongoing about how the ‘train the trainer’ model can be further improved to ensure that all the impacts of the original efficacy trial can be replicated at scale with a more ‘market ready’ model.
“Children start to develop perceptions about whether science is ‘for them’ towards the end of primary school. It is therefore essential that all primary school pupils experience inspiring science that builds their understanding of the value and place of science in their lives. This will lay the bedrock for their future studies, enable them to make well-informed decisions in our increasingly hi-tech world and give them access to a wide range of rewarding careers.”
Wellcome Trust Report 2014 – Primary Science: Is it Missing Out?