Evaluation of the Northland District Health Board rheumatic fever prevention programmes

Client: Northland District Health Board

Evidence identifying the most efficient and effective delivery approach

The Northland District Health Board (DHB) is one of 11 district health boards delivering a locally relevant response to address rheumatic fever rates in the community. The Northland rheumatic fever prevention programme involves several Māori providers delivering targeted throat swabbing services in their communities. The DHB wanted to understand the delivery model that provided the greatest value (best outcomes) for money (lowest cost), and Standard of Proof was contracted to implement the evaluation to inform future funding decisions. 

Standard of Proof pulled together data from various sources, and worked with providers and the DHB to understand how different activities contributed to their achievements as well as the cost and efficiency of activities.

As a result of the evidence and evaluation process, the DHB and providers are now in an informed position to support programme providers achieve success in the most cost effective way.

Himalayan Trust Quality Education Review

Client: Ministry of Foreign Affairs and Trade

Evidence supporting educational outcomes in Nepal

The Ministry of Foreign Affairs and Trade and the Himalayan Trust, along with their local implementation partners, have been making significant efforts across the Solukhumbu region (Nepal) to improve access to quality education, and ultimately educational outcomes for learners. These broad efforts, ranging from resource provision to designing and delivering professional development support to schools, aim to enhance literacy skills and overall educational achievement in the region. The funders and implementation partners wanted to understand the effectiveness of the support being provided to schools in the Solukhumbu region of Nepal.

Standard of Proof supported our partners Allen and Clarke undertake a review of this work. We visited a variety of schools in the Himalayan mountains, trekking from Lukla (2860 meters) up to Khumjung (3790 meters) to undertake classroom observations and interviews and to collate secondary data and artefacts along the way.

The findings are informing the future direction of the support so that they can further improve the quality of education in the Nepali region.

Many thanks to Himalayan Trust New Zealand, Himalayan Trust Nepal and Action for Nepal for supporting the trek, and all your awesome efforts to the people of Nepal!

Evaluation of the Oral Language and Literacy Initiative

Client: Ministry of Education

 “Making high quality evidence accessible in a real-world context

 “The Ministry of Education is trialling an Oral Language and Literacy initiative (OLLi) to support early literacy and oral language skills among young learners in New Zealand. OLLi is being implemented across 8 regions in New Zealand, and is expected to reach approximately 24,000 children within 800 Early Learning Services from 2018 to 2021. Through specifically trained Speech-language Therapists, the initiative intends to positively influence ELS culture and staff, building confidence and improving practice in terms of building oral language and literacy in children. As a result, children’s oral language and literacy is expected to improve through these engagements that emphasise language sounds, words, structure and complexity.

Standard of Proof supported the Ministry of Education national and regional teams to test and iterate the design of a cluster-randomised evaluation to work alongside this initiative throughout the first trial year.  The evaluation is now being implemented, providing robust evidence within this ‘real-world’ context. 

We are proud to have supported the Ministry in their endeavour towards quality evidence, and we wish the Ministry of Education and the hard-working OLLi team every success at improving outcomes for our young learners.

Evaluation of the Fiji Islands Rheumatic Heart Disease Control & Prevention Programme Activity

Client: Cure Kids, New Zealand Ministry of Foreign Affairs and Trade, Fiji Ministry of Health

“Evidence supports activity design and health outcomes across Fiji

Rheumatic fever is caused by an abnormal immune response to infection with a bacteria called Streptococcus (GAS), usually in the throat. The symptoms of rheumatic fever resolve over a few weeks, however, damage to the heart valve is usually permanent and referred to as rheumatic heart disease (RHD). With repeated episodes of rheumatic Fever the damaged heart valves become thickened and do not work properly, leading to heart failure and early death.

Rheumatic Heart Disease is a significant health problem in Fiji. Each year, at least 60 people die of RHD in Fiji and the average age of death is 38 (Singh P., et al 2007). The reported prevalence in children aged 5-14 years in Fiji is 19.2 per 1000 (Colquhoun S., et al 2014) – that is almost one child in every classroom with RHD.

From 2014 to 2019, Cure Kids, the New Zealand Ministry of Foreign Affairs and Trade (MFAT) and Fiji Ministry of Health and Medical Services (MHMS) worked together to expand upon the Fiji Islands Rheumatic Heart Disease Control and Prevention Programme. Their goal was to reduce morbidity and mortality in Fiji, and to do this, they made use of the vast RHD research as well as health and contextual experts to create a sustainable and effective programme in Fiji.

Standard of Proof supported Cure Kids and their partners design and implement a mixed-methods evaluation of this work. We collated and triangulated evidence across various sources, demonstrating the weight of the evidence to help the health and contextual experts make informed decisions moving forward.  The next steps for the activity are being planned, using evidence and expertise to achieve their goals.

We are proud to have supported Cure Kids, MFAT and MHMS obtain useful evidence to inform their success, and we wish the hard-working rheumatic heart disease team every success at further improving the health outcomes for Fiji peoples.

Evaluation of the Pacific Nations Careers Study Tour

Client: Careers New Zealand

“Delivering the best programme possible means understanding what works and what doesn’t work. This means listening to the community and the programme delivery team.

In collaboration with Allen + Clarke, Standard of Proof delivered an evaluation that examined the benefits of a Careers New Zealand Study Tour involving delegates from 19 different Pacific nations. We used a story-telling approach, eliciting rich stories about the realised benefits of the programme for delegates. The stories provided compelling, first-hand experiences of the breadth of programme benefits. 

Participants also identified the factors that contributed to success, and generated ideas on how these benefits can be further built upon and sustained over time. These suggestions provided useful information on how the programme can be further improved in the most relevant way for everyone involved.

We were pleased to deliver a cost-effective approach to documenting the benefits of the programme. Our client has been able to use these positive experiences to build upon success, provide learning for the future, and proof of benefits for the programme funder and stakeholders.