Evoke Leaders for Literacy Pilot: Impact Evaluation

In 2017 and 2018, World Vision South Africa and Pearson South Africa implemented two Evoke Literacy pilots. The first pilot was implemented at the community-level in Tusalushaka, Limpopo with in and out of-school youth. The second pilot was implemented at two secondary schools in Tembisa, Gauteng. Mthente conducted a quasi-experimental impact evaluation of the entire Evoke Literacy Pilot Program. The focus of the evaluation was to assess the impact of the pilot program by determining its effects on participants’: (a) 21c skills, (b) social innovation skills, and (c) knowledge of how children learn to read.

The evaluation included baseline and end line assessments for each pilot. The design was a pre-test / post-test using the Social Innovator’s Framework in a triangulated approach—self, peer, and professional questionnaires—as the basis for evaluating 21c skill development. The Evoke Literacy analytics (collected via the online platform) were further used to track skill development, and a Locus of Control questionnaire was used to evaluate individual beliefs about success in general. Data was also sourced from focus groups and interviews to support and inform the results of the quantitative analysis.