The Challenge

More than 617 million children and youth lack basic skills in literacy and numeracy.  EdTech organizations are uniquely positioned to leverage digital infrastructure and big data to develop and improve programs that help address this challenge. For instance, Taleemabad is an educational technology in Pakistan company that provides digital learning resources to primary school students in underserved communities. To do this, Taleemabad delivers structured lesson plans, coaching, and teacher training through an AI-powered platform used by over 10,000 teachers across Pakistan's public education system. While Taleemabad is continuously innovating their programming with technology, they sought to strengthen the internal data systems and organizational capacity needed to learn from data, test new features rigorously, and translate evidence into decisions that improve outcomes for teachers and students.

The Engagement

Through the Partnership for Tech in Education (P4T-Ed), IPA worked with Taleemabad to  refine their Theory of Change, clarifying the three main pathways through which the platform drives changes in teacher practice and student learning outcomes: teacher capacity, school leadership support and policy change. Building on this, IPA and Taleemabad collaboratively refined a comprehensive indicator framework covering all levels of the results chain and prioritized indicators according to their utility for monitoring and/or A/B testing purposes.

To strengthen existing data systems, IPA reviewed Taleemabad's classroom observation tool and provided recommendations to measure more accurately the competencies targeted through their teacher training and coaching model. IPA also facilitated a reflective session on how AI-based analysis of classroom recordings expands what Taleemabad can measure for MEL purposes, opening new possibilities for scalable, low-burden data collection. Finally, IPA introduced a structured framework to think about A/B testing, and considered how to apply it to some of Taleemabad’s experimentation ideas.

Results

This engagement strengthened Taleemabad's foundation for evidence-driven decision-making across three areas: a clearer Theory of Change with explicit impact pathways, a prioritized indicator framework for monitoring from experimentation metrics, and ways to strengthen key data collection tools to better align measurement with targeted outcomes. In addition to this, a structured A/B testing framework provided Taleemabad’s team with a strategic approach to the identification and prioritization of experiments that generate actionable evidence. Together, these outputs position Taleemabad to further their translation of data into decisions that improve outcomes for teachers and students across Pakistan.

Implementing Partner