Projects
Rapid Feedback Monitoring, Evaluation, Research, and Learning
2016–2022
Project Overview
Objective
Design and test approaches to improve program effectiveness using a series of rapid and short tests or analyses to provide decision makers with timely and actionable evidence of whether operational variations can improve program outcomes cost effectively.
Project Motivation
To help build rapid feedback loops into early stages of project implementation using proven evaluation methods to improve effectiveness during scale-up.
Partners in Progress
- Results for Development
- Abt Associates
- Notre Dame Initiative for Global Development
- U.S. Global Development Lab
Prepared For
U.S. Agency for International Development
As a part of the RF MERL consortium, Mathematica tested the effectiveness of specific components of early grade reading and health projects in Senegal, India, Guinea, Cambodia, and Tanzania.
Mathematica was engaged in five RF MERL projects or pilots, including two on early grade reading and three on family care and mobile health. Three of these projects are featured below.
In Senegal, the Lecture Pour Tous (LPT) initiative taught reading in national languages in Grades 1 to 3 with the goal of improving student literacy. The project supplied enhanced continuous teacher professional development and coaching, and reinforced parent and community engagement. Mathematica employed mixed-methods research including lean testing, usability testing, and randomized control trials to test different models of implementation. Our research provided opportunities for project improvement, contributed to the literature on effective early grade reading strategies, and provided rigorous evidence that informed the Government of Senegal’s scaling of some project activities.
In India, the Tuberculosis Health Action Learning Initiative (THALI) deployed technology-enabled approaches to support tuberculosis patients in taking their daily treatment. Mathematica used mixed-methods analysis to evaluate the feasibility and utility of three adherence technologies. Our study included qualitative data collection and a review of administrative data to better understand the technologies and how patients’ compliance to their treatment plan differed by technology and patient characteristics. Our findings discussed implications for India’s efforts to combat tuberculosis.
In Guinea, where maternal, infant and child mortality are prevalent, the government launched an ambitious community health strategy to achieve universal health care. Mathematica employed a qualitative study using semi-structure telephone interviews with stakeholders and providers to assess the strategy’s early results and potential for scale-up. Our findings revealed that the program was taking root in spite of the COVID pandemic but some logistical aspects must be addressed for successful national-level rollout of community-based services. Our research provided guidance to stakeholders charged with scaling the program throughout the country.
In Senegal, the Lecture Pour Tous (LPT) initiative taught reading in national languages in Grades 1 to 3 with the goal of improving student literacy. The project supplied enhanced continuous teacher professional development and coaching, and reinforced parent and community engagement. Mathematica employed mixed-methods research including lean testing, usability testing, and randomized control trials to test different models of implementation. Our research provided opportunities for project improvement, contributed to the literature on effective early grade reading strategies, and provided rigorous evidence that informed the Government of Senegal’s scaling of some project activities.
In India, the Tuberculosis Health Action Learning Initiative (THALI) deployed technology-enabled approaches to support tuberculosis patients in taking their daily treatment. Mathematica used mixed-methods analysis to evaluate the feasibility and utility of three adherence technologies. Our study included qualitative data collection and a review of administrative data to better understand the technologies and how patients’ compliance to their treatment plan differed by technology and patient characteristics. Our findings discussed implications for India’s efforts to combat tuberculosis.
In Guinea, where maternal, infant and child mortality are prevalent, the government launched an ambitious community health strategy to achieve universal health care. Mathematica employed a qualitative study using semi-structure telephone interviews with stakeholders and providers to assess the strategy’s early results and potential for scale-up. Our findings revealed that the program was taking root in spite of the COVID pandemic but some logistical aspects must be addressed for successful national-level rollout of community-based services. Our research provided guidance to stakeholders charged with scaling the program throughout the country.
Evidence & Insights From This Project
Podcast
Improving the Impact of Social Programs Through Better Evaluation
This episode of Mathematica’s On the Evidence podcast features highlights from a recent convening on improving the impact of social programs through a more comprehensive approach to design and evaluation.
Learn MoreRelated Staff
More like this from Mathematica
Featured Project
Tracer Study of the Akazi Kanoze Youth Livelihoods Project in Rwanda
See Clearly. Act Quickly.
From local to global challenges in health, human services, and international development, we’re here to improve public well-being and make progress together. Learn more about becoming a Mathematica client or partner.
Work With Us