Replication

We set up our Replication Programme to address the need for a freely available global public good that helps improve the quality and reliability of impact evaluation evidence used for development decision-making. Replication is the most established method of research validation in science, yet it has not been fully embraced by the research community or development donors, leading to this gap.

What is replication?

The 3ie programme highlights the benefits of replicating impact evaluations of development studies to incentivise replication of selected influential, innovative or controversial impact evaluations. Since 2012, we have funded more than 20 internal replications. This type of replication uses data from the original study and possibly existing secondary datasets from the same location to check the validity and robustness of the estimations and recommendations.

View our Replication Programmes

Where 3ie-funded replication studies confirm that the impact evaluation findings are valid and robust, they lend additional credibility to these findings for use in policy and programme decision-making.

For impact evaluations revealed to have invalid or non-robust findings, the replication results caution decision makers in the use of those findings. The overall benefit of 3ie’s programme, though, is to improve the incentives for all impact evaluators to conduct careful analysis leading to credible findings in the first place.

This selected bibliography attests to the fact that there is a growing number of replications in economics. For a multidisciplinary list of previous research on the practice of replication, see our replication methodologies bibliography. A comprehensive database of replication studies can also be found on the University of Göttingen's replication wiki website.

Related content

Treatment as prevention: a replication study on early antiretroviral therapy initiation and HIV-1 transmission

Replication paper 3ie 2020
 
Eric Djimeu and Eleanor G Dickens conduct a replication of the HPTN 052 study by Cohen and colleagues that evaluates the impact of early initiation of antiretroviral therapy on rates of sexual transmission of HIV-1.

Biometric Smartcards and payment disbursement: a replication study of a state capacity-building experiment in India

Replication paper 3ie 2019
 
The National Rural Employment Guarantee Scheme and Social Security Pension are two of the largest employment programmes in Andhra Pradesh. Muralidharan and colleagues (2016) investigated the impacts of biometrically-authenticated payment infrastructure (Smartcards) on beneficiaries of the two employment programmes.

Risk sharing and transaction costs: a replication study of evidence from Kenya’s mobile money revolution

Replication paper 3ie 2019
 
This replication study starts with the twin strategies of push-button and pure replications of the original study. It then followed this up with various consistency and robustness checks, such as propensity score matching and the Tobit model specification.

Cash and change: a replication study of a cash transfer experiment in Malawi

Replication paper 3ie 2019
 
Maira Reimão conducted a replication of a 2011 study, Cash or condition? Evidence from a cash transfer experiment, by Baird and colleagues, which is one of the few studies that empirically compares the impact of unconditional cash transfers to that of conditional cash transfers.

Impact of unconditional cash transfers: a replication study of the short-term effects in Kenya

Replication paper 3ie 2019
 

Wang and colleagues replicate the results of a randomized evaluation carried out by Haushofer and Shapiro in 2016.

Savings revisited: a replication study of a savings intervention in Malawi

Replication paper 3ie 2018
 

Jesper Stage and Tharshini Thangavelu replicate the results of a randomized evaluation carried out by Lasse Brune and colleagues in 2016 in Malawi.

There are no impact evaluations
There are no systematic reviews
There are no evidence gap maps

Treatment as prevention: a replication study on early antiretroviral therapy initiation and HIV-1 transmission

Replication paper 3ie 2020
 
Eric Djimeu and Eleanor G Dickens conduct a replication of the HPTN 052 study by Cohen and colleagues that evaluates the impact of early initiation of antiretroviral therapy on rates of sexual transmission of HIV-1.

Biometric Smartcards and payment disbursement: a replication study of a state capacity-building experiment in India

Replication paper 3ie 2019
 
The National Rural Employment Guarantee Scheme and Social Security Pension are two of the largest employment programmes in Andhra Pradesh. Muralidharan and colleagues (2016) investigated the impacts of biometrically-authenticated payment infrastructure (Smartcards) on beneficiaries of the two employment programmes.

Risk sharing and transaction costs: a replication study of evidence from Kenya’s mobile money revolution

Replication paper 3ie 2019
 
This replication study starts with the twin strategies of push-button and pure replications of the original study. It then followed this up with various consistency and robustness checks, such as propensity score matching and the Tobit model specification.

Cash and change: a replication study of a cash transfer experiment in Malawi

Replication paper 3ie 2019
 
Maira Reimão conducted a replication of a 2011 study, Cash or condition? Evidence from a cash transfer experiment, by Baird and colleagues, which is one of the few studies that empirically compares the impact of unconditional cash transfers to that of conditional cash transfers.

Impact of unconditional cash transfers: a replication study of the short-term effects in Kenya

Replication paper 3ie 2019
 

Wang and colleagues replicate the results of a randomized evaluation carried out by Haushofer and Shapiro in 2016.

Mobile money and its impact on improving living conditions in Niger: a replication study

Replication paper 3ie
 

Edmundo Beteta and colleagues replicate the results of a randomized evaluation carried out by Aker and colleagues in 2016 in Niger.

There is no related content.