The impact of India's JSY conditional cash transfer programme: a replication study

The impact of India's JSY conditional cash transfer programme: a replication study

3ie Replication Paper 6

Natalie Carvalho and Slawa Rokicki

In this study, Natalie Carvalho and Slawa Rokicki conduct an internal replication of the first impact evaluation of India’s Janani Suraksha Yojana (JSY) intervention, a large-scale conditional cash transfer programme designed to incentivise the use of formal birthing facilities. The original impact evaluation by Stephen S. Lim, Lalit Dandona, Joseph A. Hoisington, Spencer L. James, Margaret C. Hogan and Emmanuela Gakidou from 2010 showed positive effects of the programme across India. JSY is one of the largest programmes of its kind in the world. Given its scale, any study related to this conditional cash transfer programme is crucial to understanding the effectiveness of the programme in improving maternal and neonatal health outcomes and reducing existing inequities in access. Understanding the programme’s effectiveness is important for policymakers in India and is also relevant for other countries with low rates of institutional delivery and poor reproductive health outcomes.

Specifically focusing on the exact matching analysis, the replication study by Carvalho and Rokicki reexamines both the original study’s methodological approach and the robustness of the research to various model specifications. In the measurement and estimation analysis, the researchers check the original matching algorithm and explore state-level multi-level modeling to test the robustness of the original research. They also explore differences in JSY’s implementation, to see if these differences influenced the original research findings. 

The researchers find the original results robust to changes in model specifications and analysis. The study does find state-level differences in health coverage and mortality outcomes, which should be considered in future analyses of the programme. The researchers conclude that the effect of JSY on health outcomes may be understated when averaged over all states and districts, especially when accounting for the implementation lag across the country. 

3ie also invites formal replies from the original authors. If received, the reply will be posted on the 3ie website alongside the replication study.

3ie Replication paper 18

Savings revisited: a replication study of a savings intervention in Malawi

Replication paper 3ie 2018

Jesper Stage and Tharshini Thangavelu replicate the results of a randomized evaluation carried out by Lasse Brune and colleagues in 2016 in Malawi.

RPS19

Mobile money and its impact on improving living conditions in Niger: a replication study

Replication paper 3ie

Edmundo Beteta and colleagues replicate the results of a randomized evaluation carried out by Aker and colleagues in 2016 in Niger.

3ie Replication Paper 17

Thou shalt be given... but how? A replication study of a randomized experiment on food assistance in northern Ecuador

Replication paper 3ie 2018

Lhachimi and Seuring re-examine the results of a cluster-randomized evaluation carried out by Melissa Hidrobo and colleagues in 2013 in two provinces in northern Ecuador.

RP16

Preventing HIV and HSV-2 through improving knowledge and attitudes: a replication study of a multicomponent intervention in Zimbabwe

Replication paper 3ie 2018
Yu and colleagues conducted a replication study of an influential paper “The Regai Dzive Shiri Project: results of a randomised trial of an HIV prevention intervention for Zimbabwean youth” by Frances Cowan and colleagues.

RP14

When to start ART? A replication study of timing of antiretroviral therapy for HIV-1-associated Tuberculosis

Replication paper 3ie 2018
In this paper, the research team conducted a replication study of Havlir and others’ 2011 study, “Timing of antiretroviral therapy for HIV-1 infection and tuberculosis.”