Skip to main content
Subscribe

Home Page Secondary Menu

  • Blogs
  • Events
  • Jobs
  • Media
  • Newsletter
  • Resources
  • Donate
3ie

Home Page Primary Menu

  • About
    • Team
    • Supporters
    • Members
    • At a glance
    • Research Commissioning Centre
    • Governance
    • Partners
    • Institutional policies and reports
    • Contact us
  • Services
  • Research
  • Evidence Hub
    • Development Evidence Portal
    • Evidence gap maps
    • Evidence impact summaries
    • Journal of Development Effectiveness
    • Publications
    • Replication studies
  • Impact

Home Page Primary Menu

  • About
    • Team
    • Supporters
    • Members
    • At a glance
    • Research Commissioning Centre
    • Governance
    • Partners
    • Institutional policies and reports
    • Contact us
  • Services
  • Research
  • Evidence Hub
    • Development Evidence Portal
    • Evidence gap maps
    • Evidence impact summaries
    • Journal of Development Effectiveness
    • Publications
    • Replication studies
  • Impact

Home Page Secondary Menu

  • Blogs
  • Events
  • Jobs
  • Media
  • Newsletter
  • Resources
  • Donate

Breadcrumb

  1. Home
  2. Evidence hub
  3. Evidence impact summaries
  4. Improving government health services and data collection in Rajasthan, I...

Improving government health services and data collection in Rajasthan, India

 

About 3ie evidence impact summaries

Read how 3ie verifies and classifies evidence impact

Highlights

Evidence impact

  • Positive impacts on immunisation rates as a result of the Khushi Baby system of digital health records led the government to partner with the research and implementation team for the new Nirogi Rajasthan (‘Disease-free Rajasthan’) scheme.
  • The new scheme includes features of the evaluated Khushi Baby system, including mobile application-based health (mHealth) information collection and portable digital health records.

Factors that contributed to impact

  • The researchers piloted a novel mHealth innovation – digital health records stored in amulets with microchips – that had already won several recognitions, including the UNICEF Wearables for Good challenge.
  • The pilot was implemented through the government health system via frontline health workers and supervising officials, thereby involving them in the process from the outset and building interest in the findings.
  • A senior health department official highlighted the acceptability of the digital amulets amongst caregivers and the promise of improving administrative monitoring, while reducing the burden of paperwork as reasons for the government’s continued interest in Khushi Baby’s mHealth intervention.
     

Impact evaluation details

Title: A mixed-methods evaluation to determine the effects of a novel mHealth platform…
Authors: Ruchit Nagar, Mohammad Sarparajul Ambiya, Pawan Singh, Hamid Abdullah, Vijendra Bansal, Logan Stone, Deepa Manjanatha, Preethi Venkat, Mohammed Shahnawaz, Vaidehi Supatkar, Arjun Singh and Dhanwant Purawat
Status : Completed January 2020
Improving government health services and data collection in Rajasthan, India

Context

Vaccine-preventable conditions put 9.4 million children across India at risk of death or disease each year, making expanding and deepening immunisation an urgent priority. According to the 2015–2016 National Family Health Survey, less than half of the children in Rajasthan’s Udaipur district got all of their vaccine shots.

In response, 3ie supported US-based non-profit Khushi Baby to implement and evaluate a new mHealth system in five rural blocks in Rajasthan’s Udaipur district, in partnership with the state’s health department. Treatment areas were the catchment areas of the rural health outposts or sub-centres where the Khushi Baby system was implemented.

The Khushi Baby system included multiple components aimed at frontline workers and caregivers. Mothers who had just delivered a child received a wearable digital health record for infants, designed to resemble a traditional amulet. Frontline health workers received tablets with biometric verification and an Android application for scanning the pendants and entering data on immunisations and other health indicators for mothers and children.

The system sent automated voice-call reminders in the local dialect about the immunisation schedule to the participant caregivers. It also enabled the Khushi Baby team and health officials to track maternal and child health data through online dashboards.

Evidence

The cluster randomised trial of the Khushi Baby system found that it had a significant positive impact on the immunisation rates of infants. By the end of the two-year evaluation in 2018, children in the treatment areas were 1.66 times more likely to be fully immunised than those in the control areas, which used only the existing paper-based maternal and child health tracking systems. The cost per 10 percentage point increase in the likelihood of full immunisation was US$0.68 (INR 50) per child.
Testimonies from frontline health workers in the treatment arm indicated they were satisfied with the intervention and perceived it to be the cause of improved beneficiary attendance at health camps. However, the evaluation found no decreases in hospitalisation, decreases in infant mortality rates or increases in the retention of children’s health records.

‘… if we work in collaboration with the health structure and we try to understand the requirement of that system. and then we make our process and formulate the things, and then after identifying those gaps we put in our evidence to fulfil those gaps, then I think it is very promising …’ — Dr Sanjeev Tak, deputy director medical and health services, Department of Medical and Health Services, Udaipur division, Government of Rajasthan

Evidence impacts

Type of impact: Inform the design of other programmes

Where findings from the evaluation or review inform the design of a programme(s) other than the one(s) evaluated.

This is one of 3ie’s seven types of evidence use. Impact types are based on what we find in the monitoring data for an evaluation or review. Due to the nature of evidence-informed decision-making and action, 3ie looks for verifiable contributions that our evidence makes, not attribution.

Read our complete evidence impact typology and verification approach here.

Close window

Catalysed collaboration on a new government programme

The Rajasthan government appointed the Khushi Baby team as a technical partner for the government’s new Nirogi Rajasthan scheme, based on discussions of evaluations. Under the scheme, frontline workers were to conduct a state-wide health census, collecting health information using a customised mobile application. Similar to the digital pendants under the evaluated programme, the scheme also envisaged portable digital health record cards for all residents. The government aimed to leverage the data and link health records to improve monitoring and delivery of government health services.

Suggested citation

International Initiative for Impact Evaluation (3ie), 2020. Improving frontline data collection and government health services in Rajasthan, India [online summary], Evidence Impact Summaries. New Delhi: 3ie.

Evidence impact summaries aim to demonstrate and encourage the use of evidence to inform programming and policymaking. These reflect the information available to 3ie at the time of posting. Since several factors influence policymaking, the summaries highlight contributions of evidence rather than endorsing a policy or decision or claiming that it can be attributed solely to evidence. If you have any suggestions or updates to improve this summary, please write to influence@3ieimpact.org

Last updated on 13th November 2020
Print this page Download this page Share this page  

About Footer

  • About

Services Footer

  • Services

Our work

  • Research

Evidence hub

  • Evidence Hub

Donate

  • Donate
 

Copyright © 2025 International Initiative for Impact Evaluation (3ie)| All rights reserved | Terms of use | Privacy policy | Accessibility statement