Truth telling by third-party audits and the response of polluting firms: Experimental evidence from India

Truth telling by third-party audits and the response of polluting firms: Experimental evidence from India

3ie Impact Evaluation Report 10

Esther Duflo, Michael Greenstone, Rohini Pande and Nicholas Ryan

How accurate and credible is an environmental audit if the auditor is chosen and paid for by the firm being audited? In this 3ie-supported impact evaluation report, Esther Duflo, Michael Greenstone, Rohini Pande and Nicholas Ryan provide a clear answer. Their impact evaluation of an environmental audit scheme in Gujarat shows such an arrangement encourages corruption and misreporting of industrial plant emissions. Independent audits on the other hand produce more accurate reports and prompt firms to curtail pollution.

In response to these findings, the Gujarat Pollution Control Board (GPCB) is changing its regulations to ensure that audits are independent.

The impact evaluation

This impact evaluation in Gujarat is the first randomised controlled trial conducted on an environmental regulation. It examines the impact of reforming the system of environmental audits for industrial plants.

The trial involved a sample 473 audit-eligible plants in Ahmedabad and Surat in which 233 were exposed to the new system and the remaining acted as the control group. In the control group, plants remained in the status quo system, directly choosing and paying their third party auditors. In the treatment group, auditors were randomly assigned to the plant and paid a fixed fee from a central pool of funds. In addition, their audit reports were subjected to random back-checks by independent agencies. In the second year, auditors working in the treatment group were paid a bonus for accurate reporting.

Results

The findings of this study are:

  •  Auditors working under the standard scheme were systematically under-reporting pollution readings.
  • Auditors in the modified scheme reported much more accurately, as measured by comparisons of auditor reports and independent back-checks, showing many more firms to be above the threshold.
  • Plants that were part of the improved audit scheme reduced their pollution emissions.

Policy influence

On 23 January 2015, the GPCB reformed its environmental auditing system based on the findings from this study. As per the new guidelines, environmental auditors in Gujarat will now be randomly assigned to industrial plants and have their work double-checked for accuracy.

Using information to break the political resource curse in natural gas management in Mozambique

Using information to break the political resource curse in natural gas management in Mozambique

Impact evaluation 3ie 2019
This study evaluated the impact of providing information to local leaders and communities about the discovery of natural gas in Mozambique, and the implications for provincial government revenues and job creation.

Harnessing transparency initiatives to improve India’s environmental clearance process for the mineral mining sector

Harnessing transparency initiatives to improve India’s environmental clearance process for the mineral mining sector

Impact evaluation 3ie 2019
This study evaluated the impact of a set of reforms to the environmental clearance process in India, which included subjecting larger projects to scrutiny from regulators, independent experts and the public.

Impacts of removing user fees for maternal health services on universal health coverage in Kenya

Impacts of removing user fees for maternal health services on universal health coverage in Kenya

Impact evaluation 3ie 2018

This evaluation examines both the short- and long-term impacts of removing user fees for maternal health services in Kenya on low-income women’s maternal health facilities use.

Impact of voice reminders to reinforce harvest aggregation services training for farmers in Mali

Impact of voice reminders to reinforce harvest aggregation services training for farmers in Mali

Impact evaluation 3ie 2018

Authors evaluated the impact of mobile phone voice reminders for a pre- and post-harvest grain management training, on farmer behaviour and household income.

Impacts of Breakthrough’s school-based gender attitude change programme in Haryana, India

Impacts of Breakthrough’s school-based gender attitude change programme in Haryana, India

Impact evaluation 3ie 2018

This evaluation studies the impact of a gender attitude change programme in government-run secondary schools in four districts of Haryana.