Spotlight
Global Evidence Commitment – First Annual Convening
GEC



The Global Evidence Commitment signatories, with keynote remarks from USAID Chief Economist Dr Dean Karlan, are holding an IDB-hosted event on 21 October to discuss the promise and progress of the pledge. In October 2023—as part of IDB’s Knowledge Week—3ie, together with several leading international development institutions, launched the Global Evidence Commitment. The Commitment is an opportunity for organizations to come together to improve their culture and practice of evidence use. 
 
The signatories, which to date include the International Initiative for Impact Evaluation (3ie), the Inter-American Development Bank, the Millennium Challenge Corporation (MCC), the Norwegian Agency for Development Cooperation (Norad), the UK’s Foreign Commonwealth and Development Office (FCDO), Germany’s KfW Development Bank, and the U.S. Agency for International Development (USAID), commit to mutual support and learning as they seek to deploy institutional levers summarized in the TRIPS framework to improve their evidence culture.
 
This public event will include a panel discussion of Global Evidence Commitment signatory organizations following the keynote and will kick off the first annual convening.
 
Please sign up for the event to join in person or virtually.

Register here

Featured
Women’s collective enterprises in rural India – learning from the Swashakt program 



To mark the International Day of Rural Women and upcoming Women’s Entrepreneurship Day, we are showcasing key findings from 3ie’s Swashakt program on empowering Indian women’s collectives. Supported by the Bill & Melinda Gates Foundation, this program included the implementation of four pilot and five at-scale projects that supported collective and group-based models for women-led businesses across 10 Indian states.

Overview of process evaluations under Swashakt
While 3ie led three process evaluations of at-scale projects, we collaborated with IDinsight and IMAGO Global Grassroots on one study. Here is a summary of the programs we studied.

  • We evaluated a program to form women-owned agro-producer companies to increase their incomes. This program was implemented by ACCESS Development Services in select districts of West Bengal, Rajasthan, and Odisha (see report)
  • We evaluated a program that set up village-level common-interest groups (part of cooperative societies) and trained women in crafts. This program was implemented by URMUL Trust in Rajasthan (see report)
  • We evaluated a program implemented by the Chitrika Foundation in Andhra Pradesh and Telangana to mobilize women weavers into producer companies and provide technical and marketing training (see report).
  • We also worked with IDinsight to conduct a process evaluation of a program on agro-processing enterprises implemented by IMAGO Global Grassroots and Self Employed Women’s Association (SEWA) in Madhya Pradesh and Uttar Pradesh.

Setting up women’s collective enterprises in rural India: Learning from 3ie’s Swashakt program
We also conducted a synthesis of all four process evaluations, which provides insights into the barriers to training programs, how collectives transitioned from low to high-value enterprises, and the role of gender and social norms.
Read the report

Findings from a study on women in management training: Under the Chitrika-led project, the implementers worked to enhance managerial skills among women weavers through a micro-MBA program called the ‘Handmade MBA’ (HMBA) program. The larger goal of the HMBA program was to enhance women’s role in the management of the producer companies and their own businesses. Our study findings show that program participants benefited from certain modules, particularly those focused on HR and self-transformation. Read the working paper for detailed findings and recommendations.

Learn more about the Swashakt program | Listen to our podcast series

 

Featured
How to communicate a null-results impact evaluation



Evaluation findings tell us many things about a program, based on which we tell implementers and donors what worked, for whom, and at what cost—and with key takeaways, we help improve future programming for greater effectiveness. However, when the results do not show any effects, or they show adverse impacts—which may not be as rare as it seems—the challenge is bigger in terms of what to communicate and how to communicate it in the best way possible. It is important for evaluators to think about how we can still make our findings useful for our partners so they don’t get disheartened.

In our latest blog, evaluation director Sebastian Martinez offers six tips for communicating null results. He shows how null results offer an important opportunity for learning and introspection and why the way we talk about our evaluation results and findings is no less important than the findings themselves.

Read more

Featured
Navigating ethical considerations in evaluations 



Evidence production, especially in low- and middle-income countries, must be cognizant of ethical and security issues. To ensure that the evidence produced is credible and aligned with ethical practices, our Transparency, Reproducibility, and Ethical Evidence (TREE) initiative promotes stronger integration of ethical principles into research. As part of this, we offer the TREE Review Framework—a public good designed to complement the Institutional Review Board (IRB process—to help research teams evaluate and document the ethical considerations inherent in social science research. 

Earlier this year, our TREE team collaborated with the Education Endowment Fund (EEF) and Effective Basic Services Africa (eBASE Africa) to implement the TREE Review Framework in two upcoming evaluations in Cameroon. Our latest blog highlights how it impacted their evaluations, and the lessons learned from its implementation.

Read blog

Journal | Special issue on TREE

We also recently published a special issue of the Journal of Development Effectiveness that highlights issues around transparency and ethics in the context of impact evaluations. Read the complete issue here. To submit an article to the journal, please read the guidance here.

 

Funding
FCDO Research Commissioning Centre 

RCC banner

UK's Foreign, Commonwealth and Development Office (FCDO), through the Research Commissioning Centre (RCC), has announced a new upcoming funding opportunity for a scoping review of the science, research and innovation landscape in Southeast Asia. If you are interested in this opportunity, learn more here and sign up to receive updates.  

For more information, please visit the RCC section on 3ie’s website. To receive alerts for these and other opportunities, please sign up for funding alerts

The RCC is managed by 3ie and the University of Birmingham. You can learn more about it here or sign up to receive updates here.

 
Publications

Learning summary | How did integrating qualitative evidence within a synthesis improve our understanding of the impact of food systems and nutrition interventions on women’s empowerment and gender equality?
 


3ie in the Media | ‘Scientists are building giant ‘evidence banks’ to create policies that actually work’
This article in the Nature Journal is a compelling reminder of why timely and optimal use of all available evidence is more critical than ever. Read the piece to learn about 3ie’s milestone contribution to making more evidence accessible through our Development Evidence Portal and strengthening the institutionalization of evidence use across leading development and multilateral organizations through the Global Evidence Commitment.  
Read article

 

 
Events

Upcoming events

8th National Evaluation Capacities Conference (NEC 2024) | 14-18 October, Beijing
 
The UNDP Independent Evaluation Office (IEO), the China International Development Cooperation Agency (CIDCA) are co-organizing the 8th National Evaluation Capacities Conference (NEC 2024) conference in collaboration with the Global Evaluation Initiative (GEI). The conference theme, ‘Responsive Evaluation: For Government, For Inclusion, For the Future,’ underscores the importance of sharing progress and lessons learned in strengthening national evaluation systems, their role in achieving the SDGs and other development goals, and how new technologies and approaches in evaluation can facilitate the achievement of the SDGs. 3ie will be participating in two sessions at the conference.


Strengthening NES through Accessible, Actionable, and Relevant Evidence | 15 October | 2:00 – 3:00 PM CST
Panelists: Anca Dumitrescu, Lead Evaluation Specialist, 3ie; Thomas Kelly, Director of Evidence to Policy and Learning, 3ie; Candice Morkel, Director, Centre for Learning on Evaluation and Results – Anglophone Africa (CLEAR-AA); and Damit Serge Didier Amany, Manager of Impact Monitoring and Evaluation Unit, Banque Ouest Africaine de Développement. Click here to register for the livestream link.


Artificial Intelligence and the Opportunities it Brings to Evaluation | 16 October | 11:00 AM – 12:30 PM CST. 
Panelists: Patrizia Cocca, Communications and KM Lead, Global Evaluation Initiative; Anish Pradhan, ICT Specialist, UNDP; Marco Segone, Director, Evaluation Office, UNFPA, Lingrong Ying, PhD Candidate, Shanghai University of International Business and Economics; Thomas Kelly, Director of Evidence to Policy and Learning, 3ie; and Devika Lakhote, Data Scientist, 3ie. Click here to register for the livestream link.
Read more 

Past events

Fragile Lives | 1-2 October | Berlin

Fagile event panel
Fragile Lives 2024 highlighted the use of rigorous, scientific evidence to develop knowledge-based policy interventions in fragile, conflict-affected and underdeveloped settings. It focused specifically on how poly-crises shape individuals, institutions, and interventions at the micro-level and on the policies that can boost resilience and coping capacities in the context of these shocks.

As part of the Integration and Community Cohesion (AFK) session, Paul Thissen, Senior Evaluation and Communication Specialist at 3ie, spoke about ‘Building what kind of peace? Outcomes of a UN Peacebuilding project in Darfur’. He was joined by Tobias Risse (University of St. Gallen) and Mariajose Silva-Vargas (J-PAL Europe) and session chair Lame Ungwang (ISDC).

3ie Executive Director Marie Gaarder participated in two plenary sessions. On Day 1, she joined  Tilman Brück (HUB; IGZ; ISDC), Anne-Claire Luzot (WFP), Gilles Carbonnier (Geneva Graduate Institute; ICRC), Scott Gates (PRIO) and chair Anke Hoeffler (University of Konstanz) to reflect on The First Twenty Years of Research on Fragile Lives.

On Day 2, Gaarder spoke at the session focusing on Evidence in Peacebuilding: Needs, Learnings, Outcomes and Remaining Gaps, along with Tilman Brück (HUB; IGZ; ISDC), Bushra Hassan (PBSO), Erin Koenig (Global Affairs Canada), and chair Neil Ferguson (ISDC). 

 

 



15th European Evaluation Biennial Conference | 23-27 September 2024

15th European Evaluation Biennial Conference
The European Evaluation Society’s Better Together Conference was held in Rimini, Italy. The conference explored how collaboration can be more effective, transformative evaluation, and social change.  3ie participated in multiple sessions at the conference.

In the session 'Standing on the shoulders of giants: On the collaborative and coordinated use of existing evidence from evaluations’ on 25 September, 3ie staff shared insights from different collaborations on evidence mapping, synthesis and capacity strengthening with DEval.  3ie's Anca Dumitrescu  shared reflections from working with high-level policymakers through the West Africa Capacity building and Impact Evaluation (WACIE) while 3ie’s Tomasz Kozakiewicz shared a report that provides an overview of the state of evidence on each of the SDGs, using data from 3ie’s Development Evidence Portal and about taking a sectoral approach to in a recent evidence gap map on sexual and reproductive health and rights development interventions.

3ie’s Ingunn Gilje Storhaug and Mark Engelbert presented the findings and lessons for living synthesis based on the 3ie’s Living Evidence & Gap Map on Food Systems and Nutrition in the session titled ‘Food and agriculture: Improving food and agricultural systems through evaluation’. Devika Lakhote from 3ie joined Julian Glucroft (MCC) and Marina Apgar (IDS) for the session titled ‘Changing the rules of the game: The praxis of generating and using evidence for policy and institutional reform’ to present the Methods Menu on Policy and Institutional Reform and spoke about the praxis of generating and using evidence for this area of research. 

 

 


AfDB Evaluation Week | 17-19 September 2024
3ie’s Anca Dumitrescu and Deo Gracias led a pre-conference online workshop on ‘Cutting-edge approaches to communicating evaluative insights’ on 17 September at the 2024 African Development Bank Evaluation Week.
Read more  

 

 
Featured
Senior Research Fellow

Josh Fureson3ie’s Senior Research Fellows Program includes experts from various sectors – including development, evaluation, policy as well as academia. This month, we feature Josh Furgeson, who has more than 15 years of experience in program evaluation and systematic reviews. Read more

Since 2020, 3ie's Fellowship Program has contributed to achieving our mission by tapping into diverse expertise and experience across the world.