The International Food Policy Research Institute (IFPRI) seeks a consultant to undertake an assessment of the impacts of its recent causal impact evaluation research. IFPRI has undertaken rigorous causal impact evaluations on various innovations or interventions for many decades across various thematic domains (e.g., nutrition, social protection, agriculture) with those results feeding into decisionmaking. Some of those contributions to decisionmaking have been documented, but there is still much to assemble and learn from. It is expected that the consultancy will take about 25-30 days in total and travel is not necessary. For more details on the task, please see the terms of reference.
To apply, please send a cover message and CV to Frank Place (f.place@cgiar.org).
TERMS OF REFERENCE FOR CONSULTANT
Influence and Impacts of IFPRI Causal Impact Evaluation Research
The International Food Policy Research Institute (IFPRI) wishes to commission a consultant to carry out an impact assessment study of IFPRI's causal impact evaluation research1 over the period 2012-2022. This type of research program has long antecedents at IFPRI, notably in evaluation of social protection programs, but IFPRI's causal impact evaluation research has broadened into may thematic areas: (a) agriculture and natural resource management, (b) markets and agricultural value chains, (c) health and nutrition, (d) education, (e) governance mechanisms, and (f) social protection.
Many of the evaluations were conceived in partnership with funders and implementing organizations who sought to know if and how innovations, programs, or other interventions were beneficial and worthy of continued or increased investment. Case study evidence has already found that some of these studies were highly impactful, but there has been no comprehensive review across the many studies undertaken.
The impact assessment study should include the following types of analyses:
an assessment of the overall contributions of causal impact evaluation research in terms of the relevance and quality of its research, research capacity building, communications activities, and outputs and thematic area. Identification of challenges in achieving impacts and factors that may be associated with higher likelihood of contributing to impacts. validate and/or identify impacts from 2-3 case studies selected on the basis of likelihood of having significant impacts. where feasible, explore the use of IFPRI's causal impact evaluations in replication studies, systematic reviews, literature reviews, and teaching. examine the process by which IFPRI causal impact evaluations are designed and executed, including IRB review, study registrations, science and research quality assessments, partnership strategies, etc.It is expected that the methods used to produce those output will include:
Desk reviews of IFPRI causal impact evaluation outputs, IFPRI impact materials, as well as reporting of contributions to outcomes to funders and the CGIAR. Consultations with scientists and selected partners. In-depth case studies of selected causal impact evaluations and their influence. Use of analytical tools to trace through influences of research recommendations on decisions taken in relation to policies, programs, investments, and other actions.The consultant will lead the impact assessment study and take direct responsibility for the final report. IFPRI staff will help provide necessary background documents and assist with the organization of the case studies. The background studies iwll include several project evaluation and impact assessment studies that have already been conducted of IFPRI's causal impact evaluation research. IFPRI will also provide the consultant with a list of all the outputs from this body of research between 2012 and 2022, together with relevant use (e.g., download) and citations statistics from internal websites.
After an initial review of background materials, the consultant will be expected to visit IFPRI to meet with relevant staff and develop an agreed work plan and budget with IFPRI. The consultant will prepare a methodology paper which outlines the analytical approach. This will be followed by agreement on the case studies selected for a deeper analysis. A draft report will be submitted 90 days following the signing of the contract. It will be peer-reviewed and subsequently published as an IFPRI independent Impact Assessment Report.
1 Causal impact evaluations refer to the use of rigorous methods able to infer causality of a 'treatment' effects on specified outcomes. Randomized control trials are a gold standard, but other methods such as discontinuity and difference in differences analyses.