Search results
- By impact evaluation, we mean rigorous evaluation methods designed to measure the causal effect of a program by comparing outcomes between a group that received an intervention (or treatment group) and a group that did not receive the intervention (or the comparison group).
www.worldbank.org/en/topic/education/publication/impact-evaluations
People also ask
What is impact evaluation in education?
Can impact evaluation design be used in program evaluation?
Why is impact evaluation important?
What is health impact evaluation?
What is an example of an impact evaluation?
What is a formative impact evaluation?
This guide is an introduction to help you critically evaluate other people’s evaluations, and also to run your own evaluation. In this guide we will also consider the research behind evaluating impact, the benefits of evaluating impact and how to carry out an impact evaluation.
- What Is Impact Evaluation?
- Why Do Impact Evaluation?
- When to Do Impact Evaluation?
- Who to Engage in The Evaluation Process?
- How to Plan and Manage An Impact Evaluation?
- What Methods Can Be Used to Do Impact Evaluation?
- How Can The Findings Be Reported and Their Use supported?
- Page Contributors
An impact evaluation provides information about the impacts produced by an intervention. The interventionmight be a small project, a large programme, a collection of activities, or a policy. Many development agencies use the definition of impacts provided by the Organisation for Economic Co-operation and Development – Development Assistance Committ...
An impact evaluation can be undertaken to improve or reorient an intervention (i.e., for formative purposes) or to inform decisions about whether to continue, discontinue, replicate or scale up an intervention (i.e., for summative purposes). While many formative evaluations focus on processes, impact evaluations can also be used formatively if an i...
An impact evaluation should only be undertaken when its intended use can be clearly identified and when it is likely to be able to produce useful findings, taking into account the availability of resources and the timing of decisions about the intervention under investigation. An evaluability assessmentmight need to be done first to assess these as...
Regardless of the type of evaluation, it is important to think through who should be involved, why and how they will be involved in each step of the evaluation process to develop an appropriate and context-specific participatory approach. Participation can occur at any stage of the impact evaluation process: in deciding to do an evaluation, in its ...
Like any other evaluation, an impact evaluation should be planned formally and managed as a discrete project, with decision-making processes and management arrangements clearly described from the beginning of the process. Planning and managing include: 1. Describing what needs to be evaluated and developing the evaluation brief 2. Identifying and m...
Framing the boundaries of the impact evaluation
The evaluation purpose refers to the rationale for conducting an impact evaluation. Evaluations that are being undertaken to support learning should be clear about who is intended to learn from it, how they will be engaged in the evaluation process to ensure it is seen as relevant and credible, and whether there are specific decision points around where this learning is expected to be applied. Evaluations that are being undertaken to support accountability should be clear about who is being h...
Defining the key evaluation questions (KEQs) the impact evaluation should address
Impact evaluations should be focused around answering a small number of high-level key evaluation questions (KEQs) that will be answered through a combination of evidence. These questions should be clearly linked to the evaluative criteria. For example: 1. KEQ1: What was the quality of the intervention design/content? [assessing relevance, equity, gender equality, human rights] 2. KEQ2: How well was the intervention implemented and adapted as needed? [assessing effectiveness, efficiency] 3. K...
Defining impacts
Impacts are usually understood to occur later than, and as a result of, intermediate outcomes. For example, achieving the intermediate outcomes of improved access to land and increased levels of participation in community decision-making might occur before, and contribute to, the intended final impact of improved health and well-being for women. The distinction between outcomes and impacts can be relative, and depends on the stated objectives of an intervention. It should also be noted that s...
The evaluation report should be structured in a manner that reflects the purpose and KEQs of the evaluation. In the first instance, evidence to answer the detailed questions linked to the OECD-DAC criteria of relevance, effectiveness, efficiency, impact and sustainability, and considerations of equity, gender equality and human rights should be pre...
The content for this page was compiled by: Greet Peersman The content is based on ‘UNICEF Methodological Briefs for Impact Evaluation’, a collaborative project between the UNICEF Office of Research – Innocenti, BetterEvaluation, RMIT University and the International Initiative for Impact Evaluation (3ie).The briefs were written by (in alphabetical ...
This compendium was produced by the World Bank’s Education team, in close collaboration with Development Research Group, Development Impact Group, and Strategic Impact Evaluation Fund. Evidence-informed insights to improve education and learning outcomes in low- and middle-income countries in early childhood to secondary education, teacher ...
Impact evaluation is a type of evaluation that assesses the long-term effects of a program, policy, or intervention on its intended beneficiaries. It involves examining whether the program has achieved its intended outcomes and whether any unintended consequences have occurred.
What is ‘impact’? Impact refers to an effect of an initiative or intervention, whether it is positive or negative, direct or indirect, intended or unintended, on an outcome.1 . Why evaluate? To build a better understanding of your audience (their interests, behaviours, etc.);
developing a valid research model of the quality of education, covering the intention, implementation and impact of the curriculum. designing an inspection approach that focused on the collection...
Nov 6, 2019 · Overview. This chapter will discuss impact evaluation, an important method of measuring the effectiveness of an educational intervention. This form of evaluation represents a subset of program evaluation and focuses on outcomes and consequential events related to an educational intervention.
