Evaluierung Environmental and Social Impact Management (ESIM) System
ADA’s Evaluation Unit (EVAL) is commissioning a strategic evaluation of the Environment and Social Impact Management at ADA. The evaluation is to be conducted by a team of external consultants between August 2018 and January 2019.
E(G)SIM is a relatively new management system and involves changes in ADA’s project and programme appraisal and management. At the time of the publication of the manual it was envisaged that a review would take place in 2017 to provide for early learning and potential adjustments.
The primary purpose of this evaluation is to learn from the recent experience of ADA in introducing and implementing different aspects of E(G)SIM. The evaluation aims to provide evidence and lessons as an input into the ongoing process of implementing the follow up system, EGSIM. It will provide recommendations that likely consider a variety of scenarios (in terms of resource needs and prioritization) for moving ahead with EGSIM.
The primary users of the evaluation results are
- ADA senior management and strategic decision makers - total of 3 People
and the actual users of E(G)SIM, consisting of:
- the E(G)SIM appraisal team (T&Q) - total of 6 People
- implementers of the results of E(G)SIM appraisals (project owners) - total of 39 ADA staff at HQ and 12 KOBÜ staff
- those responsible for following up and monitoring the implementation of the results of the E(G)SIM appraisals (project owners, ADA programme managers, coordination offices) - total of more than 100 partners
The evaluation of E(G)SIM will be formative, in that it will examine the implementation process of ESIM and aims to provide inputs into the further development and use of EGSIM. Thus, it has elements of an ex-ante evaluation of EGSIM, as the prospects of successful implementation of EGSIM will be analysed before its implementation.
The evaluation will have a non-experimental design and will rely on qualitative data. Accordingly, methods and sources will be chosen to assure data and methods triangulation9, thus enabling multiple perspectives on every evaluation question. As no Theory of Change of E(G)SIM exists to date, the evaluation will collect information on the possible causal pathways, including assumptions. The aim is to construct a Theory of Change that will guide the inquiry and will be reviewed and adapted through an iterative process with evaluation stakeholders and informants.
It will be participatory and will aim to involve relevant stakeholders throughout the evaluation process. This will be done to assure the relevance and subsequently the use of the evaluation results.
As a means to this end, an evaluation reference group will be created and regular feedback loops with ADA management established. The focus will be on internal stakeholders, especially the users of E(G)SIM, which have been specified under “evaluation purpose”.
The ESIM Evaluation was foreseen when ESIM was published in July 2015. The ongoing accreditation process with the GCF, which had already induced an adaptation from ESIM to EGSIM was given as another reason to include it in ADA’s strategic evaluation plan 2017-20188.