Evaluierung Environmental and Social Impact Management (ESIM) System

Contract partner: Goss Gilroy Inc. Country: Entwicklungsländer, unspezifisch Funding amount: € 59.142,00 Project start: 01.10.2018 End: 31.03.2019

Short Description:

Overall goal

ADA’s Evaluation Unit (EVAL) is commissioning a strategic evaluation of the Environment and Social Impact Management at ADA. The evaluation is to be conducted by a team of external consultants between August 2018 and January 2019.

E(G)SIM is a relatively new management system and involves changes in ADA’s project and programme appraisal and management. At the time of the publication of the manual it was envisaged that a review would take place in 2017 to provide for early learning and potential adjustments.

Expected results

The primary purpose of this evaluation is to learn from the recent experience of ADA in introducing and implementing different aspects of E(G)SIM. The evaluation aims to provide evidence and lessons as an input into the ongoing process of implementing the follow up system, EGSIM. It will provide recommendations that likely consider a variety of scenarios (in terms of resource needs and prioritization) for moving ahead with EGSIM.

Target group / Beneficiaries

The primary users of the evaluation results are

- ADA senior management and strategic decision makers - total of 3 People

and the actual users of E(G)SIM, consisting of:

- the E(G)SIM appraisal team (T&Q) - total of 6 People

- implementers of the results of E(G)SIM appraisals (project owners) - total of 39 ADA staff at HQ and 12 KOBÜ staff

- those responsible for following up and monitoring the implementation of the results of the E(G)SIM appraisals (project owners, ADA programme managers, coordination offices) - total of more than 100 partners


The evaluation of E(G)SIM will be formative, in that it will examine the implementation process of ESIM and aims to provide inputs into the further development and use of EGSIM. Thus, it has elements of an ex-ante evaluation of EGSIM, as the prospects of successful implementation of EGSIM will be analysed before its implementation.

The evaluation will have a non-experimental design and will rely on qualitative data. Accordingly, methods and sources will be chosen to assure data and methods triangulation9, thus enabling multiple perspectives on every evaluation question. As no Theory of Change of E(G)SIM exists to date, the evaluation will collect information on the possible causal pathways, including assumptions. The aim is to construct a Theory of Change that will guide the inquiry and will be reviewed and adapted through an iterative process with evaluation stakeholders and informants.

It will be participatory and will aim to involve relevant stakeholders throughout the evaluation process. This will be done to assure the relevance and subsequently the use of the evaluation results.

As a means to this end, an evaluation reference group will be created and regular feedback loops with ADA management established. The focus will be on internal stakeholders, especially the users of E(G)SIM, which have been specified under “evaluation purpose”.


The ESIM Evaluation was foreseen when ESIM was published in July 2015. The ongoing accreditation process with the GCF, which had already induced an adaptation from ESIM to EGSIM was given as another reason to include it in ADA’s strategic evaluation plan 2017-20188.

project number 2817-01/2018
source of funding OEZA
sector Andere multisektorielle Maßnahmen
tied 59142
modality Other technical assistance
marker Environment: 2, Gender: 1, Democracy: 1
  • Policy marker: are used to identify, assess and facilitate the monitoring of activities in support of policy objectives concerning gender equality, aid to environment, participatory development/good governance, trade development and reproductive, maternal, newborn and child health. Activities targeting the objectives of the Rio Conventions include the identification of biodiversity, climate change mitigation, climate change adaptation, and desertification.
    • 1= policy is a significant objective of the activity
    • 2= policy is the principal objective of the activity
  • Donor/ source of funding: The ADA is not only implementing projects and programmes of the Austrian Development Cooperation , but also projects funded from other sources and donors such as
    • AKF - Foreign Disaster Fund of the Austrian federal government
    • BMLFUW - Federal Ministry for Agriculture, Forestry, Environment and Water
    • EU - Funds of the European Commission
    • Others - various other donors are listed in ADA’s annual business report.
  • Type of Aid – Aid modalities: classifies transfers from the donor to the first recipient of funds such as budget support, core contributions and pooled programmes and funds to CSOs and multilateral organisations, project-type interventions, experts and other technical assistance, scholarships and student costs in donor countries, debt relief, administrative costs and other in-donor expenditures.
  • Purpose/ sector code: classifies the specific area of the recipient’s economic or social structure, funded by a bilateral contribution.
  • Tied/Untied: Untied aid is defined as loans and grants whose proceeds are fully and freely available to finance procurement from all OECD countries and substantially all developing countries. Transactions are considered tied unless the donor has, at the time of the aid offer, clearly specified a range of countries eligible for procurement which meets the tests for “untied” aid.