META Evaluierung - ADA Projekt und Programm Evaluierungen 2016-2018



Contract partner: CEval - Centrum für Evaluation GmbH, Universität des Saarlandes Country: Entwicklungsländer, unspezifisch Funding amount: € 62.431,20 Project start: 15.08.2018 End: 31.12.2018

Short Description:

Overall goal


The overall goal of the evaluation is to identify ways to improve the quality of (internal and external) project and programme evaluations. It should develop recommendations on what aspects to improve and how to increase the quality and usefulness of project and programme evaluations at ADA. These should include next steps to improve the project and programme evaluation tool (evaluation design and implementation). Ultimately the meta-evaluation should contribute to making project and programme evaluations more effective in increasing ADA’s performance.


Expected results


As a first step it aims to better understand the causal pathways of project and programme evaluations in ADA and what is actually expected and assumed. It aims to assess the quality and usefulness of project and programme evaluations at ADA and to provide an overall assessment of their strengths and weaknesses. It also aims to identify enabling and hindering factors for evaluation quality and use..


The evaluation team is expected to deliver the following products:

• draft and final quality assessment protocol, in cooperation with ADA Evaluation Unit

• draft and final inception report, including final quality assessment protocol, sampling plan and survey questionnaire

• presentation of preliminary findings (for virtual meeting)

• individual quality assessments for each evaluation

• draft and final evaluation Report


The expected results of this meta-evaluation are :

- Quality assessment of PP evaluations

- Identification of strengths and weaknesses of PP evaluations

- Suggestions for improvement of quality and usefulness of PP evaluations as well as the evaluation system


Target group / Beneficiaries


The direct beneficiaries of the evaluation are

- the Executive Unit Evaluation and Statistics (total of 6 people)

- ADA Senior Management (total of 3 people)

for strategic decision making regarding project and programme evaluations, as well as

- ADA PP staff at Headquarters (total of 39 people)

- KOBÜ Managers (total of 12 people) and local programm managers and advisors (around 20 people)

for discussion and follow up to the evaluation.


Activities


The meta-evaluation will be desk-based with no foreseen travel (apart from an initial kick off Workshop and presentation). The main data collection methods that are going to be applied are: document Review, the assessment of evaluation quality which will be conducted based on a sample of evaluation Reports, Survey and interviews


Context


The meta-evaluation at hand is ADA’s first meta-Evaluation.

project number 2835-00/2018
source of funding OEZA
sector Staatsführung & Zivilgesellschaft, allgemein
tied 62431,2
modality Other technical assistance
marker
  • Policy marker: are used to identify, assess and facilitate the monitoring of activities in support of policy objectives concerning gender equality, aid to environment, participatory development/good governance, trade development and reproductive, maternal, newborn and child health. Activities targeting the objectives of the Rio Conventions include the identification of biodiversity, climate change mitigation, climate change adaptation, and desertification.
    • 1= policy is a significant objective of the activity
    • 2= policy is the principal objective of the activity
  • Donor/ source of funding: The ADA is not only implementing projects and programmes of the Austrian Development Cooperation , but also projects funded from other sources and donors such as
    • AKF - Foreign Disaster Fund of the Austrian federal government
    • BMLFUW - Federal Ministry for Agriculture, Forestry, Environment and Water
    • EU - Funds of the European Commission
    • Others - various other donors are listed in ADA’s annual business report.
  • Type of Aid – Aid modalities: classifies transfers from the donor to the first recipient of funds such as budget support, core contributions and pooled programmes and funds to CSOs and multilateral organisations, project-type interventions, experts and other technical assistance, scholarships and student costs in donor countries, debt relief, administrative costs and other in-donor expenditures.
  • Purpose/ sector code: classifies the specific area of the recipient’s economic or social structure, funded by a bilateral contribution.
  • Tied/Untied: Untied aid is defined as loans and grants whose proceeds are fully and freely available to finance procurement from all OECD countries and substantially all developing countries. Transactions are considered tied unless the donor has, at the time of the aid offer, clearly specified a range of countries eligible for procurement which meets the tests for “untied” aid.
Back to list