Assessment of the ASEAN Foundation’s Impact between 2015 to 2019
TOR for Consulting Services:
Assessment of the ASEAN Foundation’s Impact between 2015 to 2019
Three decades after ASEAN was established, ASEAN Leaders recognised that: there remained inadequate shared prosperity, ASEAN awareness and contact among people of ASEAN. It was of this concern that ASEAN Leaders established the ASEAN Foundation during ASEAN’s 30th Anniversary Commemorative Summit in Kuala Lumpur Malaysia on 15 December 1997.
After its establishment, the ASEAN Foundation has been tasked to support ASEAN’s community building efforts by promoting greater awareness of the ASEAN identity, human resource development, people-to-people interaction, and close collaboration among the business sector, civil society, academia and other stakeholders in ASEAN.
We continue to complement ASEAN priorities. To date, we work to strengthen the ASEAN Community.
We work in four thematic areas of education, arts and culture, media development and community building. We provide support in the form of scholarships, fellowships internships and exchanges. We organize meetings, conferences, roundtables and workshops in support of the ASEAN Community.
- Overall Objective of the Impact Assessment
The overall objective of the Assessment is to assess the impact of ASEAN Foundation’s work during the period 2015 to 2019, a period of 5 years. The Assessment will examine and provide strong evidence on the impact achieved, i.e. positive, negative, intended and unintended, on direct and indirect beneficiaries, analyse ASEAN Foundation’s contributions and identify specific factors that have enabled or disabled positive impact to occur. The Assessment will also review the relevance of our work, assess effectiveness, efficiency, sustainability of our programmatic interventions and document lessons learnt and best practice.
- Specific objectives
- To collect and aggregate data on numbers and types of people benefitting and in what ways from all the programmes that ASEAN Foundation has implemented during the period 2015 and 2019. ASEAN Foundation intends to assess the significant impact indicators in the lives of people at individual level
- To identify the key factors that that have helped or hindered impact to occur. The ASEAN Foundation intends to identify and assess in its approaches, strategies and relationships with other organisations, factors that have helped or hindered the achievement of lasting change for direct and indirect beneficiaries between 2015 and 2019.
- To document lessons learnt and best practices from the ASEAN Foundation’s interventions between 2015 and 2019. The ASEAN Foundation intends to identify and document lessons learnt and best practice that can be replicated/adapted and forward recommendations for future interventions in relation to initiatives and organisational development.
The evaluation is expected to ascertain whether or not the ASEAN Foundation’s programming has been relevant, efficient, effective, sustainable and impactful on the lives of beneficiaries. It will assess the impact of the ASEAN Foundation’s work both in terms of individual stories of change and on a more systematic basis, be able to collate how many people have benefitted and in what kind of ways. It will attempt to identify the extent to which the ASEAN Foundation initiatives have brought about positive change in the lives of those benefitting directly.
The Assessment will have these areas of investigation in order to respond to the specific objectives: i) The immediate and long-term impact the ASEAN Foundation has achieved for different beneficiaries through our initiatives at personal level; ii) The distinctive role played by the ASEAN Foundation and her relationship with other key players (funders, government and other CSOS). In particular assessing the effectiveness, relevance and efficiency of our initiatives, strategies and approaches; iii) The key success factors for delivery of this lasting change and documenting best practice that can be replicated or adapted in future interventions. Measure the extent to which the step changes identified at the start of the grant has been achieved.
Although the methods to be used will be decided with the selected consultant(s), the ASEAN Foundation expects the proposals to demonstrate how they will take into account the following elements:
Consulting and Scoping: The consultant(s) should work with the ASEAN Foundation staff, to define the overall specific outcomes and possible indicators for the data aggregation exercise and identifying projects over the years that will undergo in depth assessment. The consultant(s) will review mid-and final term project reports conducted, review reports and establish bench marks for the Assessment.
Desk Review: The ASEAN Foundation anticipates that this will involve reading and reviewing of the ASEAN Foundation’s reports, and other project documents. Through the desk study the consultant(s) will seek to understand the details of the initiatives, the broader internal organisation and external context in which the work was implemented. Preparation of Inception Report: The consultant (s) will prepare the Inception Report (output of the desk review) and present to designated staff for feedback. In a meeting with the ASEAN Foundation staff, the consultant(s) will test the evaluation questions and get endorsement on the proposed approaches and methods.
Collecting and compiling data: The consultant(s) will compile and collect data from the ASEAN Foundation’s inititatives between 2015 and 2019. Data will be aggregated according to the agreed outcomes and indicators out of the consultation and scoping. The second part is the more in-depth information/data collection and analysis. The specific methodology and analytical framework will be finalized during the inception phase, and will be approved by the ASEAN Foundation.
In-depth review: The Assessment will include an in-depth review of the ASEAN Foundation’s key projects between 2015 and 2019 addressing the key areas in line with the specific objectives and scope of the Assessment. This will include a variety of key projects that have been perceived as successful and others that have been perceived as not so successful. The in-depth review will include:
Interviews and discussions with key stakeholders: The ASEAN Foundation expects semi-structured interviews primarily face to face and otherwise by phone to be conducted with key informants including other NGOs, donors, ASEAN Secretariat and ASEAN Member States.
• Focus group discussions: With clients and peer educators through field visits, and with the ASEAN Foundation (complemented by one-to-one interviews where necessary).
• Stories of change: The Assessment should provide a number of stories of change with detail on how the ASEAN Foundation’s approaches, strategies and interventions made or contributed to making a difference in the lives of direct and indirect beneficiaries.
The consultant(s) will ensure triangulation of all findings by applying a variety of data collection methods.
The main outputs of the Assessment will be:
- Inception Report - not exceeding 20 pages excluding annexes. The inception report should include: • A brief summary of the desk review • An analysis of the agreed overall outcomes and indicators on which the impact will be assessed • The detailed proposal on methodologies and the elaborated analytical framework for the assessment, instruments, timeline, and process /progress indicators
The ASEAN Foundation’s Team will review/comment and endorse the inception report as appropriate before the consultant(s) to commence the next stage activities.
- Main Report – not exceeding 50 pages excluding annexes. The main report should include: • Executive Summary (6 to 8 pages): The summary would need to be extractable and read as a standalone report. It will serve as an effective means of communication and will clearly answer the questions posed especially regarding impact. • Introduction (1 to 2 pages): The introduction will provide details on background, purpose of the Assessment, methodology and limitations. • Overall achievement on impact (10 to 20 pages): This section will provide in-depth details on the impact achieved in terms of the agreed outcomes and indicators • Key success factors (5 to 10 pages): This section will detail the key factors that helped or hindered impact in relation to the key areas identified in the “scope of work” section • Lessons learnt and best practice (5 to 10 pages): This section will articulate the key lessons learnt and best practice across the ASEAN Foundation’s initiatives • Implications and recommendations for the ASEAN Foundation (3 to 5 pages) • Annex including stories of change
7. Organisation of the Evaluation
The Assessment will be carried out by an independent external consultant(s). The ASEAN Foundation will be responsible for managing the process and for facilitating the consultant(s)’s initial contact beneficiaries, partners, and other stakeholders. An Assessment Team will be established at the ASEAN Foundation to facilitate and provide smooth coordination of the Impact Assessment.
8. Work plan
It is expected that the study will be carried out over a period of 30 days.
The preliminary work plan is as follows:
- July: Terms of Reference finalised, advertising and recruitment of consultants
- August: Signing of contract and initiation of work
- Early September: Desk review (5 days)
- End September: Inception plan clarifying agreed outcomes and indicators, methodologies and time frames presented and endorsed (7 days)
- October to Mid-November: Data Collection and Analysis (10 days)
- End November: Present draft final report to the ASEAN Foundation, key stakeholders to get feedback (5 days)
- End December: Final Report submitted to the ASEAN Foundation (3 days)
9. Qualification and Experience
- An advanced university degree in social sciences from a recognised university
- At least 7 years of relevant professional work experience conducing impact assessment/evaluation
- Experience of multi-stakeholder processes
- Experience in conducing and analysing qualitative and quantitative research
- Exceptional presentation and writing skills
10. Application Process
All interested applicants whether individuals/organisations/institutions to send application, stating the position with the following documents to firstname.lastname@example.org – a) application letter and time table on how the assignment will be carried out completed with clear deliverables b) curriculum vitae c) samples of impact assessment report and d) financial proposal specifying a total lump sum amount highlighting deliverables.
DEADLINE FOR APPLICATION: 31 July 2019Tweet This Share on Facebook Plus on Google+ Share on LinkedIn