Project End line Evaluation

Background

Tdh has been working in Iraq since 2014, Tdh has scaled its programming to Anbar, Duhok, Kirkuk, Ninewa, Baghdad, and Salah al-Din governorates, providing assistance in Camp Coordination and Camp Management (CCCM), Child Protection (CP), Access to Justice (A2J), Education, and Water, Sanitation, and Hygiene (WASH). Considering the humanitarian response, Tdh with support from the Bureau of Population, Refugee and Migration (BPRM) has been implementing a multi-year project from September 2019 to September 2021 targeting 28,020 vulnerable persons.

Despite the COVID-19 pandemic slowing down the implementation of activities, the project has delivered almost on all the major activities; case management and MHPSS (Mental Health and Psychosocial Support) services to children and adolescents, access to formal and non-formal education opportunities, tailored multipurpose assistance and COVID-19 response, among others.

Project Description,

 Goal

The project aims at improving the protection, well-being and educational prospects of vulnerable, conflict affected children and adolescents in hard-to-reach districts of Ninewa, Salah al-Din and Kirkuk Governorates, Iraq. The expected objectives and outcome indicators are below.

Purpose

The primary objective of the assignment is to conduct a summative evaluation in September 2021 in the targeted project areas. The purpose of the evaluation is to assess the significant and sustained changes in the lives of women, men, girls and boys (impact) that the program has contributed to. The evaluation will also assess effectiveness of Tdh´s implementation strategies and approaches to achieve set goals within the project duration. To give insights into the project’s success and contribution to impact and highlight potential improvements for subsequent projects.

Additionally, the evaluation is intended to strengthen accountability and transparency to Tdh’s donors and partners for future interventions

Objectives  

·         To determine the extent to which project outcome and outputs have been attained both quantitatively and qualitatively through comparison with the baseline.

·         To provide concrete evidence of the change the project has been able to achieve, how the project achieved the difference, and determine the extent to which this can be attributed to the funded projects.

·         To evaluate the following dimensions of the project; Impact, Relevance, Effectiveness (added value and learning, coverage), and Sustainability.

·         To identify key lessons learned and best practices from project design and implementation that can be fed in similar future programs.

·         To develop strategic recommendations for future projects.

Scope and Focus

The evaluation shall broadly cover the accomplishment of all the expected results as outlined in the project document and detailed in the annual work plans during the entire project period/cycle. It should also assess all the different project activities as in the approved logical framework matrix.

Guiding Questions

I. Relevance: To what extent did the intervention objectives and design respond to beneficiaries’

needs belonging to different groups (children, women, IDPs, refugees) and households affected by the COVID-19 pandemic and continue to do so? 

–

-What, if any, changes do Tdh need to make so that its interventions efforts and emergency response are more appropriate and relevant?    

II. Effectiveness: To what extent has Tdh’s intervention contributed to increasing the protective environment of children at the community level?

-To what extent has Tdh’s programming effectively contributed to the reduction of vulnerability risk of children during the COVID-19 pandemic?

-What, if any, changes could Tdh make to its response efforts to make them more effective?

III. Impact: To what extent were the protection risks faced by children and adolescents addressed? How has the project contributed to this change? What project intervention has been most effective in this?

-To what extent has the project been responsive to the educational needs of vulnerable children and adolescents? To what extent has the intervention provided educational support to children, especially during COVID-19?

VI. Sustainability:

-What were the lessons learned and best practices from project design and implementation that can be fed into similar future programs?

– To what extent local stakeholders were empowered to ensure that the benefits of the activities are likely to continue after the project ends?

Methodology

Evaluation Approach: Given the dynamic nature of the context, the evaluation will be kept simple in order not to overwhelm affected populations with stressful data collection needs. The consultant will be asked to submit the methodology of the evaluation. Tdh proposes both (qualitative and quantitative) evaluation methodology but with a bias to more of qualitative data collection for easy triangulation of the Information. The consultant is recommended to use existing quantitative data that is already collected for different monitoring purposes by the Tdh team, and to avoid initiating a heavy primary quantitative data collection processes.

Evaluation design: The consultant is expected to develop the evaluation design describing the methodology, sample size, tools and the analysis plan in consultation with the Tdh team.

Data collection: The consultant will design evaluation data collection tools. . Due to access and security requirements, Tdh will take on the responsibility of data gathering. The consultant will orient and training enumerator on data collection tools. The consultant will regularly check on the quality of data been gathered. The consultant will be primarily responsible for the Desk review (narrative project Proposal, budget, PFU, quarterly reports, sources of verification, databases and any other project documentation produced will be availed to back up data collected from the field). The evaluation will involve all relevant stakeholders, program staff, implementing partners, beneficiaries and others deemed relevant.

Analysis and report writing: The consultant will be responsible for analyzing all primary (quantitative & qualitative) data gathered for the evaluation purpose and the secondary data associated with the project, as per the analysis plan agreed with the Tdh team at the initiation discussions. The consultant is expected to facilitate a learning session with the Tdh team to share and validate the findings and produce the final report as per the template agreed at the inception phase.  

The Q&A (Quality & Accountability) Coordinator/ MEAL Manager and Grants Manager will be responsible for in-country briefings with Tdh Iraqi team and regular feedback during the field work, overseeing and managing the evaluation and reviewing and approving all deliverables, with support from the program team.

The information gathered and analysis needs to be well triangulated at the maximum extent possible and disaggregated sex, age, socioeconomic status, female headed households, ethnicity, and ability etc

Ethical Considerations

 The evaluator needs to consider ethical and safeguarding considerations in the inception report including duty of care and Do No harm elements (Confidentiality, Informed Consent, Child safety etc.) The evaluation should also incorporate gender and diversity approach.

Deliverables

·         Inception report including the evaluation design,

·         Data collection tools, trainings and the analysis plan

·         First, second, third and final draft project evaluation report

·         Learning workshop

·         Final database and raw data collected used in evaluation.

Potential Risks and Challenges

·         Eventual security challenges might affect operation schedule.

·         Very limited access to services in targeted areas, including accommodation, electricity, running water and phone coverage.

Workplan 

Background

Tdh has been working in Iraq since 2014, Tdh has scaled its programming to Anbar, Duhok, Kirkuk, Ninewa, Baghdad, and Salah al-Din governorates, providing assistance in Camp Coordination and Camp Management (CCCM), Child Protection (CP), Access to Justice (A2J), Education, and Water, Sanitation, and Hygiene (WASH). Considering the humanitarian response, Tdh with support from the Bureau of Population, Refugee and Migration (BPRM) has been implementing a multi-year project from September 2019 to September 2021 targeting 28,020 vulnerable persons.

Despite the COVID-19 pandemic slowing down the implementation of activities, the project has delivered almost on all the major activities; case management and MHPSS (Mental Health and Psychosocial Support) services to children and adolescents, access to formal and non-formal education opportunities, tailored multipurpose assistance and COVID-19 response, among others.

Project Description,

 Goal

The project aims at improving the protection, well-being and educational prospects of vulnerable, conflict affected children and adolescents in hard-to-reach districts of Ninewa, Salah al-Din and Kirkuk Governorates, Iraq. The expected objectives and outcome indicators are below.

Purpose

The primary objective of the assignment is to conduct a summative evaluation in September 2021 in the targeted project areas. The purpose of the evaluation is to assess the significant and sustained changes in the lives of women, men, girls and boys (impact) that the program has contributed to. The evaluation will also assess effectiveness of Tdh´s implementation strategies and approaches to achieve set goals within the project duration. To give insights into the project’s success and contribution to impact and highlight potential improvements for subsequent projects.

Additionally, the evaluation is intended to strengthen accountability and transparency to Tdh’s donors and partners for future interventions

Objectives  

·         To determine the extent to which project outcome and outputs have been attained both quantitatively and qualitatively through comparison with the baseline.

·         To provide concrete evidence of the change the project has been able to achieve, how the project achieved the difference, and determine the extent to which this can be attributed to the funded projects.

·         To evaluate the following dimensions of the project; Impact, Relevance, Effectiveness (added value and learning, coverage), and Sustainability.

·         To identify key lessons learned and best practices from project design and implementation that can be fed in similar future programs.

·         To develop strategic recommendations for future projects.

Scope and Focus

The evaluation shall broadly cover the accomplishment of all the expected results as outlined in the project document and detailed in the annual work plans during the entire project period/cycle. It should also assess all the different project activities as in the approved logical framework matrix.

Guiding Questions

I. Relevance: To what extent did the intervention objectives and design respond to beneficiaries’

needs belonging to different groups (children, women, IDPs, refugees) and households affected by the COVID-19 pandemic and continue to do so? 

–

-What, if any, changes do Tdh need to make so that its interventions efforts and emergency response are more appropriate and relevant?    

II. Effectiveness: To what extent has Tdh’s intervention contributed to increasing the protective environment of children at the community level?

-To what extent has Tdh’s programming effectively contributed to the reduction of vulnerability risk of children during the COVID-19 pandemic?

-What, if any, changes could Tdh make to its response efforts to make them more effective?

III. Impact: To what extent were the protection risks faced by children and adolescents addressed? How has the project contributed to this change? What project intervention has been most effective in this?

-To what extent has the project been responsive to the educational needs of vulnerable children and adolescents? To what extent has the intervention provided educational support to children, especially during COVID-19?

VI. Sustainability:

-What were the lessons learned and best practices from project design and implementation that can be fed into similar future programs?

– To what extent local stakeholders were empowered to ensure that the benefits of the activities are likely to continue after the project ends?

Methodology

Evaluation Approach: Given the dynamic nature of the context, the evaluation will be kept simple in order not to overwhelm affected populations with stressful data collection needs. The consultant will be asked to submit the methodology of the evaluation. Tdh proposes both (qualitative and quantitative) evaluation methodology but with a bias to more of qualitative data collection for easy triangulation of the Information. The consultant is recommended to use existing quantitative data that is already collected for different monitoring purposes by the Tdh team, and to avoid initiating a heavy primary quantitative data collection processes.

Evaluation design: The consultant is expected to develop the evaluation design describing the methodology, sample size, tools and the analysis plan in consultation with the Tdh team.

Data collection: The consultant will design evaluation data collection tools. . Due to access and security requirements, Tdh will take on the responsibility of data gathering. The consultant will orient and training enumerator on data collection tools. The consultant will regularly check on the quality of data been gathered. The consultant will be primarily responsible for the Desk review (narrative project Proposal, budget, PFU, quarterly reports, sources of verification, databases and any other project documentation produced will be availed to back up data collected from the field). The evaluation will involve all relevant stakeholders, program staff, implementing partners, beneficiaries and others deemed relevant.

Analysis and report writing: The consultant will be responsible for analyzing all primary (quantitative & qualitative) data gathered for the evaluation purpose and the secondary data associated with the project, as per the analysis plan agreed with the Tdh team at the initiation discussions. The consultant is expected to facilitate a learning session with the Tdh team to share and validate the findings and produce the final report as per the template agreed at the inception phase.  

The Q&A (Quality & Accountability) Coordinator/ MEAL Manager and Grants Manager will be responsible for in-country briefings with Tdh Iraqi team and regular feedback during the field work, overseeing and managing the evaluation and reviewing and approving all deliverables, with support from the program team.

The information gathered and analysis needs to be well triangulated at the maximum extent possible and disaggregated sex, age, socioeconomic status, female headed households, ethnicity, and ability etc

Ethical Considerations

 The evaluator needs to consider ethical and safeguarding considerations in the inception report including duty of care and Do No harm elements (Confidentiality, Informed Consent, Child safety etc.) The evaluation should also incorporate gender and diversity approach.

Deliverables

·         Inception report including the evaluation design,

·         Data collection tools, trainings and the analysis plan

·         First, second, third and final draft project evaluation report

·         Learning workshop

·         Final database and raw data collected used in evaluation.

Potential Risks and Challenges

·         Eventual security challenges might affect operation schedule.

·         Very limited access to services in targeted areas, including accommodation, electricity, running water and phone coverage.

Workplan 

Consultant Profile

The consultant (team) must have a strong background in the design, implementation, and evaluation

of humanitarian projects. Other requirements are:

– Knowledge of the Middle East, especially the Iraqi humanitarian context

– Demonstrated previous experience in leading humanitarian evaluations, using a range of

different evaluation methods (impact, final, summative evaluation, etc.).

–  Highly competent in evaluation methodologies, approaches, data collection and analysis.

– Experience in working in the humanitarian sector, more specifically on child protection,

Education or/and psychosocial programming

– Excellent communication and report writing skills (English and Arabic).

– Successful experience/expertise in evaluating BPRM/USAID funded projects..

– Expertise in Humanitarian standards

– Strong conceptual and analytical thinking, communication and writing skills

– Gender mixed team would be an asset

– Excellent knowledge English; Arabic would be a strong asset

Application and Mandatory Documents

To be considered, the applicant must submit the following documentation:

– A Technical proposal detailing how the team meets the requirements above; understands and interprets the purpose and objectives of the evaluation; proposed approach and methodology; the team’s unique added-value or comparative advantage; and a summary of past assignments of relevance.

– A Financial proposal detailing the breakdown of costs, including daily rates of payment per consultant/team member, number of days per phase, and estimated expenses(including transportation and accommodation) all in USD. (all community level primary data gathering will be covered by Tdh)

– CVs of proposed members highlighting work experience and qualifications relevant to this consultancy)

-Full contact details of at least two references from recent clients

Mandatory Documents

-Two sample evaluation report highlighting previous experience relevant to this evaluation (Mandatory)

-Letter from the bank confirming the bank account information and mentioning the financial standing

-Iraq Visa status / residency / on arrival visa

-Company’s registration and License

-ID card of the representative

-Power of Attorney from the owner of the company to the legal representative (if different)

-Tax compliance certificate

-Litigation history of the company (both court and arbitration cases)

-A criminal record extract as required for any staff/contractor working for Tdh

-Passport copy of team leader

-Up-to-date banking details (only for individual contractor)

Submission of EOI

Applicants meeting the above criteria are invited to submit an Expression of Interest by 7^th September 2021 to:[email protected]  with the Subject:  Final Evaluation.