Endline Assessment Consultant

Project Context and Scope:

The project Empowerment of ‘Families left behind’ for Improved Migration Outcomes in Khatlon, Tajikistan is being implemented by The International Organization for Migration (IOM) jointly with United Nations Children Fund (UNICEF), Food and Agricultural Organization (FAO) and UN Women, through financial support of the Migration Multi-Partner Trust Fund (MMPTF) and it will end on 24 November 2023. The project aims to reduce the vulnerability of families adversely affected by migration in two districts (a total of 700 women left behind and 1500 adolescents and children of the vulnerable families will be targeted under this project) through the following main components:

1. Improving the wellbeing of families left behind (by enhancing provision of psychosocial services for women and children left behind, to allow for more opportunities for their empowerment and economic inclusion),
2. Increasing the economic resilience of families left behind and addressing gender related barriers to their economic inclusion (by improving utilization of land and water resources; value chains through farming, small scale processing initiatives, retail and marketing; vocational skills and livelihoods; and financial inclusion, skills and knowledge),
3. Protecting and empowering families left behind to seek their rights (by improving service provision; individual and community support and knowledge; and adolescent life competencies), and Supporting national, regional and local government to implement evidence-based responses to the challenges faced by families left behind (by ensuring evidence and policy guidance is available and used, to facilitate policy and implementation planning at national and district levels).

A baseline assessment (see Annex 1) was carried out to conduct baseline measurements of the 15 outcome indicators and 2 output level indicators of the Baseline Indicators Matrix (see Annex 2). Aligning with this baseline assessment, the UN requires a consultant to produce two deliverables i.) an endline assessment and ii.) a subsequent evaluation of the Empowerment of ‘Families left behind’ for Improved Migration Outcomes in Khatlon project.

The endline assessment aims to assess the effectiveness of the intervention by measuring against specific indicators used in the baseline assessment. It is a project deliverable which will be assess whether the four following outcomes have been achieved and to what extent; outcome 1: Families left behind enjoy improved wellbeing, outcome 2: Families left behind have increased economic resilience and address gender related barriers to economic inclusion, outcome 3: Women and children left behind are protected and seek to protect their rights, outcome 4: National and regional and local government identify and plan to implement evidence-based responses to ‘families left behind’. The audience for this deliverable will be UN agencies, government counterparts, implementing partners and the donor.

The evaluation is the second deliverable and its primary objective is to evaluate the project against the five DAC evaluation criteria: relevance, coherence, effectiveness, efficiency, sustainability, impact, and cross-cutting issues. A secondary objective is to collect lessons learned and recommendations for further strengthening of projects within this thematic area. In addition, the evaluation will serve for the donor to assess value for money for a set of activities funded and in light of possible extension and expansion. This proposed evaluation shall cover the timeframe of implementation of the project, starting from 1 October 2020 until and including the date when the contract between UN agencies and the selected service provider will enter into force. One section of evaluation should be dedicated to recommendations, good practices and lessons learned that could be derived from the analysis. The endline assessment will feed into the evaluation as it will be key to judging effectiveness and impact.

Objective: Under the overall supervision of the IOM project team, and in close coordination with the focal points in UNICEF, FAO and UN Women, the consultant will be responsible for producing i.) an endline report which will assess the effectiveness of the intervention by measuring against specific indicators used in the baseline assessment, and ii.) a final evaluation of the project. The endline assessment will assess the effectiveness of the intervention by measuring against specific indicators used in the baseline assessment. Content and audience will mirror the baseline assessment, and the endline assessment is expected to feed into the final evaluation as it will provide valuable evidence for evaluation criteria such as effectiveness and impact. The evaluation will involve evaluating the project against the following DAC criteria: relevance, coherence, effectiveness, efficiency, sustainability, impact, and cross-cutting issues. It aims to: (i) to determine extent to which the objectives of the Empowerment of ‘Families left behind’ for Improved Migration Outcomes in Khatlon project have been met and assess the likelihood of sustainability upon project completion; (ii) to identify causes for any achievement of results or any unsatisfactory results, including UN agencies’ institutional strengths and weaknesses in implementing the project; and (iii) to identify needs for further support for families left behind in Tajikistan. The evaluation is being conducted to support the UN and the donor in assessing progress, to ensure accountability; in determining what is working and what is not, to inform future phases; and, to identify knowledge, good practices, and lessons learned.

Organizational Department / Unit to which the Consultant is contributing:

Migrant Protection and Assistance Division

Category B Consultants: Tangible and measurable outputs of the work assignment

The Consultant is hired to deliver the following tasks on a final payment basis:

1. First deliverable – Inception report for carrying out the endline assessment, including a detailed description of the proposed approach and methodology, the baseline indicator matrix and timelines of key activities, taking into consideration alignment to the Project’s M&E Plan and other related activities.
2. Second deliverable - Submission of first draft and final version of the endline assessment report and presentation of key findings to UN agencies, as well as submission of the final narrative report on completed deliverables.
3. Third deliverable*–* Evaluation Inception report including, at minimum, an Evaluation Matrix to demonstrate the evaluator(s)’ understanding of the ToR and outline data collection and analysis plans, as well as an indicative list of interviewees and interview guides, to be completed and reviewed with the UN agencies prior to field visits. The evaluation should consider and duly reflect gender perspectives in the development of the interview questionnaires and other methodological tools for the evaluation, and integrate gender considerations in the findings, conclusions, and recommendations. During the whole process of the evaluation, UN Data Protection Principles, UNEG Norms and Standards for Evaluation, and UNEG ethical guidelines for evaluation will be fully followed. Discussion of how ethics will be managed is required in the Inception Report. The project should be evaluated according to the following OECD-DAC and ALNAP criteria of relevance, coherence, effectiveness, efficiency, sustainability, impact and cross-cutting issues as per the below:

Evaluation Criteria

Evaluation Question

Relevance: The extent to which the intervention objectives and design respond to beneficiaries , global, country, and partner/institution needs, policies, and priorities, and continue to do so if circumstances change.

1. Do the project’s expected outcomes and outputs remain valid, pertinent and appropriate either as originally planned or as subsequently modified?
2. To what extent did the intervention compliment or contradict other priorities and policies of the Government of Tajikistan?
3. Were the objectives set out in the project document relevant, attainable, and realistic?
4. How relevant was the selected methodology towards achievement of the project objectives?
5. To what extent does the project cater for the target group’s needs?
6. To what extent are the stakeholders involved in the project’s decision-making processes? To what extent have stakeholders participated in the project activities?
7. To what extent were the risks identified at proposal-writing stage significant for the project action and how relevant were the corrective measures?

Coherence: The compatibility of the intervention with other interventions in a country, sector or institution.

1. To what extent did the intervention compliment other
   initiatives on empowerment, resilience building and improved access to services of vulnerable women and children in Tajikistan?
2. To what extent does the intervention add value/avoid duplication in the given context?

Effectiveness: assessing the extent to which a project achieves its intended results

1. To what extent did the intervention achieve its intended results (outcome and outputs)?
2. To what extent did COVID-19-restrictions affect the effectiveness of the project?
3. To what extent can the implemented activities serve as a basis for future achievements and results. Were the planned resources (human and financial) sufficient to achieve the expected results?

Efficiency: assessing how well human, physical and financial resources are used to undertake activities, and how well these resources are converted into outputs in a timely manner

1. What were the major factors that influenced efficiency and timeliness of delivery?
2. To what extent were the project activities undertaken, and outputs delivered on time?
3. Is financial spending efficient per planned activities and in line with the costs at the local level?

Sustainability: assessing to what extent the project’s results will be maintained for a certain period of time after the current project phased out

1. Is the project supported by institutions and well-integrated into local social and cultural structures?
2. Do the project partners have the financial capacity and are they committed to maintaining the benefits of the project in the long run?
3. Which local actors will ensure continuity of activities commenced through the project in the project locations? How far can project outputs and outcomes be used and serve as basis for future activities in this field?

Impact: positive and negative, primary and secondary long-term effects produced by the project directly or indirectly, intended or unintended.

1. What longer-term change(s) can be observed or are likely (whether positive or negative, unintended, or intended) directly or indirectly, intended, or unintended to the social/economic/political/environmental circumstances of Tajikistan?
2. What was contribution of the intervention to those changes, considering also other contributing factors?
3. To which extent have the activities had an impact on the target groups?
4. Were there any significant unexpected positive or negative results?
5. To what extent has the project contributed to the improvement of the target group’s situation in relation to the project’s overall objective?

Cross-cutting Issues: Gender, whole of government/whole of society and rights-based approach to migration governance

1. How adequately were human rights and gender equality taken into consideration during the project design and implementation?
2. How adequately were vulnerabilities taken into consideration during the project design and implementation?
3. To what extent were the principles incorporated into the project cycle (design, implementation, monitoring and reporting)?
4. What was the impact of the joint programme on: the enjoyment of human rights by impacted rights-holders; the advancement of gender equality and empowerment of women and girls; and the advancement of children’s rights and meeting their needs?
5. To what extent did the joint programmes project cycle (design, implementation, monitoring and reporting) and management structure reflect and align with these GCM guiding principles?
6. Are there lessons learned or good practices that can be identified?
7. To what extent did the joint programme contribute to the relevant UN Sustainable Development Cooperation Framework, and/or relevant regional frameworks?

Fourth deliverable - Draft Evaluation Report to be submitted in English for review by the Evaluation Reference Group which will include representatives from the four UN agencies working under the joint programme, UNRCO and other relevant stakeholders such as government counterparts and implementing partners. The minimum report content requirement are as follows:

• Cover page, list of acronyms.
• Table of contents.
• Executive summary.
• Methodology.
• Findings.
• Section on lessons learned and best practices.
• Conclusions.
• Recommendations in order of priority.
• Annexes (list of interviewees, interview questionnaire/guides, documents from desk review etc.).

Fifth deliverable - Final Evaluation Report in professional English language, incorporating feedback of Evaluation Reference Group involved in the review of the report.

Sixth deliverable - A two-page Evaluation Brief following UN guidance and template, to provide a summary of key findings, conclusions and recommendations for easy sharing with UN agencies, UNRCO, the donor, government counterparts, and other stakeholders. The Evaluation Brief should be submitted in English.

Performance indicators for the evaluation of results

• Receipt of requested deliverables to UN standards in a timely manner in accordance with the above scope of services.

Education, Experience and/or skills required

• At least 5 years of experience in leading and conducting evaluations, including evaluations related to migration, irregular migration, migration decisions and similar fields is mandatory
• Excellent drafting of professional and standard evaluation reports
• Familiarity in UN results-based management (RBM) approach, gender equality, and human rights-based approach in programming and evaluation
• In-depth knowledge of evaluation approaches, ability to apply both qualitative and quantitative data collection methods, and ability to uphold UNEG quality standards and ethical principles
• Previous experience of interviewing and survey data collection
• Previous experience with UN agencies/MMPTF-funded projects considered an added value

Travel required – within this assignment travel is required to Kulyab and Dusti in Tajikistan.

Competencies

Values

• Inclusion and respect for diversity: respects and promotes individual and cultural differences; encourages diversity and inclusion wherever possible.
• Integrity and transparency: maintains high ethical standards and acts in a manner consistent with organizational principles/rules and standards of conduct.
• Professionalism: demonstrates ability to work in a composed, competent and committed manner and exercises careful judgment in meeting day-to-day challenges.

Core Competencies – behavioural indicators

• Teamwork: develops and promotes effective collaboration within and across units to achieve shared goals and optimize results.
• Delivering results: produces and delivers quality results in a service-oriented and timely manner; is action-oriented and committed to achieving agreed outcomes.
• Managing and sharing knowledge: continuously seeks to learn, share knowledge and innovate.
• Accountability: takes ownership for achieving the Organization’s priorities and assumes responsibility for own action and delegated work.
• Communication: encourages and contributes to clear and open communication; explains complex matters in an informative, inspiring and motivational way.

Annex 1: Baseline Assessment Final Report

To be sent by IOM Tajikistan on request