TERMS OF REFERENCE
FINAL EXTERNAL EVALUATION OF THE PROJECT
“Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders”
Commissioned by: Monitoring, Evaluation, Accountability, and Learning (MEAL) Unit, IOM Türkiye
Managed by: MEAL Unit and Project Implementation Team
Evaluation ContextThe International Organization for Migration (IOM), the United Nations (UN) Migration Agency, was established in 1951 and is the leading intergovernmental organization in the field of migration, working closely with governmental, intergovernmental, and non-governmental partners. With 175 member states, a further eight states holding observer status and offices in 172 countries, IOM is dedicated to promoting humane and orderly migration for the benefit of all.
The IOM established its operations in Türkiye in 1991. IOM’s partnership with the Government of Türkiye (GoT) was formalized in November 2004, when Türkiye became an IOM Member State. IOM Türkiye works closely with the government of the Republic of Türkiye, regional authorities, the UN, donors, and civil society organizations to address migration challenges by implementing programmes through three pillars: Resilience, Mobility, and Governance. Across the country, IOM Türkiye provides a comprehensive response to the humanitarian needs of migrants, internally displaced persons, returnees, and host communities through direct humanitarian assistance, recreational activities, and various other efforts. Alongside IOM’s role in addressing the needs of migrants during crises, the mission works in close collaboration with the Government of Türkiye to address the longer-term impact of migration, including migrant assistance programmes, labour integration and migration management, immigration and border management, and research and data collection on migrant movement.
The project “Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders”, funded by the Ministry of Foreign Affairs of the Kingdom of Denmark and implemented by IOM Türkiye in cooperation with the Ministry of Interior, Presidency of Migration Management Directorate General of Border Management is supporting Türkiye’s efforts in the implementation of an integrated border management (IBM) strategy and approach aiming to prevent irregular border crossings and other cross-border crimes at eastern and southern borders. The main beneficiary of the project is the Directorate General of Border Management (DGBM) - Presidency of Migration Management. DGBM is tasked to ensure national border management coordination at Turkish borders by establishing and enhancing coordination between relevant public institutions operating at border crossing points (BCP-hereinafter), as well as strengthening cooperation among national and international institutions involved in border management. Additionally, DGBM is responsible for collecting, analysing, and evaluating data related to border management.
The overall objective of the project is to support Türkiye’s efforts in strengthening its integrated border management (IBM) approach and preventing irregular border crossings and other cross-border crimes at eastern and southern borders. The expected outcome is the enhancement of the institutional capacity of the Directorate General of Border Management (DGBM) and related border management agencies to support the IBM response in the eastern and southern border provinces. The expected results are as follows:
Result 1: Border Management Agencies increase their surveillance and screening capacity through procurement of equipment
Result 2: Border Management Staff strengthen their knowledge and skills on migration and border management
Result 3: Border Management Agencies in Türkiye increase their inter-agency and international coordination and cooperation on migration and border management
The initial project implementation period was from 01 January 2022 to 31 December 2023. The project received one no-cost extension (from 31 December 2023 to 31 August 2024) and, one cost extension (from 31 August 2024 to 31 August 2025). The evaluation will cover the entire implementation period of the project, from 01 January 2022 to 31 August 2025.
2. Evaluation Purpose and Objective
The final evaluation aims to comprehensively assess the Ministry of Foreign Affairs of the Kingdom of Denmark-funded project “Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders.” The objective is to assess achieved outcomes and to identify strengths and weaknesses within the project design, management, and implementation. This evaluation will assess the project’s success in achieving its intended results and examines the impact and sustainability of its activities. This evaluation will utilize the OECD-DAC evaluation criteria -relevance, coherence, efficiency, effectiveness, impact, and sustainability. The evaluation will inform strategic decision-making and future programming by identifying lessons learned, promoting good practices, and assessing stakeholder satisfaction with project activities and results.
3. Evaluation Scope
The final evaluation aims to comprehensively assess the project’s performance during the period of January 31, 2022 to August 31, 2025. The geographic scope of the evaluation will align with the project’s implementation areas, primarily focusing on the stakeholders based at the headquarters of the beneficiary institutions. The evaluation will adopt a participatory approach, actively engaging relevant stakeholders, including IOM Türkiye staff, the Ministry of Interior (MoI), the Directorate General of Border Management (DGBM) under the Presidency of Migration Management (PMM), and other agencies involved in border management in Türkiye.
Furthermore, the evaluation will also provide actionable recommendations, highlight good practices and lessons learned, and contribute valuable insights for future or similar programmes. An important aspect of the evaluation is the analysis of cross-cutting themes, particularly the integration of gender considerations and a human rights-based approach within project activities and implementation.
4. Evaluation Criteria
The evaluation will assess the criteria of relevance, effectiveness, efficiency, and sustainability of the project and, to the extent possible, will address the likely impact. It will also examine the project's complementarity and coordination with other relevant interventions under the criterion of coherence. The OECD-DAC definitions will guide the evaluation.
• Relevance: The extent to which the intervention's objectives and design respond to the needs, policies and priorities of beneficiaries at the global, national and institutional levels, and continue to do so as circumstances evolve.
• Coherence: The extent to which the intervention is compatible with other interventions within the same country, sector, or institution.
• Effectiveness: The extent to which the intervention has achieved, or is expected to achieve, its stated objectives and results, including any differential results across groups.
• Efficiency: The extent to which the intervention delivers, or is likely to deliver, results in a cost-effective and timely manner.
• Impact: The extent to which the intervention has produced or is expected to produce significant positive or negative, intended or unintended, higher-level effects.
• Sustainability: The extent to which the benefits of the intervention continue or are likely to continue.
5. Evaluation Questions
In the inception phase, the evaluator will further develop and refine the evaluation questions to ensure detailed and specific information is gathered for each criterion. The evaluation matrix will be reviewed collaboratively with IOM.
The following key questions will guide the evaluation process:
Evaluation Criteria Evaluation Questions Relevance To what extent do the project, its objective, and targets remain relevant in the current national context, including the strategies and priorities of the Government of Türkiye? To what extent do the project’s intended results align and support the Government of Türkiye’s strategies and priorities related to migration and border management? How well did the project align with and support IOM’s national, regional, and global strategies, including the IOM Immigration and Border Governance (IBG) Guidance, Community Engagement & Policing (CEP) Document, and Migration Governance Framework? To what extent did the project respond to the needs and priorities of MoI, all stakeholders, and other key groups, as identified at the design stage? Coherence How did the project seek synergies and complement other related initiatives, by IOM, the government, or other national and international actors? What added value, if any, did this project bring compared to those other efforts in migration management? To what extent were the project’s design, implementation, and results coherent with efforts to improve border security and surveillance in line with the EU’s integrated border management policies and strategies? Effectiveness To what extent were the project activities translated into quality, sufficient, and timely outputs following the stated plans? To what extent can observable changes be linked to the intended outcomes? To what extent did the project adapt to changing external conditions to ensure project outcomes? Which project strategies proved most and least effective in achieving the intended short and long-term results, and why? What could have been done differently (design and implementation approaches) to ensure the project is more effective in reaching short and long-term target results? What (if any) lessons can be drawn from the project? How appropriate was the project design for achieving results within the operating context? What factors facilitated or hindered the achievement of the project’s intended results? Efficiency To what extent has the project used its human, financial, and technical resources in a cost-efficient way? To what extent has the project used an appropriate combination of tools, approaches, and partnerships to achieve its results? Did the project have the necessary coordination mechanisms and communication flow to ensure that the allocated resources were efficiently converted into the expected outputs? Were the projects' activities undertaken and outputs delivered on time? Has the project sought synergies with other services to optimize resource utilization? Impact To what extent did the project contribute to improving border management in line with the EU’s integrated border management policies and strategies? To what extent did the project contribute to the positive, negative, intended, and unintended changes? To what extent did the project anticipate and mitigate unintended or negative impacts? What are the direct and indirect impacts of the project at the outcome level? Sustainability To what extent was the project embedded in institutional structures likely to sustain its results beyond the life of the project? Were the government institutions well-integrated? What were the key challenges to sustainability, and how could they be addressed through project design, implementation or monitoring improvements? Are the benefits generated likely to continue once external support ceases? If so, how? Cross-cutting themes: To what extent does the project design incorporate gender equality, rights-based approaches and feedback from a diverse range of stakeholders? Will the achievements in gender equality persist after the end of the project? Have processes contributed to sustaining these benefits? To what extent has the project contributed to upholding the human rights of migrants?6. Evaluation Methodology
The evaluation will employ a comprehensive mixed-methods approach, utilizing both qualitative and quantitative methods to collect and analyse data from various sources. This rigorous approach will generate robust and reliable evidence for assessing the project's results, including outputs, outcomes, and objectives. The data will be cross-validated and triangulated using multiple methods to enhance accuracy. Evaluation findings and data will be disaggregated by gender, age, geographic location, and type of activity to ensure inclusive and meaningful analysis.
Data sources will include desk reviews, surveys, and interviews with beneficiaries, as well as key stakeholders such as the Ministry of Interior, Directorate General of Border Management (DGBM) under the Presidency of Migration Management (PMM), etc.
The evaluation will use a mixed-methods approach, combining both quantitative and qualitative data through the following methods:
Desk review: A systematic and detailed examination of key documents, including the project proposal, results matrix, work plans, donor/progress reports, monitoring reports, data, and budgetary documents. Key informant interviews and focus group discussions: Primary data will be gathered through interviews and focus group discussions with staff from IOM. The interaction will be based on semi-structured questions to gather their perspectives and deeper insight into the project. Surveys and in-depth semi-structured interviews: Structured surveys and semi-structured interviews will target stakeholders who participated in project activities.The evaluator will develop tools for review and approval by IOM Türkiye before data collection. The evaluation will incorporate gender and rights-based approaches throughout data collection and analysis.
Also, the evaluator will propose a purposive or stratified sampling strategy, ensuring adequate representation across stakeholder groups and geographic locations. The sample should account for diversity in role, gender, and institutional affiliation
7. Ethics, Norms, and Standards for Evaluation
IOM abides by the Norms and Standards of the UN Evaluation Group (UNEG) and expects all evaluation stakeholders to be familiar with the UNEG Ethical Conduct Guidelines and the UNEG Codes of Conduct. This evaluation will follow IOM's Evaluation Policy, M&E Guidelines, and Guidance on Quality Management of IOM Evaluations, including the quality checking tool for inception and final reports. The evaluation must also adhere to the Data Protection Principles laid out in the IOM Data Protection Manual.
8. Evaluation Deliverables
The external evaluator is expected to deliver the following:
Inception reportThe evaluator will prepare an inception report[1] outlining their approach to the evaluation. It should include the evaluation matrix, draft data collection tools, a clear articulation of their understanding of the ToR, the methodology, and any proposed methodological adjustments, and a detailed provisional work plan. The report should be submitted to IOM Turkiye after the document review phase for feedback and discussion, prior to the interview phase.
Presentation of the initial findingsFollowing the interview phase, the evaluator should prepare a presentation of the preliminary evaluation findings, tentative conclusions, and recommendations. This will be used to debrief the IOM team and address any misinterpretations or gaps.
A draft evaluation reportBased on the debrief and initial feedback, the evaluator should prepare a draft evaluation report incorporating lessons learned and recommendations. They will consolidate all comments received, including those from IOM, and revise the report accordingly.
Final evaluation reportOnce finalized, the evaluator will submit a final evaluation report using the IOM-provided template. The report should include an executive summary, a list of acronyms, an introduction, an evaluation context and purpose, an evaluation framework and methodology, findings, conclusions, recommendations, good practices, and lessons learned. Annexes should include the TOR, inception report, list of documents reviewed, persons interviewed or consulted, and data collection instruments.
The evaluator will submit the final evaluation report in accordance with IOM standards. All deliverables must be in English and meet professional language standards. Reports should meet the standards in the UNEG Quality Checklist for Evaluation Reports and the IOM Quality Control Tool for evaluation reports. The IOM House Style Manual and the IOM Publication Layout Manual should also be applied
Evaluation brief (two-page summary according to the IOM template) and infographicsThe evaluator will prepare a concise two-page evaluation brief[2] in English, summarising key findings, lessons learnt, and recommendations. IOM will provide a template, which may be adapted but should not exceed two pages. Page one should include identification of audience; project information (project title, countries covered, project type and code, project duration, project period, donor(s), and budget); evaluation background (purpose, team, timeframe, type of evaluation, and methodology); and a brief description of the project. Page two should summarise the most important evaluation results: key findings and/or conclusions, best practices and lessons learned (optional), and key recommendations. The evaluator will also prepare infographics summarizing key findings, good practices, lessons learned, conclusions, and recommendations. The purpose of these infographics is to enhance accessibility of results for diverse audiences and support effective dissemination.
Management response matrix (IOM will provide the template)After IOM Turkiye approves the evaluation report and brief, the evaluator should draft a Management Response Matrix[3] using the IOM template, listing recommendations and indicative timelines for implementation. The IOM team will finalize the matrix in coordination with project stakeholders.
The final presentation of the evaluation report (online briefing with a PowerPoint for IOM staff, the donor, and key stakeholders to be identified and agreed upon)The evaluator will deliver a presentation of the final findings and recommendations to stakeholders, including IOM staff, national partners, and donors. A draft should be shared with the IOM project and MEAL teams in advance, and feedback should be reflected in the final version.
IOM Türkiye will not cover any cost related to interpretation during data collection; all related expenses should be included in the evaluator’s proposed budget.
Upon final approval of the deliverables, the IOM Türkiye MEAL team will ensure that final evaluation findings are accessible to stakeholders, including sharing it with the Regional M&E team to facilitate its posting in IOM's global Evaluation Repository.
9. Specifications of Roles
The roles of the IOM project team, evaluator, and stakeholders are identified below:
The Evaluator:
Conduct the evaluation in accordance with the Terms of Reference (ToR). Implement data collection, analysis, and reporting activities for the final evaluation. Conduct bilateral meetings with IOM to discuss progress, challenges, and emerging issues. Provide regular progress updates to the IOM team. Prepare and deliver the inception report, draft and final evaluation reports, a two-page evaluation brief, the visual presentation of the evaluation findings and recommendations, and a draft management response matrix.
The MEAL Unit of IOM:
Initiate a kick-off meeting with the evaluator and establish a work plan. Provide the evaluator with background information and relevant monitoring documents, Review the deliverables submitted by the evaluator. Coordinate the review of the evaluation deliverables with relevant individuals, IOM staff, and key stakeholders. Ensure that factual corrections are incorporated and reflected in the final report. Facilitate the finalization of the management response matrix.The Project Team of IOM:
Provide the evaluator with general information, project documents, donor reports, and budget information relevant to the project. Review the deliverables submitted by the evaluator. Assist in scheduling in-person and virtual meetings with key stakeholders. Support logistical and travel arrangements as needed. Coordinate with relevant stakeholders, including government counterparts, throughout the evaluation process.
10. Schedule
The evaluation will require 44 working days for the evaluator, including preparation, data collection, analysis, and reporting. Including IOM’s internal review, the total duration will be 55 days. The assignment is expected to begin in October 2025, with the final report and presentation delivered by November 2025. The specific dates will be finalised in the discussion with the selected evaluator.
The final evaluation of the project is divided into three phases:
Phase 1 – Inception Proposed timing: Week 1 and 2 Outputs: Workplan and meeting schedule Inception report and presentation Interview guidelines and evaluation matrix Prepare data collection plan Areas to be covered Kick-off meeting Project document review Presentation (if required)The Inception Report, including the Evaluation Matrix, must be submitted within two weeks of the start of the assignment. It should demonstrate the evaluator's understanding of the assignment, methodology, and approach, along with a detailed work plan aligned with the evaluation outputs. The Inception Phase will be coordinated closely with IOM’s IBG Unit and MEAL Unit to obtain all the necessary documentation and stakeholder contact details, enabling timely scheduling of meetings and interviews.
The key tasks of the Desk Review phase are:
The evaluator and IOM team will have a virtual briefing during the first week of the evaluation process's start. Relevant IOM colleagues and government focal points will also hold a kick-off meeting to decide on the precise table of contents of the inception report and discuss evaluation questions, information needs, additional fieldwork, and methodology. During the first week, the evaluator will review all available information and identify any additional sources of information. The evaluator will draft an inception report presenting the intervention logic, revised methodology, the work plan, and an evaluation matrix, along with the proposed field tools and draft interview schedule. Following feedback from IOM, the evaluator will review and finalise the Inception Report, including the evaluation questions, methodology, tools, and work plan. IOM will arrange meetings to ensure a common understanding of the evaluation process, provide necessary information to the evaluator for logistical arrangements, and provide input to the inception report. If needed, IOM will arrange a meeting with the evaluator and other stakeholders to finalize the methodology and work plan and validate the Inception Report. Phase 2 –Stakeholder Engagement, Analysis and Reporting Proposed timing: Weeks 3, 4, and 5 Outputs: Results of documentation review and consultations/interviews Draft Evaluation Report Presentation and meeting notes Areas to be covered: Interviews, surveys, and focus group discussions Draft evaluation report Evaluation findings presented for fine-tuningThe primary goal of this phase is to conduct stakeholder consultations and collect data through interviews and surveys.
The Field Phase should start upon the evaluation manager's approval of the Inception report. The main tasks of the field phase are:
The evaluator will submit a detailed data collection plan, including an indicative list of interviewees, surveys plans, dates of visit, itinerary, and names of team members in charge. This plan should remain flexible to accommodate any field-level changes. If any significant deviation from the agreed work plan is perceived as creating a risk for the quality or timeline of the evaluation, these should be immediately discussed with the IOM. The evaluator will ensure close consultation with IOM and stakeholders; use the most reliable data sources, and harmonize inputs from various sources to allow reliable interpretation. At the end of the field phase, the evaluator will summarize the fieldwork, discuss the reliability and coverage of data collection, and present the preliminary findings in a meeting with IOM.Phase 3 – Finalization and Sharing of Final Report and Other Deliverables Proposed timing: Weeks 6, 7 and 8 Outputs: Final Evaluation Report Evaluation Brief Infographics Draft Management Response Final presentation Areas to be covered: Evaluation Report finalized in coordination with relevant colleagues. Evaluation findings and recommendations should be presented to the IOM IBG Unit, senior management, and other key stakeholders.
Based on IOM’s comments from Phase 2, the evaluator must revise the draft report accordingly. Comments requesting methodological quality improvements should be incorporated unless unfeasible, in which case justification must be provided. Comments on the report's content can be accepted or rejected, with a focus on making factual corrections only. If rejected, the evaluator must provide a justification and explanation for the decision.
Upon finalizing the evaluation report, a half-day event will be organized in Ankara, with the participation of the Steering Committee members and other key stakeholders to discuss findings and follow-up actions. Based on the presentation, project stakeholders will discuss actions to be taken to address findings and enhance the capacities of all parties involved.
The following table gives an overview of the estimated timeline and distribution of responsibilities for a total of 44 working days for the evaluator:
Activity
Responsible party
Number of days
Kick-off meeting; exchange of documents; review and prepare inception report (including evaluation matrix and data collection tools)
Evaluator
5 days
Review the inception report, evaluation matrix, tools, and field visit plan
IOM Team
4 days
Finalize the inception report and the field visit agenda
Evaluator
2 days
Planning and facilitation of data collection activities (e.g., pre-testing, logistics, scheduling)
Evaluator, in coordination with the IOM Team.
3 days
Data collection, including travel time.
Evaluator, in coordination with the IOM Team.
12 days
Analyze data and prepare/deliver presentation of preliminary findings
Evaluator
6 days
A draft evaluation report
Evaluator
7 days
Submission of the final evaluation report
Evaluator
5 days
Review draft report and provide factual corrections
IOM Team*
5 days
Prepare the final report, evaluation brief, infographics, and management response matrix and share with IOM for review
Evaluator
3 days
Review the evaluation brief, infographics and draft management response matrix
IOM Team*
2 days
Deliver the final presentation to IOM and key stakeholders.
Evaluator
1 day
*The dates mentioned pertain to IOM are not factored into the total days allocated for the evaluator. However, it encompasses in the overall duration required for the evaluation to conclude. Evaluation BudgetThe evaluator's fee will be all-inclusive, covering all costs related to flights, hotel accommodation, field trips to relevant implementation sites, translation, and any other costs required to complete the evaluation. Payment of consultancy fees will be made IOM’s approval of the following deliverables:
Payment Schedule: Deliverable Percentage of the Payment Submission of the inception report 15% Submission of the first draft of the report 30% Submission of the final report and additional documents outlined above 55% Total 100%
Duration of the Contract
The overall evaluation process, including IOM’s internal review, will span 55 days, with 44 working days allocated to the evaluator. This period covers all evaluation tasks, including preparation, data collection, analysis, and reporting. The evaluator is expected to manage and complete these tasks efficiently within the agreed timeframe, ensuring high quality of deliverables. The assignment is scheduled between October and November 2025. The specific dates will be identified in consultation with the selected evaluator.
Requirements: Education and ExperienceIOM Türkiye is seeking an independent, multidisciplinary external evaluator. The evaluator may be based in any country but must be willing to travel to Türkiye to conduct the evaluation. The candidate should demonstrate prior experience in conducting similar types of evaluations.
Education and Experience
The evaluator should have at least ten years of experience in conducting project evaluations. Proven experience in using both quantitative and qualitative research methods and analytical tools. The candidate should have a master's degree or equivalent in evaluation, law, social sciences, public policy, development studies, or related fields. Demonstrated sound understanding of key migration themes, including migration governance, border management, labour migration, trafficking in persons, and crisis management. Experience in working with IOM and evaluating IOM Immigration and Border Governance (IBG) projects is an advantage.
Competencies
Excellent analytical, oral, and written communication skills in English. Experience collecting qualitative and quantitative data under challenging circumstances and using inclusive and participatory approaches. Ability to develop visual representations of key findings. Experience in technical and analytical report writing. Experience navigating complex institutional or multi-stakeholder environments. Displays cultural, gender, religious, racial, national, and age sensitivity and adaptability. Ability to work with minimal supervision and to meet deadlines.
Languages: An excellent command of English is required. The evaluator needs to consider that the data will be collected in Turkish. Working knowledge of Turkish is an advantage.
Submission of ApplicationInterested consultants should submit a technical proposal (not exceeding 15 pages) detailing their evaluation methodology, provisional work plan, and overall approach. An all-inclusive itemized budget must also be submitted. Proposals are due by [specify the date based on the date the application is sent out].
The submission should include the following:
Technical proposal – a description of the approach and proposed evaluation methodology, including data collection plans and analysis techniques, ethical considerations, quality control measures, work plan, and timelines. Detailed budget – all-inclusive budget covering fees and all other anticipated expenses, with a cost breakdown. Cover letter – highlighting recent experience with similar assignments. A detailed CV including three references. Sample report – one recent evaluation report authored by the consultant.Proposals and related inquiries should be sent via email to: XX
[1] See for reference the IOM Inception Report Template and IOM Sample Example Evaluation Matrices.
[2] IOM will provide an IOM template for the brief, which will be developed on Microsoft Publisher. The brief should provide a short (two-page) overview of the evaluation, including key project information, findings, conclusions, and recommendations.
[3] IOM template for Management Response and Follow-up.
The Evaluator:
Conduct the evaluation in accordance with the Terms of Reference (ToR). Implement data collection, analysis, and reporting activities for the final evaluation. Conduct bilateral meetings with IOM to discuss progress, challenges, and emerging issues. Provide regular progress updates to the IOM team.Prepare and deliver the inception report, draft and final evaluation reports, a two-page evaluation brief, the visual presentation of the evaluation findings and recommendations, and a draft management response matrix.
Education and Experience