Terms of Reference for Evaluation
of the project
“Healthier Women, Healthier families, Healthier Communities”
- INTRODUCTION & PROJECT BACKGROUND:
Norwegian People’s Aid (NPA) is the Norwegian labour movement’s humanitarian organisation for solidarity. NPA’s goal is to support human worth and equal rights for all, irrespective of sex, disability, ethnicity, religion, age, sexual preference or social status. The NPA vision is solidarity in practice. The vision demands commitment and action to protect life and health, build democratic societies and strengthen people’s ability to master their own lives. NPA is politically independent but not a politically neutral organisation. NPA takes a clear position in important social debates and the goal of a more just world means that NPA often chooses partners that may be opposed to, or in conflict with, those in power. NPA believes that popular participation and organisation are important measures in securing human rights and giving people greater influence over their own lives and social development.
Project background and overall goal The Ultimate Objective of the project is ‘Improved wellbeing and empowerment of conflict affected women and girls 15 years and older with particular focus on SGBV survivors in Iraq and KRI’.
The project activities support the conflict affected communities, especially women and girls, affected by the consequences of SGBV which have an especially detrimental effect on individuals, families and communities in the patriarchal societies like Iraq, leaving SGBV survivors particularly vulnerable. The support continues to enable healing and restoration of the social thread, build resilience through survivor oriented and community based sustainable coping mechanisms, which will stay with individuals and enable the targeted community to deal with current and expected future violence in the region.
Project implementation plan
The three intermediate outcomes are:
- Strengthened civil society organizations are actively coordinating, protecting and promoting the rights and empowerment of conflict-affected women and girls 15+.
- Conflict-affected women and girls 15+ who are survivors of SGBV receive quality case management services, reintegration support and protection for life-threatening cases of SGBV.
- Conflict-affected women and girls 15+ are better able to understand and access their rights to participate: psychosocial, recreational, economic, educational, family and community decision-making processes.
The immediate outcomes are:
- 1) CSOs Partners have improved organizational capacity (e.g. project, human resources, procurement and financial management).
- 2) CSOs partners have improved capacity to deliver quality SGBV case management to conflict-affected women girls, and quality PSS to women, men, girls and boys 15+, and PSS to women, men, girls and boys 15+.
- 3) CSO partners advocate more effectively for women’s rights based on their own strategy for promoting women’s rights.
Output 1111: Continuous training and coaching on project planning and management is provided for 4 CSO. Output 1112: Continuous training and coaching on financial management is provided for project managers and finance staff from 4 CSO partners. Output 1113: Human resources training and ongoing recruitment support is provided to 4 CSO partners. Output 1114 Continuous training and coaching on M&E and reporting is provided to 4 partner CSO. Output 1121: Intensive & On-going training & coaching on GBV Core Concepts, Safety Audits, Sensitive Outreach, Case Management, PSS, Adolescent girls toolkit, caring for child SGBV survivors, Life-Skills & Self-Care etc. is provided to 4 CSOs operational in 4 areas. Output 1122: Women's Community Centres and satellite safe spaces are established for confidential counselling and indoor recreation, and are fully furnished, staffed and operational in 4 operational areas. Output 1123 - TOT on Orienting Local Activity Leaders/volunteers (e.g. Code of Conduct, GBV Core Concepts, Effective PSS Sessions, and Trauma-Sensitivity) is held for staff from 4 CSO partners. Output 1124: Training of Turning Point Programme Leaders on 11 week Turning point programme including Gender Justice Workshops is developed and implemented. Output 1131: Partner CSOs hold coordination meetings and present their joint advocacy strategy & plan for advancement of women's rights as per their own mandate. Output1132: Awareness raising session guidelines are developed on topics relating to gender social norm change for CSOs partners working in 4 operational areas. Output 1133 Training on Delivering Awareness Raising Sessions is provided to CSO partners in 4 operational areas.
Output 1211 Sensitive outreach & community mobilization for the promotion of project services is carried out with conflict-affected women and girls, men and boys 15+ in 4 operational areas. Output 1212: Confidential case management is provided for interested conflict-affected women and girls 15+ who are residing in 4 operational areas. Output 1213: Confidential referrals to specialized service providers (medical, legal, child protection, education &etc.) are provided to conflict-affected women and girls 15+ in 4 operational areas. Output1221 Safe alternative accommodation (max 12 months) and rehabilitation services are provided to SGBV survivors unable to return to family and/or facing physical threat in the 4 operational areas. Output 1231: Orientation Training on Code of Conduct, GBV Core Concepts, Effective PSS Sessions and Trauma Sensitivity is held for local activity leaders (e.g. volunteers, skilled facilitators) from 4 operational areas. Output 1232: Recreational and life skills activities are held for women and girls 15+, and recreational activities are held for their male family members and other males 15+ who reside in 4 operational areas.
Output 1311: The 9-session Turning Point Programme (TPP) and a 2-day Gender Justice Workshop at the end of TPP is delivered to women, girls, men and boys 15+ in the 4 operational areas. Output 1321: Awareness raising sessions are held on harmful social norms, gender norms and women's rights for women, girls, men and boys 15+ in 4 operational areas. Output 1322: Monthly meetings and workshops with community leaders in established Community Leaders Committees to promote SGBV prevention, response and women and girls' participation in public life.
Project target areas The project targets communities in Dohuk and Ninewa Governorates of Iraq.
- OBJECTIVE OF THE END OF PROJECT EVALUATION
The end of project evaluation is required by the donor to give an indication of the success of the project or otherwise. The evaluation findings may be a consideration in making a decision about whether to continue with the project approach overall approach, activities or should they be revised and what should be considered in that revision. The evaluation should look closely at lessons learned and recommendations for future programing as the project may continue in 2020. It is also in line with NPA evaluation guidelines to conduct end of project evaluations for projects for purpose of drawing lessons to improve our practice in design and implementation of similar projects. To aid in this purpose the evaluation will therefore respond to the following objectives:
• To critically review the achievement of the project in terms of attaining its objectives using the evaluation criteria: relevance, effectiveness, efficiency, impact and sustainability.
• To reflect on the successes, challenges, best practices and key lessons learned during the project period.
• To reflect on project progress, achievements and change achieved considering the baseline survey which was conducted in Summer 2016.
• To reflect on the NPA model of working in local partnerships with civil society organizations to achieve project objectives.
• Suggest key practical targeted recommendations and learning to be considered by NPA for future projects and programmes in particular inform with practical recommendations the continuation and further implementation of the current project ‘Rehabilitation and reintegration of SGBV survivors, their families and communities’ in 2018 and beyond.
Specifically, the end of project evaluation will address the following key basic evaluation questions that shall be further developed and expanded on by the consultant:
Table 1 – Key review questions
Key Review Questions
Relevance and quality of design
• Was the project in line with the needs and priorities of the target group (women and girls))?
• Was the project in line with focusing particularly on the displaced minority group (Yazidies) and SGBV survivors returning from ISIS captivity.
• How did the project adapt to respond to the changing context?
• Did the project manage to engage men and boys, women and girls (considering gender and age) in SGBV prevention and response.
Effectiveness of implementation
• Extent to which the outputs and results were achieved in relation to targets set in the logical framework, through comparison between baseline and endline indicator values, taking into account the ongoing displacement, migration, change in context.
• Extent to which partnership model is an effective way of implementing SGBV and women empowerment project in emergency situations with changing context.
• A summary of how change came about.
• Details of lessons learned about how change comes about, what should be done differently in the future and what needs to happen next
• The effectiveness of the adjustments made to the programme to continuously respond to the (changing) capacity of local partners and changing context
Efficiency of implementation to date
• Were the resources used effectively and in a timely manner to produce the outputs and results are appropriate compared to the planned budget and activities?
• Assess the approach of building the capacity of the partners teams to provide comprehensive SGBV services (case management, PSS activities, legal aid, vocational trainings) and facilitate Peer support groups.
• Extent to which the implemented partnership model is an effective way of implementing SGBV and women empowerment project in emergency situations with changing context and lessons learned, recommendations for revision of the model.
• An assessment of project impact should be made, through comparison of baseline and endline values for outcome and impact indicators (using appropriate statistical tests)
• An assessment of the attribution of any impact to NPA project should be made
• An assessment of any unintended impact whether positive or negative should also be made.
• Extent to which partnership model is an impactful way of implementing SGBV and women empowerment project in emergency situations with changing context and lessons learned, recommendations for revision of the model.
Potential for Sustainability
• What are the prospects for the benefits of the project being sustained after the funding stops particularly with reference to the local capacity (partner civil society organizations)
• What is the partners capacity (organizational and SGBV/women empowerment specific) for management and further implementation of such projects?
• Recommendations for improving sustainability when working in partnership with local civil society actors.
Partnership with local CSO
• Assess the NPA partnership model for working in partnership with local CSOs in emergency situations for implementing GBV prevention and response project, providing SGBV services and working on women empowerment (considering NPA Partnership policy document).
• Assess the partnership process and the partnership relationship between NPA and 3 local partners (ASFL; EMMA; PDO), identify what worked well and what did not work well and recommend possible changes.
• Assess the participation of project beneficiaries in the project. implementation, monitoring and evaluation.
• Assess change in partners capacity for management and implementation of SGBV prevention/response and women empowerment activities.
• Identify strengths, challenges and weaknesses in the project implementation process and recommend possible changes for future learning.
• Document the lessons learned in terms of the design, implementation, and monitoring of the project, that should be applied for future projects, with consideration to NPA partnership model.
- SCOPE OF WORK:
Key responsibilities and deliverables
a. Present to NPA Iraq Evaluation Work Plan: This document will operationalize and direct the evaluation. It will describe how the evaluation will be executed, thus refining and elaborating upon the terms of reference; it will be approved by NPA senior management and act as an agreement between parties for how the evaluation will be conducted. The work plan will include the following elements:
- Expectations of evaluation
- Roles and responsibilities
- Evaluation methodology, questions
- Evaluation framework
- Information collection and analysis methods
- Reporting formats
- Day by day work plan and time-frame for deliverables
b. Develop the tools and methodology for conducting the endline evaluation for the “Rehabilitation and reintegration of conflict-related sexual and gender based violence survivors, their families and communities in Iraq” project, using both quantitative and qualitative approaches to address the key evaluation questions listed above. The consultant will then compare the endline findings with baseline values, using appropriate surveys, statistical tests (relevant methodology), to draw conclusions and taking into account the qualitative information to write the end of project evaluation report.
c. Review all of project documents (Proposal, log frame, baseline report, MEAL database and project monitoring reports) and relevant NPA policy document (NPA Evaluation Plan, NPA partnership policy, NPA Iraq Country Strategy).
d. Conduct qualitative/quantitative data collection through appropriate methods (KIIs, FGDs, etc.) and carry out data analysis (including appropriate statistical tests to compare baseline and endline data on project indicators).
e. Prepare draft Evaluation report which includes the following elements:
- A stand-alone Executive Summary
- Answered questions/ Findings
- Problems and needs (Relevance)
- Achievement of purpose (Effectiveness)
- Sound management and value for money (Efficiency)
- Achievement of wider effects (Impact)
- Likely continuation of achieved results (Sustainability)
- Overall assessment
- Conclusions, Targeted Recommendations and Management Responses
- Annexes to the report, including data analysis report.
f. Present findings to NPA Iraq and partner staff in a briefing session.
g. Consultant receives feedback on the first draft from NPA Iraq and partner staff
h. Prepare the end of project evaluation report incorporating all the feedback from both the document review and briefing session and submit final report to NPA Iraq.
i. All developed tools, questionnaires, reports, guidelines should be delivered to NPA in soft and hard copy.
The composition of the evaluation team is up to the consultant/firm who can choose, depending on their internal system, ideas and logic but the team members must fulfil competency criteria (refer to point 5). The team should involve at least one SGBV/ gender equality specialist. NPA recommends that the team should be comprised of one Team Leader/Focal point who takes overall responsibility for this evaluation and coordinate/liaise between NPA and the evaluation team.
Supervision of the field work and quality (reliability and validity) of the data/information collected at field level is the primary responsibility of Team leader. Similarly, the Team Leader will work closely with NPA’s project management team. In each step and process, consultation with the NPA Protection Programme Manager is vital.
The preliminary draft evaluation report should be submitted to NPA Iraq by 30th of November 2019 the latest and the actual presentation should be given to NPA Iraq and local partners by 10th of December 2019. The final evaluation report should be submitted to NPA latest by 15th of December 2019.
The work is planned to commence on 1st of November 2019.
- LINES OF COMMUNICATION
The Evaluators will primarily communicate with the NPA Programme Manager. They will also communicate with NPA MEAL Manager. Evaluators are also expected to interact with NPA programme team and with the four local partners (ASFL, EMMA, PDO and WEO). NPA will facilitate the communication and contact between evaluators and local partners at the beginning of the evaluation process, however evaluation team will then have direct contact with partners.
- COMPETENCY OF EVALUATION TEAM:
Proven expertise in design and review of programmes focused on women empowerment, gender equality/ SGBV and experience in the MENA context, preference will be given to candidates that have past experience with programme design, implementation and/or evaluation of SGBV and women empowerment projects in the MENA. Data analysis, and writing up of evaluation reports experience is also key for this exercise. Team should possess extensive work experience and in depth knowledge on conducting project evaluations.
The consultant or group of consultants should have post graduate degree in development studies. Preferably, the Consultancy Company or the Individual consultant should deploy a multidisciplinary team with a background of, sexual and gender based violence, and gender equality and statistical data analysis qualifications. An expert with previous SGBV and women empowerment experience is essential to team composition. It is desirable to have a post graduate in gender or related studies. Preference will be given to those who possess past experience working with INGOs and conducting evaluation surveys.
- MANAGEMENT OF THE CONSULTANT
The Iraq protection Programme Manager will directly manage the consultant(s), with support from the MEAL Manager and Country Director.