Somalia: TOWARDS SELF RELIANCE (TSR) PROJECT FINAL EVALUATION

CARE SOMALIA /SOMALILAND

TOWARDS SELF RELIANCE (TSR) PROJECT

FINAL EVALUATION TERMS OF REFERENCE (TOR)

1.Introduction

a.The organization

CARE International had been operating in Somalia since 1981 in delivering humanitarian service to the most vulnerable members in the community. CARE currently works through three main programs: the Rural Women Program supports poor rural women and girls in addressing long term underlying causes of poverty and vulnerability as well as social, cultural, political and economic obstacles towards positive change. CARE helps women and girls improve their economic status, access education and support them to play a greater role in local leadership and conflict resolution; the Urban Youth program focuses on job creation and livelihood opportunities for poor youth through interventions such as secondary education, vocational training, small business development and microfinance; whereas the Emergency program provides direct humanitarian relief to victims of drought and conflict in Somalia/Somaliland.

b.The project

CARE Somalia/Somaliland received funds for the second phase of the TSR project from the European Commission (EC). The first phase of the project ended in December 2012 and the second phase is a follow-up to and expansion of the first phase of TSR program. The TSR 1 project has made considerable achievements in increasing livelihood security of the target communities. Not only have immediate needs been addressed, but more importantly systems have been established to help cushion livelihoods from the effects of future droughts. The TSR 2 project built on these achievements by more deeply addressing structural root causes of poverty, decreasing vulnerabilities and fostering a culture of self-reliance.

The new phase of TSR 2 introduces a number of methodological changes and additions to promote investment and further empower women. The enhancements entail: (a) Supporting specific activities that help project participants use the Village Savings and Loans Associations (VSLA) funds to start small business ventures, TSR 2 will pilot a profit and loss sharing system that aligns with Islamic financing principles and is not interest based, working closely with local religious leaders; (b) Expanding activities to enhance women’s role in household decision making in allocation of resources through budget management training, and development of leadership skills and basic money management skills (e.g. literacy and numeracy, bookkeeping, management, planning and maintenance); (c) Intensive training on entrepreneurial and vocational skills to help project participants pursue profitable self-employment opportunities; and (d) Linking successful VSLAs to remittance companies to further improve access to financial services, and encourage remittance companies to start considering services beyond remittances, as part of a wider range of (Islamic) banking services.

CARE’s VSLA approach is at the core of the program, building on the achievements and lessons learnt in TSR 1. The primary purpose of a VSLA is to provide simple savings and loan facilities, in a community that does not have access to formal financial services and through these and other enabling activities empower women to manage resources and invest them for the benefit of their household. Loans can provide a form of self-insurance to members, supplemented by a social fund which provides small but important grants to members in distress.

CARE envisages a community based approach where communities, through a participatory rural appraisal approach, identify their needs and implement appropriate solutions hence enabling communities to start building a better and more dignified life.

c.Project Objectives

The overall objective is reduced poverty and increased food security for chronically food insecure pastoral populations in Northern Somalia.

Indicators

· The proportion of people living on less than a dollar a day in Northern Somalia is reduced by half.

· The proportion of people who suffer from hunger in Northern Somalia is reduced by half.

The specific objective is improved livelihood security of 4,727 vulnerable households (28,362 individuals) in Sool and Sanaag regions of Northern Somalia.

Indicators

· At least 70% of targeted population score higher on the positive coping strategies index.

The project will directly contribute to 4 expected results as outlined below:

Result 1: Improved access to financial services (savings, loans and insurances) for 3,467 vulnerable households by the end of the project.

Indicators

· 3,467 HH have access to financial services through participation in VSLAs.

· 181 VSLAs functional by the end of the project.

· At least 30% of the HH that receive conditional cash injections participate in a VSLA.

· At least 60% of the participants report an improvement of their self-esteem and social position through their participation in VSLA.

Result 2: Improved and diversified employment opportunities for 1000 vulnerable households by the end of the project

Indicators:

· 30% of the households start income generating activities during the project.

Result 3: Strengthened ability of 1000 women to manage household budgetary decisions and influence household resources allocation

Indicators:

· 30% men and women reporting meaningful participation of women in household budget decision-making.

Result 4*: Improved community infrastructure in 42 villages, and increased resilience to the impact of* drought for 3,000 households by the end of the project

Indicators:

· 1,260 HH benefit from conditional cash transfers.

· 42 communities with completed infrastructures by type.

2.Objectives of the evaluation

The overall objective of the final evaluation is to assess the progress made towards achievement of the overall and specific objectives of the project, and achievement towards the indicators of the project. The evaluation will assess the overall impact (positive as well as negative) observed as a result of the project intervention. The terminal evaluation is expected to generate well documented findings, lessons learned and recommendations.

The project’s final evaluation is a part of the agreement with the EC. The evaluation will be done to assess the situation at the end of the project and provide recommendations based on lessons learnt from the project interventions. The final evaluation will also help determine some impact signs the project has made on the main target communities. The evaluation will also gauge the level of community and other stakeholder participation and ownership of the implementation process including the identification of the intended and unintended outcomes, best practices and lessons learned as well as challenges arising from programme implementation and provide recommendations on the way forward for future programming.

CARE seeks to hire an external consultant for 23 days to carry out the final evaluation.

A.The purpose of the final evaluation is primarily:

· To assess extent to which the project has achieved its objectives and created the expected changes in target communities lives.

· To review the achievements against targets of indicators established in the project’s logframe.

· Assess whether the project objectives and strategies were relevant in addressing the identified problem(s).

· To evaluate the effectiveness and efficiency of the different approaches used to implement the project

· Establish the extent to which the results of the project are sustainable.

· To generate learning (positive and negative) and good practices in implementing the project that could be applied in future programming.

· Based on the findings of the evaluation make specific recommendations for different stakeholders for improvements.

B.An assessment of a number of critical elements in the project approach and methodology

· To assess in detail the relevance of the relief component against the current food security context of the project area. In order to do so the consultant will analyze the food security situation, bringing together existing sources of information and where necessary verify this through fieldwork.

• To assess the ability to withstand shocks and identify the key coping mechanisms and their impact on household income sources for each of the wealth groups within the project target areas.

· To assess the impact and sustainability of the Village Saving and Loan Association (VSLA) model in the context of Somalia/Somaliland and the linkage of the project relief component and its Village Saving and Loan Association (VSLA) component.

· To analyse the impact the project has on the status of women within their households and the community in general (i.e. involvement HH budget decision making and resource allocation, economic position as a result of livelihood opportunities (self-)employment), involvement in community leadership and decision-making, etc.)

· To assess the effectiveness of measures taken to ensure project achievements are not lost and provide suggestions for improving the sustainability of the project.

· To review the effectiveness and relevance of the selection criteria for areas, structures and participants: are vulnerability criteria adequately applied in the selection of participants for different project interventions

C.Anassessmentof the achievements of the project so far against log frame indicators and Organisation for Economic Co-operation and Development (OECD) criteria

The consultant shall assess the project achievements against the following criteria (relevance, efficiency, effectiveness, impact and sustainability):

Relevance

The consultant should look at the design of the project and assess the extent to which the stated project objectives address the identified problems or real needs.

Efficiency

· Analyse the quality of day-to-day management (adequacy of project budget, management of personnel, project properties, communication, relation management with elders, community leaders, other development partners, etc.)

· Local capacity building: How far the project was able to strengthen the capacity of Village committees and Village Saving and Loan Association (VSLA) groups

· Review if the technical design and quality of works undertaken is appropriate and adequate.

· Review and assess the quality of monitoring

Effectiveness

· Assess whether the beneficiaries (communities and LNGOs) perceive that the planned benefits are appropriate

· Assess the appropriateness of the indicators (OVI’s) and make recommendations on any possible changes to be made.

· Assess the robustness of the monitoring protocol and data collection & compilation by project staff based on the log frame indicators.

Impact

· Assess progress against the planned overall objectives and against the log frame indicators.

· Assess the impact of the projects on the purchasing power of beneficiary households and, as a result, their poverty reduction.

· Analyse the project approach to gender and its impact on gender equity and related issues.

· Assess the possible intended or unintended impact on environment

Sustainability

· Ownership of objectives and achievements: to what extent were the stakeholders consulted and involved in defining the objectives, the selection process for activities and beneficiaries, implementation, monitoring and evaluation?

· Institutional capacity: Assess the degree of commitment of stakeholders, community and village committees in cost sharing, and the measures taken to strengthen their capacity and suggest improvements for the future.

· Document lessons learned by the project so far.

· Analyse the capacity building component of the project including appropriateness of training methods and suitability of messages and curriculum.

· Assess the economic and financial sustainability of the interventions.

At the end of the final evaluation, the external consultant shall produce a comprehensive report and present it to CARE.

3.Scope of Evaluation

The final evaluation should cover the implementation period from 28^th November 2013 to June 2016 (We will update once the NCE approval is received). The geographical scope of the evaluation is Erigavo, El-Afwayn, Ainabo and Bo’ame districts of Sanaag and Sool regions respectively. While the main emphasis should be on measuring the final achievements, results and impact of the project against baseline values on each of the indicators, the final evaluation should also cover the relevance, effectiveness, efficiency and sustainability.

4.Methodology

The consultant shall use mixed methods including desk review, key informant interview sample survey, and observation using simple but numerically sensitive tools to collect data. The sample size must be statistically representative of the population. The analysis will involve statistical and content analysis using appropriate packages as deemed fit by the consultant in consultant with CARE. The analysis among others should show trends and to the extent possible should be disaggregated by gender and location. Unless otherwise necessary, the consultant shall use the sampling techniques consistent with the baseline for comparability with baseline performance and targets.

5.Expected deliverables

The following deliverables are expected:

1. Briefing by CARE, the partner and/or the EC in Nairobi and/or Somaliland

2. Review of reference documents (Desk Review)

· EC regulations, project financing agreements, evaluation guidelines.

· Project document.

· Project baseline survey.

· Project log frame.

· Progress reports.

· Financial reports.

· VSLA manual.

· Any other relevant documents.

1. Design the evaluation and submit an inception report including critical elements in the project approach, project and relevant program indicators and the OECD criteria; and the corresponding research methodology including the data collection tools, sampling technique and sample size.

2. Train enumerators who will pre-test the data collection tools.

3. Obtain feedback on data collection tools from key CARE and partner staff and finalize data collection tools (including translation into Somali).

4. Field Work

· Interact with field staff and finalize the field visit plan.

· Interact with local NGOs, other international NGOs and other stakeholders as relevant.

· Meet with local authorities.

· Collect data from a representative sample of individuals from the target groups and key stakeholders, including the partner NGO, VSLAs and women’s groups, village committees, elders, user committees and local authorities, through e.g. household questionnaires, key informant interviews (KII) and Focus Group Discussions (FGDs). There should be adequate women representation and participation during FGD discussions and the data collection exercise in general.

· Assess progress on and quality of constructed on-site facilities and associated infrastructure through cash for work, such as berkads, check dams, etc.

1. Present of preliminary findings to and validation by key stakeholders in the field, including the CARE’s project team and the partner to obtain their feedback to be incorporated in the draft report.

2. Undertake data entry, verification and analysis.

3. Write and submit first draft of report.

4. Present findings to CARE and obtain feedback to be incorporated in the final report

5. Finalize the report incorporating feedback and submission of final report.

There should be adequate women representation and participation throughout the data collection process. Where necessary, especially in rural areas, focus group discussions should be conducted separately for men and women.

6.Timeframe

The consultants will produce the following specific deliverables after signing the contract:

Deliverable

Days

1. Methodology, including work plan and draft data collection tools

2 days

1. Tested and translated final data collection tools

2 days

1. Data collection/draft report, including all annexes (see below)

11 days

1. Presentation of findings and recommendations to CARE and partners

1 day

1. The consultant, upon completion of the assignment will, verify findings with key stakeholders

1 day

1. Final report, including all annexes (see below)

3 days

1. Presentation of findings and recommendations to beneficiary communities and external stakeholders

1 day

1. Travelling

2 days

Total

23 days

The first draft report is to be received by26th September 2016

The draft and final report will have the following structure:

1. Executive Summary (max. 2 pages)

2. Introduction.

3. Methodology, including sampling.

4. Analysis and findings of the study.

5. Conclusions, recommendations and best practices.

6. Annexes

a. Performance indicator tracking table reflecting the status on each indicator against target;

b. Recommendations for revisions to logframe.

c. Relevant maps and photographs of the study areas.

d. Bibliography of consulted secondary sources.

e. Finalized data collection tools (in English and Somali).

f. List of key informants.

g. Raw data in an agreed format.

The report will be written in English.

The consultant needs to produce 3 hard copies of all deliverables. The final report will also be provided in electronic copy (both PDF and MS Word format) to be shared with the Programme Coordinator of Rural Women, Ibrahim Hussein.

7.Expertise required

The evaluator should be an experienced and independent consultant with the following expertise:

· Minimum of 10 years professional experience in developing countries, including previous experience working in Somalia/Somaliland.

· University degree in Project Management, Livelihoods, Women Empowerment or other relevant related subject.

· Excellent understanding of women empowerment, local governance and community action.

· Be conversant with Village Savings and Loans Association concept or the Group savings and loan association or similar associations.

· Demonstrated experience in community development / community targeting / Participatory Rural Appraisal (PRA)

· Have a good understanding of Somalia/Somaliland and its history, and the resulting impact this may have on the working environment.

· Have an understanding of operating conditions in an insecure environment.

· Have practical experience in assessments, planning and implementation of interventions using participatory methods such as PRA.

· Familiar with Project Cycle Management and evaluations, especially under EC funded projects.

· Have excellent analytical and writing skills.

· Be willing to travel extensively in the working areas of the project.

· Be a team worker who can produce a report and presentation together with other consultants involved in the evaluation.

· Fluent in English (both reading and writing).

· Understanding of the Somali language is an advantage.

8.Work plan and Time schedule

The consultancy is expected to take place in the months of September 2016 – October 2016 in a total of 23 days, including preparation, evaluation design, field work, report writing and presentation of findings and recommendations to CARE, partners and external stakeholders.

The first draft report is to be received by 26^th September, 2016.

9.Guiding Principles and Values

The consultant shall adhere to the “Do No Harm” principle and any other humanitarian principles. The consultant will be required to follow CARE Somalia’s security advice.

Applications will be evaluated based on the following criteria:

· Technical experience and expertise

· Quality of proposal

· Cost-effectiveness of proposal

The consultant shall ensure at all times the confidentiality of data, respect the privacy of all individuals concerned and make all data collected available to CARE in a usable format.

10.Terms and Conditions:

Logistics: The consultant’s travel from base to the field and back after the end of the contract (including airport tax), food, and accommodation will be covered by CARE.

All applications should include the following;

• Cover letter (maximum 1 page) and updated CV’s of all study team members

• Technical proposal: Which should include (i) brief explanation about the Consultant with particular emphasis on previous experience in this kind of work; (ii) profile of the Consultant to be involved in undertaking the evaluation, (iii) Understanding of the TOR and the task to be accomplished, (iv) draft work and plan.

• Financial Proposal: Which should include consultancy fees but excluding: accommodation and living costs; transport cost; stationeries, and supplies needed for data collection; and costs related to other persons that will take part from CARE and partner organization and government authorities during survey process, workshops.

Applications should be sent to somconsultants@care.org by 7th September 2016.