Somalia: FINAL EVALUATION OF “SUPPORT TO POPULATIONS IN HUMANITARIAN EMERGENCY & ENHANCING RECOVERY EFFORTS IN SOMALIA (SPHERES)” PROJECT

1. PROJECT BACKGROUND AND CONTEXT:

Somalia continues to face one of the most complex and protracted humanitarian situations in the world. Malnutrition rates remain amongst highest in the world and access to basic survival food remains a serious challenge for a significant percentage of the population. Nearly 60% of the people experiencing acute food insecurity are internally displaced persons (IDPs). There are approximately 1.05 million Somalis—14 percent of the total population—experiencing acute food insecurity and require humanitarian assistance. Gu rains in previous years fell below average and erratically distributed in time and space, consequently making the Gu planting season (April to August 2012) poor . Agro pastoralists households in Southern/Central Somalia and pastoral households in North Somalia who were severely hit still haven’t recovered from last 2011 drought, and continue to lose their purchasing power and survive mainly through community loans and gifts – further increasing their debts. The situation is further complicated by an insecure context, with continued clashes between militant groups and the Transitional Federal Government (TGF) and AMISOM forces that create production disruption.

Through the SPHERES project, CARE Somalia has been implementing integrated WASH, food security and nutrition projects in the past 11 months in order to respond to the critical and essential humanitarian needs of vulnerable host communities and IDPs in south Somali and Puntland. The SPHERES project is a one year USAID/OFDA-funded project that commenced in October 2012 and expected end by September 2013. The project specifically aimed to respond to emergency needs of targeted populations in eight (8) regions namely; Bari, Sool, Sanaag, Nugal, Mudug, Togdheer, Banadir and Lower Juba of Somalia. The project implemented various interventions that contributed to the alleviation of immediate suffering of vulnerable populations.

Project activities covered six (6) core programming sectors: Economic Recovery and Market Systems (ERMS); Humanitarian Coordination and Information Management; Logistics Support, Relief Commodities; Nutrition; Protection; Water, Sanitation and Hygiene (WASH);

The specific objectives of the project are as follows:

(i) To restore economic assets and provide temporary employment for vulnerable populations (including IDPs) affected by livelihood depletion and food insecurity, while stimulating the local economy.
(ii) Support the Somalia NGO Consortium in providing a forum for coordination, collaboration and information exchange among NGOs operational in Somalia, and representing the consortium membership in dialogues at the international, regional, national and local levels.
(iii) To ensure immediate replacement of essential household items for IDPs.
(iv) To reduce morbidity of preventable diseases and recurrent malnutrition by provision of preventive and curative services among under-five year old children and pregnant and lactating women in IDP and host communities.
(v) Ensure adequate monitoring, advocacy, referral and management of gender-based violence and IDP/host community conflict cases.
(vi) To ensure adequate access to sufficient and quality water, as well as to hygiene and sanitation for drought-affected and displaced communities through the rehabilitation of strategic water sources and sanitation facilities, and improvement of hygiene practices.

1. PROJECT INDICATORS:

The project indicators that will be measured specifically by the evaluation are as follows: Sector/sub-sector Indicator

Economic Recovery and Market Systems: Temporary Employment Number of people directly employed through Cash-for-Work activities

• Average USD amount per person earned through Cash-for-Work activities
• Number and per cent of women employed through Cash-for-Work activities
  Economic Recovery and Market Systems: Economic Assets Restoration Number of people assisted through economic assets restoration activities
• Total USD amount channeled into the local economy through unconditional cash transfer
• Per cent (%) of cash transferred used by beneficiaries to meet basic food needs
  Logistics Support, Relief Commodities: Non-Food Items (NFIs) Total number of Non-Food Items (NFIs) distributed, by type
• Total USD cost of Non-Food Items (NFIs), by type
• Total number of beneficiaries receiving Non-Food Items (NFIs), by type, in compliance with SPHERE standards
• Percent of beneficiary households properly utilizing kits' items Humanitarian Coordination & Information Management: Coordination
• Number of organizations coordinating
  Nutrition: Management of Moderate Acute Malnutrition (MAM) Number of sites managing Moderate Acute Malnutrition (MAM)
• Number of beneficiaries admitted to Moderate Acute Malnutrition (MAM) services by beneficiary type (<5s and adults)
• Number of health care providers and volunteers trained in the prevention and management of Moderate Acute Malnutrition (MAM)
  Nutrition: Management of Severe & Acute Malnutrition (SAM) Number of health care providers and volunteers trained in the prevention and management of Severe Acute Malnutrition (SAM
• Number of sites established/rehabilitated for inpatient and outpatient care

• Number of beneficiaries treated for Severe Acute Malnutrition (SAM) by type (<5s adults; inpatient care with complications; outpatient care without complications
  Nutrition: Education and Behavioral Change

• Number of beneficiaries receiving nutrition education

• Percentage change in practice and/or knowledge pertaining to nutrition education topics

• Number of providers (health care and/or community volunteers) trained in provision of nutrition education
  WASH: Hygiene promotion / Behaviors Percent of target population demonstrating good hand-washing practices.

• Percent of target population demonstrating correct water usage and storage.

• Number and percent of clean water points functioning three months after completion.
  WASH: Sanitation Number and percent of household latrines completed that are clean and in use in compliance with sphere standards.
• Number and percent of household hand washing facilities completed and in use.
• Number and percent of households disposing solid wastes appropriately.
  WASH: Water supply Number and percent of water supply with 0 coli form bacteria per 100ml.
• Average water usage of target population in l/p/d prior to and after intervention.
• Number and percent of water points with measurable chlorine residual exceeding 0.2mg/l.
  Protection: Gender-based Violence (GBV) Prevention and Response Number and percent of target population reporting increased access to Gender-based Violence (GBV) services
• Number and percent of target population reporting increased access to Gender-based Violence (GBV) services
• Number of males sensitized in Gender-based Violence (GBV) issues
  Protection: Coordination and Advocacy Number of protection officers/personnel provided in support of protection coordination activities
• Numbers of policies/procedures/practices modified in accordance with protection principles (e.g., Guiding Principles on Internal Displacement; Human Rights Law; International Humanitarian Law)

1. EVALUATION OBJECTIVES:

The overall objective of the evaluation is to assess and provide reliable end-line information on project performance against set parameters (i.e. indicators, goal, short term impact) on the six (6) programming sectors in target areas in Puntland, Somaliland, Benadir and Lower Juba regions which will be used as benchmarks against progress of achievements will be measured and evaluated using verifiable indicators presented in the project technical proposal.

The specific objectives of the evaluation are:

 To undertake an independent and comprehensive evaluation with a view to provide evidence-based information on SPHERES project performance against set indicators.
 To assess the extent of project’s efficiency, effectiveness, appropriateness/relevance, and short-term intended and unintended impacts.
 To document lessons learnt and provide recommendations on how to improve programming of similar emergency projects in future in Somalia.

1. SPECIFIC EVALUATION DATA TO BE COLLECTED

 Project performance against indicators (as per project technical proposal)
 Prevalence of water borne diseases in the project target areas
 Daily per capita water consumption at household level
 Quality of drinking water at household levels.
 Solid wastes disposal mechanism amongst target beneficiaries.
 Latrine access, coverage and quantities constructed/rehabilitated.
 Functionality status of WASH facilities (Boreholes, shallow wells, latrines, garbage pits etc) in target locations 3 months after construction.
 Current household hygiene practices ( especially at critical times) as per target
 Current food security situation among target beneficiaries.
 Current nutrition situation with specific focus on project indicators on MAM and SAM.
 Reporting and access levels to GBV services (prior to and after interventions)
 Percent of cash transfer used to meet basic food needs.
 Utilization of NFI items

1. METHODOLOGY

The study design should entail a holistic evaluation, comprising both the qualitative and quantitative components designed to capture project performance on six (6) programming sectors, namely: WASH, economic recovery and market systems, logistics support/relief commodities, humanitarian coordination, nutrition, and protection. The methodology must be so designed to measure indicators set in the project design document.

The consultant and his/her team are expected to use different evaluation tools, comprising primary data collection (through qualitative and quantitative household survey questionnaires) and secondary data review and literature survey. Furthermore, the study will be undertaken through a participatory and collective manner based on active involvement of project beneficiaries.

In particular, the consultant is expected to:

 Conduct desk reviews of project documents and meetings with key project staff. Key documents to be reviewed include SPHERES project proposal (which includes indicators and indicator targets), project M&E plan, quarterly reports, and indicator matrix.
 Administer household questionnaires to a representative sample to be agreed with CARE.
 Train Enumerators who will administer the household questionnaires.
 Organize one-on-one interview with key stakeholders who include government ministries, local authorities; IDP and host community representatives;
 Conduct FGDs with selected groups, particularly the IDP and host communities in target areas.

However, the consultant and his/her team are encouraged to propose additional methods to conduct the evaluation.

1. KEY DELIVERABLES:

 Work plan and data collection methodology, including translated data collection tools for all indicators and sampling methodology
 Final data collection tools incorporating feedback from CARE
 Briefings/Debriefings: Provide regular feedback/briefs to Emergency Coordinator. The consultant will report his/her preliminary findings to the coordinator, and M&E Advisor before leaving the field.
 Draft report – The consultant is expected to produce a draft report identifying key findings, conclusions, recommendations and lessons for future programming. This will be reviewed by CARE Somalia for initial feedback.
 Final report – The consultant will produce the Final Evaluation Report after incorporating all comments and feedback provided by CARE.

1. DURATION OF THE ASSIGNMENT:

The duration of the assignment is 21 working days after signing of contract. Days are inclusive of travelling, fieldwork and reporting. The evaluation is expected to take place in September 2013.

1. CARE’S RESPONSIBILITIES ON THE ASSIGNMENT:

In support to the consultant(s) to undertake the assignment, CARE Somalia will:

 Provide assistance in facilitating visas for Somalia, and travel expenses (Visa, taxi) upon presentation of receipts.
 Make payment in US Dollars at an agreed rate (depending on experience).
 Pay fixed daily rates to Enumerators (if engaged to collect data)
 Provide all relevant/available materials pertinent to study
 Provide logistical support for field activities
 Provide transport to and from Somalia during the consultancy period
 Provide housing, boarding and transportation in Somalia. In case this is not provided while on field trip, CARE will pay per diem based on its rates in the country.

1. QUALIFICATIONS OF THE CONSULTANT:

The consultant must possess relevant operational experience and qualifications to undertake the work, specifically the following;

 Advanced university degree in Public Health, Social Sciences or any other related field with a minimum of 5 years of experience in conducting similar work. Previous experience in evaluating USAID/OFDA funded projects will be an added advantage.
 Expertise in the fields of WASH, livelihoods and public health nutrition. If more than one consultant, their expertise must complement each other.
 Experience in conducting project evaluations of similar programmes using participatory methods.
 Thorough knowledge of WASH programming; emergency nutrition; and livelihoods recovery/development in the emergency context of Somalia.
 Advanced analytical and report writing skills.
 Proven study team leadership qualities.
 Fluency (written and verbal) in English. Somali language is an added advantage, but not a must.

All applications MUST be accompanied by a technical and financial proposal including a brief outline of the proposed methodology, 3 references with contacts and a tentative work plan as well the candidate’s availability during the months of September and October 2013. These shouldn’t exceed 10 pages. Deadline for submission of technical and financial proposals is 15th September 2013.

Interested consultants or firms should submit their applications, updated CVs of individuals to conduct the survey or profile of applying company to: consultants@som.care.org and copy MDubow@som.care.org . Please indicate “SPHERES FINAL EVALUATION” as the subject heading.