Country: Somalia
Closing date: 07 Dec 2014
1.Introduction
VSF Germany is an international Non Governmental Organization, providing humanitarian aid and development assistance to pastoralists and vulnerable communities in areas where livestock is of importance. In the region, VSF Germany implements activities in South Sudan, the Sudan, Kenya, Somalia and Ethiopia. With support in animal health, agriculture, marketing, food safety but also with developing the capacity of communities and governmental institutions, initiating peace building and conflict resolution, and working with women we work towards food security and strengthened livelihoods of pastoralist communities.
Following over 20 years of conflict and civil unrest in Somalia, the structure of Somali society has dramatically changed and women dominate many of the informal business entities and have become the prime bread-winners of their families in the country. Somali women contribute to the economies of their families by largely engaging in small scale enterprises and home-based income generating activities such as milk and meat vending, teashops, artifacts, garment making, etc. This happens against the backdrop of lack of skills in business management, limited access to resources for expansion of businesses and poor or no linkages to critical service providers. Furthermore, patriarchal traditional perceptions and structures reinforce marginalization and discrimination of women and girls in the social, political and economic spheres with no or little formal policy and legal redress. Protection of women’s rights in Somalia is fragile with different forms of violence, exploitation and deprivation of basic needs and rights prevalent in both urban and rural communities. This is further exacerbated by low awareness of women’s rights and gender equality among Somali men.
In light of the above mentioned challenges facing women and girls, VSFG designed a project to address the identified needs and issues which was funded by European Union. In collaboration with the ministry of women development and family affairs and local partners and stakeholders, VSFG has been implementing gender equality and women’s empowerment project since September 2012. The specific objective of the project is action is to promote the economic empowerment of women victim of GBV and women in Somalia through micro financing of group-based income generating activities. The project focuses on three results: supporting women involved in small scale income generating activities with technical and financial inputs, strengthening the capacity of GBV survivors and women organizations in the prevention and management of GBV, and enhancing the perceptions of men towards women.
2. Purpose of the evaluation
To assess the impact of the project on the lives of project beneficiaries and the contribution of the Action to the principle objective of the project; “*to contribute towards the promotion of gender equality and women empowerment in Somalia for an inclusive, transparent and accountable society”*. Thus, the external evaluation aims at assessing achievement of the stated objectives, outcomes and outputs, best practices and lessons learnt from the implementation action.
3. Objectives of the evaluation
To assess and quantify where possible(i) the relevance, effectiveness, efficiency, impact and sustainability of the action(s) towards meeting the specific objectives and (ii) the contributions of the Action to gender quality and women’s empowerment.
The performance is judged against the project indicators compared with baseline information and monitoring data. Besides, the evaluation serves to gather objective information on how the project was adapted to the evolving humanitarian situation in target areas, the effectiveness of gender and women empowerment approaches, security of aid workers, respect for human rights, economic environment, and donor visibility used by the project.
The specific objectives of the evaluation are:
a) Assess whether or not this Action, in design and implementation strategies, was consistent with the overall goal of EU, national priorities, policies and action plans for the gender and human rights sector i.e. the extent to which the various actions have contributed to priorities set under each of the above.
b) Examine to what extent gender and women’s empowerment programming (and activities undertaken under this Action) has effectively contributed to improved economic, social and political situation of women in Galkayo-Puntland.
c) Examine extent to which key result areas (increased income of women, capacity for self determination, to cope with GBV, improved perceptions of women’s rights and roles in Puntland society) were achieved achieved and good practice principles applied.
d) Analyze and verify the achievement of intended results as described in the logical framework for each action.
e) Assess the impact of the project on the lives of small scale women traders and GBV victims, draw out key lessons learnt and opportunities for future programming in gender and women’s rights in Somalia.
4. Scope of work
In the course of this evaluation, the evaluator shall interact with a wide range of informants; women traders and GBV victims who directly benefitted from the project, local implementing partners such as GECPD, government authorities such as MOWDAFA and Galkayo municipality based on their partnership and collaboration with the project. It will assess the achievements collectively at specific objective level taking into account the uniqueness and innovative contributions of this project.
5. Evaluation methodology
In designing the evaluation methodology, reference is to be made to the EU guidance (DAC). The consultant shall prepare comprehensive participatory tools for undertaking this evaluation. The methodology must include among others, literature reviews; meeting and interviewing project staff, officials in the ministry of women development and family affairs and local municipalities; visiting IDP camps and interviewing direct project beneficiaries (women traders, GBV victims, local women groups, etc.) and stakeholder consultations. The consultant is expected to develop and use data collection tools as appropriate to the task. The field visits and contact sessions with communities and groups must strive to reach/meet 60% of the targeted groups including government officials. VSFG will take responsibility for logistics and mobilization and facilitations in the field.
6. Indicative plan
Assessment and awarding of contract8th– 9th DecemberMeeting with Somalia Country Coordinator 10th DecemberReview of project documents and development of data gathering tools 11th– 13th DecemberTravel to Galkayo to begin field work 14th DecemberField work (*detailed itinerary and routes for field work will be jointly developed with field team).* 14th– 20th DecemberTravel back to Nairobi 21st DecemberReport writing and consultations 22nd– 26th DecemberPresentation of preliminary findings 5th January 2015Submission of final report 9th January 2015
7. Key tasks of the consultant
a) Collect relevant data / information on the project implementation, outputs and outcomes from relevant sources.
b) Develop methodology and tools for the data collection and analysis process. Such tools should be shared with VSFG before starting field work for any comments.
c) Develop a practical work plan for the work.
d) Visit project sites and carry out evaluation through meetings with all relevant stakeholders.
e) Consult with relevant stakeholders for views on the project in Nairobi as including the EU prior to field work.
f) Debrief VSF Germany after completing the assignment and validate the findings prior to submitting final report.
g) Prepare and submit final evaluation report to VSF Germany as per time frame set in the ToR.
8. Consultant’s profile
A consultant with sufficient knowledge and experience covering the key result areas of the project (women economic empowerment, improved capacity for individuals and groups to cope with and prevent GBV, & Improved perceptions of women’s rights and roles in Puntland society) is recommended for this evaluation. The consultant should have competencies in evaluating impacts of women economic empowerment/micro-finance initiatives, promotion of women’s rights activities and GBV management interventions, good understanding of participatory methodologies, able to collected data and analyze using appropriate statistical packages if needed and must be fluent in spoken and written English,. sound knowledge of the Somalia context and demonstrated ability to manage the available time, resources and to work to tight deadlines. The Consultants should be able to demonstrate impartiality during the work.
Specifically, he/she should have:
a) Demonstrated understanding of protection, gender and women’s rights programming and economic empowerment models (income generation activities, micro-finance, etc.)
b) Experience in humanitarian and development contexts.
c) At least 5 years working experience in the dry lands of the Horn of Africa
d) Firsthand knowledge of socio-cultural, economic, political situation in Somalia is advantage.
e) An in-depth knowledge and experience in evaluations of protection and gender actions including economic empowerment of women
f) A Degree or higher qualification preferably in Social sciences, Gender, Development studies, Agriculture and/or Livestock with strong experience in women small scale business management.
g) Strong analytical and writing skills and ability to clearly present findings, practical conclusions and recommendations.
h) Knowledge of Puntland institutional and local context is an asset
i) Evaluation of a previous EU funded project is an advantage
9.Expression of Interest
Any person/firm interested in undertaking this evaluation should send an expression of interest comprising:
a) Technical proposal; (maximum 3 pages) including the methodology and work plan to comply with the requirements of the evaluation
b) Financial proposal: consultant fees per day excluding transport, food and accommodation in the field
c) CV of the person(s) to carry out the actual work/evaluation
d) Applications to be submitted to VSF-Germany not later 17.00 hours7th December,2014
10.Reporting
The evaluator will write and produce a precise final report (maximum 25 pages) written in simple and understandable English. The draft report is to be shared with field teams and discussed with the VSFG in Nairobi during debriefing time. Comments and inputs from the VSFG will be included in the final report.
The following report format to include:
- Cover page: (Title of the evaluation with the title of the Action, names and logos of the donor and implementing partner, Consultants’/firms name and address, Dates of the evaluation and the report)
- Table of contents, Executive summary (a maximum of 4 pages), main report including the findings, conclusions, lessons and recommendations.
- Annexes
- Terms of Reference;
- List of persons / organizations consulted;
- List of literature and documents consulted;
- List of sites visited;
- Examples of case studies
- List of abbreviations
Further works or revisions of the report may be required if it does not meet the requirements of the TOR, if there are factual errors, including incomplete reports, or if the report is not of acceptable standards. The final report must be drawn up in 4 hard copies and 4soft copies.
11.Issues to study
The consultant should assess evidence of relevance and quality of design, efficiency of implementation, effectiveness, impact to date and analyze potential sustainability of the achievements. The issues to be studied are:
a.Relevance.
Relevance is the extent to which the objectives and design of the action being evaluated fit with: current global/ regional policies, challenges and concerns; the needs, policies and priorities of intended beneficiary; EU operational guidance and the good practices principles developed by relevant ministries and other, the specific objectives, role and comparative advantages of the NGO. It is critical that evaluation looks especially at the adoption of the good practices principles. Some of the considerations include:
Is the action consistent with the main goals of EU gender equality and women’s empowerment as stated in the operational guidance?
i) Was the design appropriate for the geographic area?
ii) Was the intervention logic coherent and accurate?
iii) Were any lessons learned from previous pilot projects in the area?
iv) Were the indicators of progress and of impact in the design of good quality?
v) How was the quality of the outputs going to be determined?
vi) Were the outputs achievable or overly ambitious?
vii) Does the action build on comparative advantages of the NGO? Does it compete with or substitute for activities that other development agencies could do more appropriately or efficiently?
viii) Is there evidence of continuing demand for the program from intended beneficiaries?
ix) Were potential values for money, opportunity costs and trade‐offs considered in the action’s development?
x) How much the good practice principles developed by VSFG under this gender equality and women’s empowerment project have been implemented?
xi) Are the specific objectives of the program still valid given changing circumstances?
xii) Was the design appropriate for the geographic area?
xiii) Was the action’s organizational structure and choice of partnerships appropriate to achieve its aims?
xiv) Have appropriate incentives been built in for partners?
b. Effectiveness:is the extent to which the action has achieved its outputs and outcomes.
Questions on effectiveness may cover the following areas (as appropriate):
- To what extent was the activities implemented result in achievement of planned outputs and outcomes and specific objectives?
- What unplanned outputs and outcomes have been achieved? Were they good or bad? Any adjustments were made in the original plans? How have ‘failures’ been handled and documented? How did they affect overall project achievement?
- What were the major factors influencing the achievement or non‐achievement of the planned and unplanned outputs and outcomes?
- Was coordination with other development actors effective?
- Where the effects of the project felt equally across the project area or were some areas neglected?
- Were technical designs effective and appropriate for that environment?
c. Efficiency:- is the extent to which an action has converted its resources and inputs (such as funds, expertise and time) economically into results in order to achieve the maximum possible outputs, outcomes, and impacts with the minimum possible inputs”.
Questions on efficiency may cover the following areas (as appropriate):
- Timeliness of commencement of project implementation.
- Was a no cost extension applied for and granted?
- Were all inputs delivered on time? Were inputs of acceptable quality?
- Was the methodology of implementation the right one under the circumstances?
- Did the implementing agency get good cooperation from relevant government partners/authorities?
- What was relevant governments and local leaders’ assessment of this intervention?
- Was access to project areas acceptable?
- Were most of the outputs achieved to an acceptable standard?
- Was co-financing a success? Did other donors deliver on time?
- Did the community contribute in cash and in kind according to the proposal?
- Was the budget spent according to the proposed budget lines? Was the rate of spending acceptable?
- To what extent did the NGO/agency take on board the recommendations from EC’s field visits and feedback on progress reports provided by the EC?
- How do actual costs compare with planned costs? What are the main reasons for any differences?
- Are there any obvious areas of inefficiency?
- Were financial and human resources available in the quantity and time planned and maintained through project life? If not, what were the effects?
- How do the costs of producing outputs and other processes compared to those of similar actions?
- Coordination: Is the level of collaboration and coordination with partners, including capacity building, appropriate and efficient? What are the views of different partners?
- What would be the probable implications of scaling the action [up or down (if relevant)] in terms of costs, cost‐effectiveness, or efficiency?
d.Impact
The word impact can be used in different ways. We use here the OECD‐DAC definition: “Impacts are positive and negative, primary and secondary long‐term effects produced by an action, directly or indirectly, intended or unintended”. Impacts can be at the macro (sector) or micro (household or individual) level.
We do recommend here a very practical approach and expect that the evaluator will systematically refer to the impact/ outcome indicators for the specific results. This is a critical element to strengthen the evidence base of the approaches for future advocacy and good practice promotion.
Evaluators should also check what actions taken outside this project in Galkayo complemented achievement of planned impacts (e.g., by the private sector, changes in policy, etc), Evaluation should also document (and where relevant/possible, quantify) spin off effects and risks of the project.
Sustainability:- is the continuation of benefits from an action after work has been completed, or the probability of continued long‐term benefits. Questions on sustainability will vary considerably with the objectives of action being evaluated and may cover the following (as appropriate):
- To what extent, are the benefits of the action are expected to continue? Why or why not?
- Is there an appropriate exit/hand over strategy, for example in partnerships? Are partners prepared and incentivised to take on any necessary responsibilities?
- Have partners or other key stakeholders benefited indirectly (e.g. in knowledge, attitudes, power) as a result of the action?
- Is there any risk that the project is crowding out other initiatives?
- How sensitive are the benefits to future changes in the operating environment?
- To what extent has the action likely to have affected environmental sustainability, in a positive or negative way?
- To what extent the action has strengthened women’s rights, gender equality and the economic power of women and community members and any actors will be sustained?
How to apply:
Interested and qualified Consultants should submit a technical proposal including a Financial proposal, consultancy firm profile plus the consultants’ CVs to: postal address or via email address above indicating the project. Only short-listed Consultants will be contacted for feedback. Closing date for receiving applications is 7th December 2014,at or before 17.00hrs.