CHURCH WORLD SERVICE : CALL FOR CONSULTANT - EVALUTION ENDLINE SURVEY, PALU

CALL FOR CONSULTANT: Evaluation-End line Survey Disaster Resilience through Enhanced Adaptive Measures Funded by Act for Peace (AfP) -  ANCP (the Australian NGO Cooperation Program), CWS/Indonesia, July-August 2020

 I. Background

South Sulawesi province, with the population of 8 million people, chronically experiences severe floods, landslides and earthquakes. Earthquake hazard is high in the northern part of the province due to the highly active Palu-Koro and Matano fault systems, and moderate in central South Sulawesi due to the Wallanae Fault. South Sulawesi also experiences droughts and other severe weather events, including extreme wind. The south and northeast coasts of the province have moderate tsunami risk. All 24 districts and municipalities in South Sulawesi are ranked high risk by BNPB, including Tana Toraja district where floods and landslides are the main hazards during the rainy season. During the dry season, draught and forest fires also negatively affect communities. The results of a 2016 CWS Hazard Vulnerability and Capacity Assessment confirm this information.

Changed weather patterns associated with El Niño have had an impact to an estimated 22 million people in 2015/16, and the BNPB declared a drought emergency in the affected districts. Dry conditions, a late monsoon season onset and erratic rainfall led to crop failures, lower than usual agricultural yields and, in some cases, unavoidably delayed planting. El Niño was followed by a mild La Niñain 2016, which is typically associated with the opposite weather effects creating a risk of severe flooding and further damage to crops that could exacerbate food shortages.

Together, these realities will result in reduced household incomes in the impacted regions, one of which is South Sulawesi, and here particularly the Tana Toraja District. The increasing irregular weather patterns have not only caused torrential rainfall and triggered landslides, they have also decreased the yield of the main crops (rice and coffee) in Tana Toraja. The intensity of climate hazards has profound impacts on the agriculture sector which remains the main source of livelihood for the people of Tana Toraja. It is therefore imperative that communities in Tana Toraja adapt to the changing climate and weather patterns
Funded by Act for Peace (AfP) -  ANCP (the Australian NGO Cooperation Program), CWS have been implemented the Disaster Resilience through Enhanced Adaptive Measures (DREAM) that is designed to support communities engaged in building adaptive capacities, reducing the risks presented by ongoing climate change and building resilience.

After 3 years program implementation, CWS  plan to conduct the evaluation-end line survey to evaluate  the current condition related with climate change adaptation (CCA) and Disaster Risk Reduction (DRR of the communities to provide recommendation on the most appropriate strategies for the next phase.

II. Objective of the Evaluation- Endline Survey:

The objective of the evaluation- end line survey is to measure the project goal achievement by collect data (qualitative and quantitative) on which be measured, compared and analyzed against the Evaluation-End line survey value, overall objective indicators and expected result indicators of the project.

 Specific objectives:

·         To measure the current level of target communities’ knowledge, attitude, and practice (KAP) on community based adaptation related to climate vulnerability. This will cover issues adaptation/coping mechanism, land use and agricultural production, vulnerability of farmers to climate change, technologies and intervention promoted, and adaptation policies.

·         To measure the current KAP level of target community and government on disaster risk reduction (DRR) and Climate Change Adaptation (CCA). This will cover issue on community participation, their interest, knowledge, skills and attitudes in disaster risk reduction, emergency response preparedness, early actions to disaster and community-based early warning system – especially the target groups in the target communities.

·         To measure degree of implementation on effectiveness, efficiency, accountability, sustainability, inclusivity and quality delivered on outputs and outcomes, against what was originally foreseen in the project document, M&E frameworks, including the area of partnership between CWS and Pusbinlat Motivator.

·         To provide recommendations for future program by analyzing the problems and issues which remain unresolved on program areas (DRR and CA)

·         To identify and document substantive lessons learnt and good practices on the thematic areas as defined in outputs and other crosscutting issues

III. Evaluation-End line survey  Target Audiences

The Evaluation-End line survey  result is intended for some parties as it will be useful for further utilization as lesson learn to management, intervention and accountability. The target audiences are:

a)      The beneficiaries impacted of the project and generally, the community, government and stakeholders of Tana Toraja district.

b)      Partner – Pusbinlat Motivator

c)       CWS

IV. Area of Evaluation-End line Survey  

The survey will be conducted in five lembang (villages) of Tana Tojara District which are Bau, Burasia, Pondingao, Belau Utara, Rano village.

V. Evaluation-End line Survey  Methodology

The evaluation-endline survey will be conducted by external consultant. The consultant will be responsible to ensure the evaluation-end line survey methodology and meet statistical analysis requirements for both qualitative and quantitative approach.

To accommodate all outcome indicators required, the Evaluation-End line survey methods should include detailed data on target beneficiaries (both direct beneficiaries, adolescent boys and girls, and indirect: communities in Tana Toraja District), secondary data, qualitative data and quantitative data.

All data, qualitative and quantitative, collected through the assessment must be disaggregated by locations, age and sex, that is, separately for girls, boys, men and women. The external will develop specific questionnaire for each stakeholders. 

The following methodology and research tools will be employed (but not limited) during the study.

1.       Secondary Document: To conduct a thoroughly clearly referenced literature review, relevant documents, agreements and policies with regard to disaster risk reduction/ management, disaster events, early warning system, disaster management institutions, etc (both national and international official documents)

2.       Qualitative data: will allow verifying the perceptions and experiences of communities (men, women, adolescent girls and boys) and key stakeholders. The consultant should use qualitative approaches, such as focus group discussions and key informant interviews. The following is the key informants in each stakeholder.

a)      Community in the selected five villages/lembang in Tator District

The key informants should know the condition of the village, the community particularly the vulnerability (of farmers) to climate change, climate change induced disasters, current adaptation and response mechanism etc.

b)      BPBD Tana Toraja (Tator) and its related stakeholders (i.e Dinas Sosial, BPBD, BMKG, Dinas Pertanian, Badan Ketahan Pangan, BAPPEDA, Dinas Lingkungan Hidup). The key informants should know the condition of the BPBD Tator and its related stakeholder’s capacity in response management and contingency plan.

3.       Quantitative data: for some indicators of the project, it will be necessary to conduct a survey which explores knowledge, attitude and practices – on household adaptive capacity, disaster preparedness level and current competency of BPBD- in the project areas.

External consultant will help to measure indicator in all projects. Consultant will be charge to ensure collecting data by enumerators thus to correct and be completed for data entry process.

The evaluation-endline survey will be conducted during the global challenge of the pandemic of Covid-19, therefore the data collection should follow the Covid-19 mitigation protocol. The safety and security of the team members and the beneficiaries involved in this endline study will be priority.  The team members should follow the precaution and mitigation actions of the Covid-19, as well as equip the team members as well as the beneficiaries with the Personal Protective Equipment (mask, hand sanitizers). 

VI. External Consultant Deliverables:

1.       Survey proposal (and including the analysis plan

2.       Finalized survey questionnaire for quantitative and qualitative

3.       Raw data sets in SPSS and/or Excel including code book (quantitative and qualitative), transcripts of qualitative data for future used by CWS/AfP-ANCP. The data sets should be in appropriate format (SPSS, Excel and Word) and should be submit together with the final evaluation

4.       Sampling weights used in data analysis

5.       Presentation of initial findings to CWS team after field activities have been conducted

6.       Draft Report with preliminary survey results for quantitative and qualitative (both in English and Bahasa)

7.       Material of presentation of findings (Both in English and Bahasa) summarizing the key findings from the evaluation submitted together with the final evaluation report.

8.       Final report (both in English and Bahasa)

9.       A short, crisp summary on findings (not more than 2-3 pages)

10.   2 case studies and lesson learnt

VII. Timeframe :

The evaluation-endline survey expected to be conducted in the end of July and expected to be completed by mid of August 2020, and then the reviewed report should finalized the latest the last week of August 2020 .

 VIII. Budget

Budget will include all cost such as transportation, accommodation, professional fee, etc. The price offered is gross income. Income tax will be deducted from the price offered.

I.           Ethical and child protection consideration

The consultant team must follow Ethical Principles for involving human subjects in a research and obtain written/ verbal consent from the human subjects. Permission from elder must be sought if the children under 18 years are involved as subjects. Signed informed consent of each child and his/ her parents need to take after explaining purpose of the study and its usage.

In addition, CWS has a Child Safeguarding and Child Protection Policy, Code of Conduct, and Anti Human Trafficking Policy to minimize the risk of harm to children who come into contact with those employed by, or who are associated with, CWS. Therefore, the appointed consultant to this assignment must comply to these policies.

II.         Skills and qualifications of consultant

1.       Possess equal composition of qualified academic background, knowledge, experience and capacity to manage evaluation-endline survey

2.       Demonstrate expertise on climate change adaptation, disaster risk management/disaster risk reduction issues and disaster response

3.       Track record in developing and conducting various type of evaluation including qualitative and quantitative data collection

4.       Experience in managing and coordinating evaluation/research exercises, delivering agreed outputs on time and on budget

5.       Experience in data collection and analysis using participatory methodologies

6.       Previous experience working with government and communities using participatory approaches

7.       Ability to work with communities in relevant local languages (in this case Tana Toraja would be an advantage)

8.       Strong quantitative data entry and analysis skills and previous experience using statistical analysis software

9.       Ability to respond to comments and questions in a timely, appropriate manner

10.   Ability to write high quality, clear, concise reports in Bahasa Indonesia. 

III.       Procedure for expression of Interest

First Phase: Interested consultant should submit an Expression of Interest to CWS Indonesia to: operation@cwsindonesia.or.id the latest on 15 July 2020 before 11.00 am Jakarta time, by enclosing the following required documents:

1.     Organizational Profile (for institutional consultant) or a CV (for individual consultant).

2.     A proposal containing two parts:

·         Technical Proposal comprising the description of proposed activities, methodology (sampling design, data collection technique), and implementation plan which includes study schedule and timeline for data analysis. The technical proposal should demonstrate understanding of study ethic, qualification of study team members and their CVs, as well as their roles in the study. The consultant should also describe her/his experience in conducting similar survey, and financial and technical capacity.

·         Budget Proposal comprising details of budget plan such as consultant and team’s fees, transportation, stationeries and other survey necessities.

Second Phase: Based on received proposals, CWS will shortlist candidates and invite them to present their proposals. CWS will afterwards proceed with selecting and appointing a consultant, and produce a working contract with the selected consultant.