Church
World Service (CWS) has worked in humanitarian and development
initiatives in Indonesia for more than 40 years under the MoU with the
Ministry of Social Affairs of the Republic Indonesia. CWS currently
engages in several humanitarian sectors include disaster risk reduction,
health and nutrition and refugee and migrant protection. This endline
survey will focus on the DRM program in CWS; “The Strengthening
Preparedness for Effective Response Disaster (SOLIDARITAS)” project, a
2-year project funded by the Department of Foreign Affairs and Trade
(DFAT). The project aims at increasing the awareness and knowledge, and
improving access to information, thereby building capacity and strength
in district level disaster management agencies (Badan Penanggulangan
Bencana Daerah, or, BPBD) as well as at the community level. The project
is implemented in two villages in Toraja Utara district and two
villages in the Timor Tengah Selatan (TTS) district, where all of them
are in the eastern part of Indonesia.
A. Description of the Assignment
SOLIDARITAS
that began in May 2016 has already conducted baseline reports before
the project started on the total 234 respondents in 4 villages in TTS
and Toraja Utara. We used different methodology and approach for
assessing of project context in beginning as refer to the project’s
logical frame approach (LFA), and also including context analysis and
BPBD’s capacity as the main partner. As the project is approaching the
end of the project in May 2018. In order to assess the project progress
against the set indicators, also the need for CWS to look back and
reflect its service approach and result particularly at target group and
partner level, based on this rationale; CWS will conduct endline
survey. It is planned to be conducted on the same sample to determine
the effect of SOLIDARITAS on beneficiaries that will be guided by the
final evaluation questions as delineated in Methodology section.
To
support this work, an M&E framework and Indicator Tracking Table
(ITT) that contained set of indicators of project achievement have been
designed. These tools shall function s one of the references to guide
the implementation of the endline survey.
Objective of the Endline Survey:
The general objective of the endline survey is to measure changes by assessing the project progress against the set outcome indicators over the life of SOLIDARITS project that impacted by project implementation. Also to identify constraints, gaps and lesson learned.
The general objective of the endline survey is to measure changes by assessing the project progress against the set outcome indicators over the life of SOLIDARITS project that impacted by project implementation. Also to identify constraints, gaps and lesson learned.
Specific Objectives:
• To measure to what extent the SOLIDARITAS has contributed to reduce the impact of natural disasters on communities in Toraja Utara district in South Sulawesi province and Timor Tengah Selatan district in Nusa Tenggara Timur province.
• To measure SOLIDARITAS’s degree of implementation, efficiency and quality delivered on outputs and outcomes, against what was originally foreseen in the project document, M&E frameworks, ITT, etc.
• To identify and document substantive lessons learnt and good practices on the thematic areas as delineated in outputs and crosscutting issues: gender, child protection, disability inclusion and sustainability.
• To measure to what extent the SOLIDARITAS has contributed to reduce the impact of natural disasters on communities in Toraja Utara district in South Sulawesi province and Timor Tengah Selatan district in Nusa Tenggara Timur province.
• To measure SOLIDARITAS’s degree of implementation, efficiency and quality delivered on outputs and outcomes, against what was originally foreseen in the project document, M&E frameworks, ITT, etc.
• To identify and document substantive lessons learnt and good practices on the thematic areas as delineated in outputs and crosscutting issues: gender, child protection, disability inclusion and sustainability.
B. Project Description
Funded by Australian Department of Foreign Affairs (DFAT), CWS in Indonesia is implementing the Strengthening Preparedness for Effective Response to Disaster project (SOLIDARITAS) that is designed to improve the disaster management system in four villages in two districts – Toraja Utara (Torut) and Timor Tengah Selatan (TTS) in two provinces, South Sulawesi and NTT; and link these to provincial and national DRM policy and technical support initiatives. In line with GOI priorities, the project is designed to increase awareness and knowledge, and to improve access to information, thereby building capacity and strength in district level disaster management agencies (Badan Penanggulangan Bencana Daerah/BPBD). SOLIDARITAS is implemented in a 24-month period.
Funded by Australian Department of Foreign Affairs (DFAT), CWS in Indonesia is implementing the Strengthening Preparedness for Effective Response to Disaster project (SOLIDARITAS) that is designed to improve the disaster management system in four villages in two districts – Toraja Utara (Torut) and Timor Tengah Selatan (TTS) in two provinces, South Sulawesi and NTT; and link these to provincial and national DRM policy and technical support initiatives. In line with GOI priorities, the project is designed to increase awareness and knowledge, and to improve access to information, thereby building capacity and strength in district level disaster management agencies (Badan Penanggulangan Bencana Daerah/BPBD). SOLIDARITAS is implemented in a 24-month period.
Project
Goal:to reduce the impact of natural disasters on communities in Toraja
Utara district in South Sulawesi province and Timor Tengah Selatan
district in Nusa Tenggara Timur province.
SOLIDARITAS focuses on 3 outcomes that linked to each other as of the following:
1. Community capacity to assess climate vulnerability and implement community-based adaptation strategies is enhanced.
2. Community, government and civil society development planning systems are modified to support adaptation planning and strategies.
3. Successful community-based strategies for adaptation are adopted, adapted and used in other vulnerable communities.
1. Community capacity to assess climate vulnerability and implement community-based adaptation strategies is enhanced.
2. Community, government and civil society development planning systems are modified to support adaptation planning and strategies.
3. Successful community-based strategies for adaptation are adopted, adapted and used in other vulnerable communities.
In
implementing the project toward meeting these outcomes, CWS is
partnering with BPBD in each district as well as local partners (Gerbang
Mas in TTS and YayasanInanta in Toraja Utara). Each partner
organization has different contribution to achieve each outcome area and
works in different number location (district and village level).
The envisaged outputs (result) of the project are:
1. Establish commitment with local government, stakeholders, local partner and community
2. Community-Based DRM measures are implemented based on HVCA and risk mapping
3. DESTANA (Disaster Resilient village) Program in 4 target villages is established
4. Village disaster management plan, contingency plan as well action plan are developed, tested and reviewed
5. BPBD in 2 Districts has Disaster Management Plan, Contingency Plan and Action Plan
6. Established community-based early warning system (EWS) in 4 villages
7. DRM Forum in each targeted village and district is established and functioning
8. Communities, local government and its related stakeholders have received information on mainstreaming DRM
9. Establishment of Disaster Risk Management Team at community level
10. Improved knowledge of BPBD members and related stakeholders on disaster emergency response and incident command system
11. Village contingency plan is tested and reviewed
12. District contingency plan is tested and reviewed
13. Improved planning, preparedness and response activities during emergency through the operational of InaSAFE software.
14. Disaster information system is established and functioning in 2 districts
15. Early warning system is established and functioning in 2 districts
16. Project learning documentation is available
1. Establish commitment with local government, stakeholders, local partner and community
2. Community-Based DRM measures are implemented based on HVCA and risk mapping
3. DESTANA (Disaster Resilient village) Program in 4 target villages is established
4. Village disaster management plan, contingency plan as well action plan are developed, tested and reviewed
5. BPBD in 2 Districts has Disaster Management Plan, Contingency Plan and Action Plan
6. Established community-based early warning system (EWS) in 4 villages
7. DRM Forum in each targeted village and district is established and functioning
8. Communities, local government and its related stakeholders have received information on mainstreaming DRM
9. Establishment of Disaster Risk Management Team at community level
10. Improved knowledge of BPBD members and related stakeholders on disaster emergency response and incident command system
11. Village contingency plan is tested and reviewed
12. District contingency plan is tested and reviewed
13. Improved planning, preparedness and response activities during emergency through the operational of InaSAFE software.
14. Disaster information system is established and functioning in 2 districts
15. Early warning system is established and functioning in 2 districts
16. Project learning documentation is available
C. Methodology
In general, the final evaluation will have to cover two aspects in terms of: (a) Project achievement (result) and (b) project management. Both of these aspects will have to be assessed through the following evaluation guiding questions:
In general, the final evaluation will have to cover two aspects in terms of: (a) Project achievement (result) and (b) project management. Both of these aspects will have to be assessed through the following evaluation guiding questions:
Relevance and appropriateness
• Do the actions undertaken appropriate in the context of the needs and target of community and the context of the situation?
• What was the quality of the program’ content/design and how well was it implemented?
• To what extent do community, cadres and other village stakeholders are functioning and actively participating in project activities?
• What internal and external factors that have influenced the ability of target groups, CWS and its partner to meet projected targets? What were there strengthens, weakness, opportunities and threats that made the difference between successful and disappointing implementation and outcomes?
• Do the actions undertaken appropriate in the context of the needs and target of community and the context of the situation?
• What was the quality of the program’ content/design and how well was it implemented?
• To what extent do community, cadres and other village stakeholders are functioning and actively participating in project activities?
• What internal and external factors that have influenced the ability of target groups, CWS and its partner to meet projected targets? What were there strengthens, weakness, opportunities and threats that made the difference between successful and disappointing implementation and outcomes?
Effectiveness on the outcome level
• To what extent the project contributes to 3 objectives of the project?
• How is the project’s effect on a wider number of targeted groups?
• How valuable were the outcomes to targeted groups?
• How have the planned activities achieved, have they completed as planned? Has the project reached the expected number of target groups?
• Were there unexpected results of the project?
• To what extent the project contributes to 3 objectives of the project?
• How is the project’s effect on a wider number of targeted groups?
• How valuable were the outcomes to targeted groups?
• How have the planned activities achieved, have they completed as planned? Has the project reached the expected number of target groups?
• Were there unexpected results of the project?
Sustainability
• How strong is the program’s sustainability? Can it survive/grow in the future with limited additional resources? What program’s components that was likely to survive/grow and what program’s component that was likely not to survive/grow?
• Is there any stakeholders who would ensure the follow up of implemented activities?
• Had the program’s design taken into consideration sustainability issue and how well was the program’s implementation prepared and supported partner and other stakeholders?
• How strong is the program’s sustainability? Can it survive/grow in the future with limited additional resources? What program’s components that was likely to survive/grow and what program’s component that was likely not to survive/grow?
• Is there any stakeholders who would ensure the follow up of implemented activities?
• Had the program’s design taken into consideration sustainability issue and how well was the program’s implementation prepared and supported partner and other stakeholders?
Efficiency
• Was the program worth implementing? Did the value of the outcomes outweigh the value of the resources used to obtain them?
• Assess whether the implementation is timely and acknowledge reasons for delays. Whether the project’s activities in line with the schedule of activities as defined in the project proposal?
• Was the program worth implementing? Did the value of the outcomes outweigh the value of the resources used to obtain them?
• Assess whether the implementation is timely and acknowledge reasons for delays. Whether the project’s activities in line with the schedule of activities as defined in the project proposal?
Partnership
• How well the parties work together to meet the objectives of the partnership? What were each partner’s (including CWS) roles and involvement in this partnership? Do organizations have a clear understanding of what each one can contribute to the partnership?
• Whether the partnership is successful in meeting its objectives and delivering the desired outcomes?
• Whether it adds value – in that what the partnership achieves is greater that could be achieved if the parties acted alone?
• How well the parties work together to meet the objectives of the partnership? What were each partner’s (including CWS) roles and involvement in this partnership? Do organizations have a clear understanding of what each one can contribute to the partnership?
• Whether the partnership is successful in meeting its objectives and delivering the desired outcomes?
• Whether it adds value – in that what the partnership achieves is greater that could be achieved if the parties acted alone?
Gender mainstreaming
• Level of access, participation and control of women and men in the project is assessed?
• Level of access, participation and control of women and men in the project is assessed?
The evaluation will involve the perspective of both quantitative and qualitative methods to in order to draw out the findings.
This evaluation will consist of 2 big components, namely
a. End-line survey – will focus on quantitative data to answer to what extend the change of the indicators in the program logical framework.
b. External evaluation – will focus on qualitative data to answer why and how of the evaluation’s questions.
a. End-line survey – will focus on quantitative data to answer to what extend the change of the indicators in the program logical framework.
b. External evaluation – will focus on qualitative data to answer why and how of the evaluation’s questions.
D. Scope of Work
The external consultantisexpected to develop the detailed external evaluation plan and instruments prior to the field work. The external evaluation will include:
1. Proposed work plan clearly outlining the process of the survey.
2. Desk Review: review all relevant project documents (including but not limited to project proposals, budget, log frame, reports narratives well as financial reports, survey reports, mid-term evaluation report, and training TORs, pre and post-test). Publicly available government or other agencies documents that relevant to this program components (such as water, sanitation and hygiene; home gardening; health and nutrition; gender; ECCD) will be also reviewed whenever necessary.
3. Management and Staff Meeting: meeting with the project manager, field staffs and CWS technical staffs will be conducted prior to and at the end of the field visit. Any additional meetings to discuss relevant survey process may be conducted if needs be.
4. Field visit: core consultant team will visit and consult with project stakeholders including BPBD, OPD, community at four target villages, as well as project staff members in the field operation areas to understand project progress and identify lesson learnt.
5. Finalize and share the survey methodology including data collection methods; proposed structured questionnaires;analysis framework; and piloting the survey methodology testing,with CWS before conducting the data collection in the field.
6. Finalize data collection tools (questionnaire, checklist) and guidelines for the end-line survey. The consultant team will be responsible for pre-test and finalization of tools and technique for the survey and analysis. The endline survey will use the baseline data.
7. Organize the training session for the enumerators and followed by the field practice.
8. Collect data from the respondents as per sampling list, using prescribed tools and techniques.
9. Prepare and finalize data analysis and tabulation plan and generate output tables accordingly; and lay out the findings and the data analysisper village per district.
10. Provide soft copy of cleaned data and initial finding summary.
11. Submit draft report, prior to submission of the final report. CWS will provide review of the draft report and provide necessary feedback. The consultant team will then submit a final report addressing the feedback received from CWS.
The external consultantisexpected to develop the detailed external evaluation plan and instruments prior to the field work. The external evaluation will include:
1. Proposed work plan clearly outlining the process of the survey.
2. Desk Review: review all relevant project documents (including but not limited to project proposals, budget, log frame, reports narratives well as financial reports, survey reports, mid-term evaluation report, and training TORs, pre and post-test). Publicly available government or other agencies documents that relevant to this program components (such as water, sanitation and hygiene; home gardening; health and nutrition; gender; ECCD) will be also reviewed whenever necessary.
3. Management and Staff Meeting: meeting with the project manager, field staffs and CWS technical staffs will be conducted prior to and at the end of the field visit. Any additional meetings to discuss relevant survey process may be conducted if needs be.
4. Field visit: core consultant team will visit and consult with project stakeholders including BPBD, OPD, community at four target villages, as well as project staff members in the field operation areas to understand project progress and identify lesson learnt.
5. Finalize and share the survey methodology including data collection methods; proposed structured questionnaires;analysis framework; and piloting the survey methodology testing,with CWS before conducting the data collection in the field.
6. Finalize data collection tools (questionnaire, checklist) and guidelines for the end-line survey. The consultant team will be responsible for pre-test and finalization of tools and technique for the survey and analysis. The endline survey will use the baseline data.
7. Organize the training session for the enumerators and followed by the field practice.
8. Collect data from the respondents as per sampling list, using prescribed tools and techniques.
9. Prepare and finalize data analysis and tabulation plan and generate output tables accordingly; and lay out the findings and the data analysisper village per district.
10. Provide soft copy of cleaned data and initial finding summary.
11. Submit draft report, prior to submission of the final report. CWS will provide review of the draft report and provide necessary feedback. The consultant team will then submit a final report addressing the feedback received from CWS.
E. Expected Outputs
Literature review 1 week
Meeting with relevant stakeholders 1 week simultaneously with survey
Finalizing methodology and data collection tools 1 week simultaneously with literature review
Enumerators’ training and field test 2 days
Conducting survey in TTS and Toraja Utara 10 days
Data Entry compilation 5 days
Data analysis and draft report writing 6 days
Finalizing end survey report 1 week
Literature review 1 week
Meeting with relevant stakeholders 1 week simultaneously with survey
Finalizing methodology and data collection tools 1 week simultaneously with literature review
Enumerators’ training and field test 2 days
Conducting survey in TTS and Toraja Utara 10 days
Data Entry compilation 5 days
Data analysis and draft report writing 6 days
Finalizing end survey report 1 week
Data
collection tools based on indicators fixed in the baseline but may
include additional indicators as deemed necessary for the purpose of
endline survey and be finalized together with CWS Project contact person
(MEAL Specialist).
F. Institutional Arrangement
The consultant team will work under the supervision of CWS MEAL Specialist and DRM Specialist. The consultant will be required to share drafts of the proposed work plan, deliverables, and coordinate the progress of the survey with either the CWS MEAL Specialist; or the DRM Specialist.
The consultant team will work under the supervision of CWS MEAL Specialist and DRM Specialist. The consultant will be required to share drafts of the proposed work plan, deliverables, and coordinate the progress of the survey with either the CWS MEAL Specialist; or the DRM Specialist.
G. Duration of the Work and Duty Station
Duration of the assignment will be maximum 1,5 months, beginning in April 2018.
Duration of the assignment will be maximum 1,5 months, beginning in April 2018.
H. Consultant Deliverables
1. The consultant team will submit the inception report including the agreed action plan to CWS within three working days of signing the agreement of this assignment.
2. The required number of qualified enumerators will be hired by the consultant team and trained on study subject, methodology, data collection and tools and techniques, quality control and data management
3. A dataset of endline survey and final evaluation will be developed and both furnished and non-furnished data set will be submitted to CWS.
4. Draft Report with preliminary survey results for quantitative and qualitative produced by no later than 8 May 2018.
5. The final report of the endline/evaluation will be submitted to CWS both in hard and soft copy (five copies) by the consultant by 15 May 2018.
1. The consultant team will submit the inception report including the agreed action plan to CWS within three working days of signing the agreement of this assignment.
2. The required number of qualified enumerators will be hired by the consultant team and trained on study subject, methodology, data collection and tools and techniques, quality control and data management
3. A dataset of endline survey and final evaluation will be developed and both furnished and non-furnished data set will be submitted to CWS.
4. Draft Report with preliminary survey results for quantitative and qualitative produced by no later than 8 May 2018.
5. The final report of the endline/evaluation will be submitted to CWS both in hard and soft copy (five copies) by the consultant by 15 May 2018.
The final report should include detailed information on the following:
a) Cover Page
b) Table of content
c) Acknowledgements
d) Glossary/Acronyms
e) Executive Summary
f) Introduction
a. Endlinesurvey background
b. Objectives
c. Literature review
g) Methodology
d. Qualitative
e. Quantitative
f. Data Analysis Plan
h) Limitations
i) Findings
The findings shall be divided per village per district to have a clear idea of the different impacts the project has brought.
j) Discussion
g. Analysis (including non-response, variance estimation technique used and low complex sample design accounted for) table, chart, and narrative analysis
k) Conclusion, Lesson Learnt and Recommendations
h. Summary of findings
i. Conclusion
j. Lesson learnt
k. Recommendations
l) Appendixes
Following lists must be given at the beginning:
1. Table of contents (automatically generated)
2. List of Figures
3. List of Tables
a) Cover Page
b) Table of content
c) Acknowledgements
d) Glossary/Acronyms
e) Executive Summary
f) Introduction
a. Endlinesurvey background
b. Objectives
c. Literature review
g) Methodology
d. Qualitative
e. Quantitative
f. Data Analysis Plan
h) Limitations
i) Findings
The findings shall be divided per village per district to have a clear idea of the different impacts the project has brought.
j) Discussion
g. Analysis (including non-response, variance estimation technique used and low complex sample design accounted for) table, chart, and narrative analysis
k) Conclusion, Lesson Learnt and Recommendations
h. Summary of findings
i. Conclusion
j. Lesson learnt
k. Recommendations
l) Appendixes
Following lists must be given at the beginning:
1. Table of contents (automatically generated)
2. List of Figures
3. List of Tables
I. Budget
The
budget shall include all the expenses related to the endline/evaluation
cost for example professional fee, travel, accommodations, enumerators,
FGD’s, communications, data collections, interviews and etc. of the
consultants and the team to produce an evaluation report.
J. Skills and Qualifications of Consultant
1. Demonstrate expertise on disaster risk management issues and disaster response.
2. Track record in developing and conducting various type of evaluation including qualitative and quantitative data collection.
3. Experience in managing and coordinating evaluation/research exercises, delivering agreed outputs on time and on budget.
4. Experience in data collection and analysis using participatory methodologies.
5. Previous experience working with government and communities using participatory approaches.
6. Ability to work with communities in relevant local languages (in this case Timor Tengah Selatan and Toraja Utara would be an advantage).
7. Strong quantitative data entry and analytical skills and previous experience using statistical analysis software.
8. Ability to respond to comments and questions in a timely, appropriate manner.
9. Ability to write high quality, clear, concise reports in English and Bahasa Indonesia.
1. Demonstrate expertise on disaster risk management issues and disaster response.
2. Track record in developing and conducting various type of evaluation including qualitative and quantitative data collection.
3. Experience in managing and coordinating evaluation/research exercises, delivering agreed outputs on time and on budget.
4. Experience in data collection and analysis using participatory methodologies.
5. Previous experience working with government and communities using participatory approaches.
6. Ability to work with communities in relevant local languages (in this case Timor Tengah Selatan and Toraja Utara would be an advantage).
7. Strong quantitative data entry and analytical skills and previous experience using statistical analysis software.
8. Ability to respond to comments and questions in a timely, appropriate manner.
9. Ability to write high quality, clear, concise reports in English and Bahasa Indonesia.
K. Ethical and Child Protection Consideration
The consultant team must follow Ethical Principles for involving human subjects in a research and obtain written/ verbal consent from the human subjects. Permission from elder must be sought if the children under 18 years are involved as subjects. Signed informed consent of each child and his/ her parents need to take after explaining purpose of the study and its usage.
The consultant team must follow Ethical Principles for involving human subjects in a research and obtain written/ verbal consent from the human subjects. Permission from elder must be sought if the children under 18 years are involved as subjects. Signed informed consent of each child and his/ her parents need to take after explaining purpose of the study and its usage.
In
addition, CWS has a Child Safeguarding and Child Protection Policy,
Code of Conduct, and Anti Human Trafficking Policy to minimize the risk
of harm to children who come into contact with those employed by, or who
are associated with, CWS. Therefore, the appointed consultant to this
assignment must comply to these policies.
L. Procedure for Expression of Interest
First Phase: Interested consultant should submit an Expression of Interest to CWS Indonesia to: operation@cwsindonesia.or.id the latest on 30 March 2018 by enclosing the following required documents:
1. Organizational Profile (for institutional consultant) or a CV (for individual consultant).
2. A proposal containing two parts:
• Technical Proposal comprising the description of proposed activities, methodology(sampling design, data collection technique), and implementation plan which includes study schedule and timeline for data analysis. The technical proposal should demonstrate understanding of study ethic, qualification of study team members and their CVs, as well as their roles in the study. The consultant should also describe her/his experience in conducting similar survey, and financial and technical capacity.
• Budget Proposal comprising details of budget plan such as consultant and team’s fees, transportation, stationeries and other survey necessities.
First Phase: Interested consultant should submit an Expression of Interest to CWS Indonesia to: operation@cwsindonesia.or.id the latest on 30 March 2018 by enclosing the following required documents:
1. Organizational Profile (for institutional consultant) or a CV (for individual consultant).
2. A proposal containing two parts:
• Technical Proposal comprising the description of proposed activities, methodology(sampling design, data collection technique), and implementation plan which includes study schedule and timeline for data analysis. The technical proposal should demonstrate understanding of study ethic, qualification of study team members and their CVs, as well as their roles in the study. The consultant should also describe her/his experience in conducting similar survey, and financial and technical capacity.
• Budget Proposal comprising details of budget plan such as consultant and team’s fees, transportation, stationeries and other survey necessities.
Second Phase:
Based on received proposals, CWS will shortlist candidates and invite
them to present their proposals. CWS will afterwards proceed with
selecting and appointing a consultant, and produce a working contract
with the selected consultant.
Should you have any question related to this respect, please send an email to operation@cwsindonesia.or.id
Only shortlisted consultant will be contacted for recruitment.
Thank you very much for your kind attention & best cooperation.
Operation Unit CWS Indonesia.
No comments:
Post a Comment