TERM OF REFERENCE FINAL EVALUATION OF CMDRR PROJECT CARITAS KEUSKUPAN SIBOLGA (CKS) - NIAS
1. PROJECT BACKGROUND
In the year 2007, CKS began with a pilot project of Community Managed Disaster Risk Reduction (CMDRR) covering 3 communities. Positive experiences which CKS gained through the implementation of a 18-month pilot project; subsequently extended to a 2nd phase of the project expanding the process to another 14 communities through developing 3-year projectwith a period of 1st October 2008 – 31st October 2011. Altogether, the CMDRR project covers 17 communities. Among 17 communities addressing by the project 14 are located in Nias and 3 are in Tapanuli Tengah; two of the 18 Regencies of North Sumatra province of Indonesia. Among 17 communities 16 communities represents Christianity as majority population while one represents 50% Christian and 50% Muslim population. Communities of Nias and Tapanuli Tengah are frequently exposed with the natural hazards. Climate change and its exposure of sea water level rise, increase of temperature of ocean floor, changes of sea-web actions accentuated by other factors such as rapid soil erosion, sedimentation of river and estuaries
altogether increasing the frequency of hazard occurrence in the area.
Major natural hazards affecting people are floods, landslides, land erosions. Target population addressing by the project is extremely vulnerable. Lack of food security, rudimentary physical communication infrastructure and lack of access to market, inadequate employment and income, illiteracy, low health water sanitation and nutrition status, gender discrimination, top down governance, degradation of forests and other natural resources, are major causes of vulnerability facing by the communities of Nias and Tapanuli Tengah. Another critical vulnerability reason is Nias and Tapanuli Tengah both have separate language than Bahasa Indonesia keeping its population away from accessing education, media and news as the higher education systems and media are dominant by the Bahasa language. Government support to disaster risk reduction and other related development activities are extremely inadequate. After the Tsunami 2004 there were several international organizations and NGOs extended their hands of cooperation to the communities for the relief and rehabilitation and now most of them are departed after completion of their mission. Linking DRR and development CKS’s CMDRR project is designed to attain following objectives:
* To build a total of 17 disaster resilient communities by building and facilitating community organizations in participatory disaster risk assessment, community DRR action planning, monitoring and evaluation,through integration of needed sectors, like natural resource conservation and management, primary health care, livelihood promotion, self-help groups, employment and income generation towards vulnerability reduction, and human resiliency building.
* To build capacities of 7 parishes as ‘facilitators’ of CMDRR process through accompaniment and training action reflection approach; and project implementation-management support through provisioning of resources.
* To share CMDRR knowledge within Caritas Sibolga, parish organization, community organization, Caritas family networks & other relevantstakeholders through documentation and & dissemeintaion of practice generated learning
* To ensure enforcement or accurate implementation of favorable policy to disaster risk reduction.
Further, the project intended to:
* Include gender, indigenous scientific knowledge & good local governance, networking & advocacy, as cross cutting issues at all levels, starting from the community to parish level project, to Caritas Sibolga.
* Institutionalize participatory monitoring & evaluation at each of the levels (community, Parish, Caritas Sibolga) to achieve effectiveness and efficiency of the project.
2. PURPOSE AND OBJECTIVE OF FINAL PROJECT EVALUATION
The main purpose of the final project evaluation isto examine whether the project is in track to reach its intended objectives, finding out gaps if any, draw lessons, suggest recommendation for better implementation.The specific objectives are:
To evaluate the relevance of project intervention in term of community needs and local culture.
To examine the implementation standard in terms of quantity, quality, target and achievement.
To examine the effectiveness of strategy applied in terms of applicability and generation of intended effects.
To see the efficiency in relation to input provided and output created; in term of project management and partnership with parishes.
To see the impact that the project has created so far
To examine sustainability potential.
3. METHODOLOGY
Simultaneity of review and learning:The fundamental approach of final evaluation of the project should be participatory in nature by which staff of the project team and other programs of CKS have continuous learning. However, the neutrality and objectivity of the final-study will be controlled by the external evaluator as well as involving staff of senior management of CKS.
Formation of a multidisciplinary evaluation team:For conducting the evaluation, under the leadership of the external evaluator, a multidisciplinary team should be formed composed of the external evaluator, senior staff of the CKS management and senior staff of CMDRR project.
Development of design:Grounded on the objectives, the evaluation should be proceeding through developing a framework by the team which will be facilitated by the external evaluator. Similarly the data tools should be presented and validated through the team review.
Sampling:For the selection of sample, both purposive and random method will be applied. At the level of community, among 17 communities covered by the project 30 % from the total communities will be selected random basis. Considering the availability, communication feasibility and time limit, purposive selection methodology will be applied to select other stakeholders included project staff, and parish priests
Data generation and gathering:In data generation and gathering, an extensive review of documents should be done by the external evaluator.Primary data should be generated through application of participatory methods and instruments. Several participatory tools should be applied to generate primary data through face to face interaction with stakeholders. Tools applied for primary data generation included:
· Participatory document distillation session with project team
· Key Informant Interview
· Informal discussions and dialogue with community members
· Focused Group Discussion (FGD)
· Separate PRA sessions with female SHGs
· Direct observation of work samples and outcome
· Visit and direct observation of villages and mitigation infrastructure developed at communities
· Consolidation of lessons learnt by the review team.
Data consolidation, analysis & findings development:Evaluator team engaged in data generation should do consolidation of data generated through various sessions. After consolidation of primary data, the external evaluator develop findings base on final evaluation objectives. Major findings should be summarized by the external evaluator.
Feedback generation, validation and articulation:An intermediary presentation of primary findings should be done in which CMDRR project team and senior management staff participated. Post presentation question-clarification should be conducted and feedback will be solicited. The next step is articulation of the feedback received, preparation of final report and submission of final report to CKS’s CMDRR project team and management.
4. EXPECTED OUTPUT & OUTCOME
Outputs
- Further details to draft ToR for the project of CMDRR evaluation by external evaluator.
- Evaluation framework, methodology, tools applied for data generation (Interviews, Focus Group Discussion, Questionnaire…)
- List of documents studied
- List of respondents in communities involved in the study
- Program of primary data generation
- Timeline for survey activities
- Report with Executive Summary in Indonesian and English, recommendations regarding to relevance, implementation standard, partnership & management, effectiveness of input delivery, efficiency, impacts and sustainability of the CMDRR project.
Outcomes
- The Management of Caritas Sibolga, Parishes, and Donors obtain clear objective description of the situation and achievements in the project areas regarding to CMDRR project
- The Management of Caritas Sibolga understands challenges and opportunities and necessary improvements of the activities to achieve the envisaged targets and can take necessary steps towards sustainability before donor funding ends.
- The CMDRR project team can improve effectiveness and efficiency of the project implementation (improved utilization of budget, human resources, and relationship with stakeholders – parishes and communities)
- The CMDRR project team can obtain input and feedback regarding to project relevance, implementation standard, impact and sustainability of the project.
- The management of Caritas Sibolga and CMDRR team can obtain input and feedback regarding to the future of community organization sustainability in term of CKS accompaniment
- The management of Caritas Sibolga and CMDRR team can obtain input on the overall mechanism of soft fund implementation in supporting community initiated micro project
- The management of Caritas Sibolga and CMDRR team can obtain input on integration issue with other departments within Caritas Sibolga
4. TIME SCHEDULE (SUBJECT OF DISCUSSION)
The schedule of final evaluation will be conducted by the end of July 2011 in which final report submission by end of August 2011. Detailed schedule will be discussed together with CMDRR project team and senior staff from management at CKS office in Gunungsitoli, Nias
5. PROFILE AND QUALIFICATIONS
- Highly required: Experience and understanding of Community Managed Disaster Risk Reduction Project in remote project site both Nias and Tapanuli
- Highly required: Understanding on working within a Catholic church context
- Highly required: Experience at grass root community empowerment and development
- Highly required: Experience of evaluation with quantitative and participatory methods.
- Highly required: Willingness to work in an isolated environment with very basic living conditions, field visits will include travelling by motorbike and hiking
6. PROPOSAL SUBMISSION
For both independent and organizations who are interested please submit:
1. The external evaluation proposal
2. Organization/ independent profile
To Caritas Keuskupan Sibolga:
* frans.esensiator@gmail.com
* aktivitas.sarumaha@caritas.keuskupan-sibolga.org
With the proposal submission deadline: 30 April 2011.
Only shortlisted candidates will be contacted.
1. PROJECT BACKGROUND
In the year 2007, CKS began with a pilot project of Community Managed Disaster Risk Reduction (CMDRR) covering 3 communities. Positive experiences which CKS gained through the implementation of a 18-month pilot project; subsequently extended to a 2nd phase of the project expanding the process to another 14 communities through developing 3-year projectwith a period of 1st October 2008 – 31st October 2011. Altogether, the CMDRR project covers 17 communities. Among 17 communities addressing by the project 14 are located in Nias and 3 are in Tapanuli Tengah; two of the 18 Regencies of North Sumatra province of Indonesia. Among 17 communities 16 communities represents Christianity as majority population while one represents 50% Christian and 50% Muslim population. Communities of Nias and Tapanuli Tengah are frequently exposed with the natural hazards. Climate change and its exposure of sea water level rise, increase of temperature of ocean floor, changes of sea-web actions accentuated by other factors such as rapid soil erosion, sedimentation of river and estuaries
altogether increasing the frequency of hazard occurrence in the area.
Major natural hazards affecting people are floods, landslides, land erosions. Target population addressing by the project is extremely vulnerable. Lack of food security, rudimentary physical communication infrastructure and lack of access to market, inadequate employment and income, illiteracy, low health water sanitation and nutrition status, gender discrimination, top down governance, degradation of forests and other natural resources, are major causes of vulnerability facing by the communities of Nias and Tapanuli Tengah. Another critical vulnerability reason is Nias and Tapanuli Tengah both have separate language than Bahasa Indonesia keeping its population away from accessing education, media and news as the higher education systems and media are dominant by the Bahasa language. Government support to disaster risk reduction and other related development activities are extremely inadequate. After the Tsunami 2004 there were several international organizations and NGOs extended their hands of cooperation to the communities for the relief and rehabilitation and now most of them are departed after completion of their mission. Linking DRR and development CKS’s CMDRR project is designed to attain following objectives:
* To build a total of 17 disaster resilient communities by building and facilitating community organizations in participatory disaster risk assessment, community DRR action planning, monitoring and evaluation,through integration of needed sectors, like natural resource conservation and management, primary health care, livelihood promotion, self-help groups, employment and income generation towards vulnerability reduction, and human resiliency building.
* To build capacities of 7 parishes as ‘facilitators’ of CMDRR process through accompaniment and training action reflection approach; and project implementation-management support through provisioning of resources.
* To share CMDRR knowledge within Caritas Sibolga, parish organization, community organization, Caritas family networks & other relevantstakeholders through documentation and & dissemeintaion of practice generated learning
* To ensure enforcement or accurate implementation of favorable policy to disaster risk reduction.
Further, the project intended to:
* Include gender, indigenous scientific knowledge & good local governance, networking & advocacy, as cross cutting issues at all levels, starting from the community to parish level project, to Caritas Sibolga.
* Institutionalize participatory monitoring & evaluation at each of the levels (community, Parish, Caritas Sibolga) to achieve effectiveness and efficiency of the project.
2. PURPOSE AND OBJECTIVE OF FINAL PROJECT EVALUATION
The main purpose of the final project evaluation isto examine whether the project is in track to reach its intended objectives, finding out gaps if any, draw lessons, suggest recommendation for better implementation.The specific objectives are:
To evaluate the relevance of project intervention in term of community needs and local culture.
To examine the implementation standard in terms of quantity, quality, target and achievement.
To examine the effectiveness of strategy applied in terms of applicability and generation of intended effects.
To see the efficiency in relation to input provided and output created; in term of project management and partnership with parishes.
To see the impact that the project has created so far
To examine sustainability potential.
3. METHODOLOGY
Simultaneity of review and learning:The fundamental approach of final evaluation of the project should be participatory in nature by which staff of the project team and other programs of CKS have continuous learning. However, the neutrality and objectivity of the final-study will be controlled by the external evaluator as well as involving staff of senior management of CKS.
Formation of a multidisciplinary evaluation team:For conducting the evaluation, under the leadership of the external evaluator, a multidisciplinary team should be formed composed of the external evaluator, senior staff of the CKS management and senior staff of CMDRR project.
Development of design:Grounded on the objectives, the evaluation should be proceeding through developing a framework by the team which will be facilitated by the external evaluator. Similarly the data tools should be presented and validated through the team review.
Sampling:For the selection of sample, both purposive and random method will be applied. At the level of community, among 17 communities covered by the project 30 % from the total communities will be selected random basis. Considering the availability, communication feasibility and time limit, purposive selection methodology will be applied to select other stakeholders included project staff, and parish priests
Data generation and gathering:In data generation and gathering, an extensive review of documents should be done by the external evaluator.Primary data should be generated through application of participatory methods and instruments. Several participatory tools should be applied to generate primary data through face to face interaction with stakeholders. Tools applied for primary data generation included:
· Participatory document distillation session with project team
· Key Informant Interview
· Informal discussions and dialogue with community members
· Focused Group Discussion (FGD)
· Separate PRA sessions with female SHGs
· Direct observation of work samples and outcome
· Visit and direct observation of villages and mitigation infrastructure developed at communities
· Consolidation of lessons learnt by the review team.
Data consolidation, analysis & findings development:Evaluator team engaged in data generation should do consolidation of data generated through various sessions. After consolidation of primary data, the external evaluator develop findings base on final evaluation objectives. Major findings should be summarized by the external evaluator.
Feedback generation, validation and articulation:An intermediary presentation of primary findings should be done in which CMDRR project team and senior management staff participated. Post presentation question-clarification should be conducted and feedback will be solicited. The next step is articulation of the feedback received, preparation of final report and submission of final report to CKS’s CMDRR project team and management.
4. EXPECTED OUTPUT & OUTCOME
Outputs
- Further details to draft ToR for the project of CMDRR evaluation by external evaluator.
- Evaluation framework, methodology, tools applied for data generation (Interviews, Focus Group Discussion, Questionnaire…)
- List of documents studied
- List of respondents in communities involved in the study
- Program of primary data generation
- Timeline for survey activities
- Report with Executive Summary in Indonesian and English, recommendations regarding to relevance, implementation standard, partnership & management, effectiveness of input delivery, efficiency, impacts and sustainability of the CMDRR project.
Outcomes
- The Management of Caritas Sibolga, Parishes, and Donors obtain clear objective description of the situation and achievements in the project areas regarding to CMDRR project
- The Management of Caritas Sibolga understands challenges and opportunities and necessary improvements of the activities to achieve the envisaged targets and can take necessary steps towards sustainability before donor funding ends.
- The CMDRR project team can improve effectiveness and efficiency of the project implementation (improved utilization of budget, human resources, and relationship with stakeholders – parishes and communities)
- The CMDRR project team can obtain input and feedback regarding to project relevance, implementation standard, impact and sustainability of the project.
- The management of Caritas Sibolga and CMDRR team can obtain input and feedback regarding to the future of community organization sustainability in term of CKS accompaniment
- The management of Caritas Sibolga and CMDRR team can obtain input on the overall mechanism of soft fund implementation in supporting community initiated micro project
- The management of Caritas Sibolga and CMDRR team can obtain input on integration issue with other departments within Caritas Sibolga
4. TIME SCHEDULE (SUBJECT OF DISCUSSION)
The schedule of final evaluation will be conducted by the end of July 2011 in which final report submission by end of August 2011. Detailed schedule will be discussed together with CMDRR project team and senior staff from management at CKS office in Gunungsitoli, Nias
5. PROFILE AND QUALIFICATIONS
- Highly required: Experience and understanding of Community Managed Disaster Risk Reduction Project in remote project site both Nias and Tapanuli
- Highly required: Understanding on working within a Catholic church context
- Highly required: Experience at grass root community empowerment and development
- Highly required: Experience of evaluation with quantitative and participatory methods.
- Highly required: Willingness to work in an isolated environment with very basic living conditions, field visits will include travelling by motorbike and hiking
6. PROPOSAL SUBMISSION
For both independent and organizations who are interested please submit:
1. The external evaluation proposal
2. Organization/ independent profile
To Caritas Keuskupan Sibolga:
* frans.esensiator@gmail.com
* aktivitas.sarumaha@caritas.keuskupan-sibolga.org
With the proposal submission deadline: 30 April 2011.
Only shortlisted candidates will be contacted.
No comments:
Post a Comment