Evaluation of the
Shelter Projects of Caritas Germany in Central Sulawesi and Lombok
1. Project Information
Project Evaluation Period: 01.10.2019 – 30.11.2019
| |
|
Project
Title:
|
“Central Sulawesi Earthquake and
Tsunami Shelter Program”
|
|
Project
Number:
|
P.416-020/2018
|
|
Project Period:
|
01.12.2018 – 30.11.2019
|
|
Overall
Budget:
|
460.700 EUR
|
|
Project Donors:
|
Caritas Germany Own
Funds
|
|
Project
Partner:
|
Yayasan
Habitat Kemanusiaan Indonesia (HFH)
|
|
Project
Title:
|
“Early Recovery
Temporary Shelter and WASH Interventions in the earthquake affected areas of
Gunung Sari, West Lombok”
|
|
Project
Number:
|
P.416-018/2018
|
|
Project Period:
|
11.01..2018 – 31.05.2019
|
|
Overall
Budget:
|
216.000 EUR
|
|
Project Donors:
|
Caritas Germany Own
Funds
|
|
Project
Partner:
|
Yayasan
Bumi Tangguh (YBT)
|
|
Project
Title:
|
“Transitional
shelter, sanitation and cash transfer for emergency affected households after
earthquake and tsunami disaster in Central Sulawesi Island, Indonesia”
|
|
Project
Number:
|
P.416-015/2018+P.416-019/2018
|
|
Project Period:
|
15.10.2018 – 30.09.2019
|
|
Overall
Budget:
|
520.000 + 200.000 EUR
|
|
Project Donors:
|
Caritas Germany Own
Funds (200.000) + German Federal Foreign Office (AA) (520.000)
|
|
Project
Partner:
|
Cathlic
Relief Services with PKPU and MDMC
|
2. Background information and Context
a. Background
Indonesia experienced severe earthquakes throughout 2018, amongst others
in Lombok and Central Sulawesi. As a consequence of these natural disasters,
many people living in the affected regions lost their homes – some of the
houses got completely destroyed, others were severely or slightly damaged.
In response to that, Caritas Germany (CG) through its Country Office
Indonesia (COI) started three projects with its partner organizations YBT, HFH,
CRS (with MDMC & PKPU) in two regions in Central Sulawesi and one region in
Lombok in order to provide temporary shelter as well as access to sanitation
facilities to affected households. In cooperation with Caritas Germany and
based on various external and internal issues, each partner developed their own
strategy and their own activities to fulfill their mandate.
This is the first time that
Caritas Germany works with these three partners.
Caritas Germany plans an
extension of its shelter project with CRS in Central Sulawesi which is supposed
to start in November 2019.
b. Context:
Intended Objectives: All projects aim at providing beneficiaries
with safe and healthy transitional shelters and access to sanitation
facilities. Although not all projects include the construction of sanitation
facilities, the partners agreed to make sure that the beneficiaries get access
to sanitation in the project regions (either through getting funding for
building latrines from another donor or by making sure another organization
provides latrines). The disaster affected communities should also be trained
how to build back safer (BBS) and be therefore better prepared for future
disasters.
Target group: The beneficiaries of the projects are households that were affected by
the earthquake in a way that their previous house was either damaged or
completely destroyed. The three projects in total managed to build 1.330
transitional shelter and 575 latrines. 575 t-shelters from CRS (575 latrines), 290
from YBT (public communal latrines) and 465 from HFH (313 latrines financed by
another donor).
Current Status: None of the projects could
be finished within the initially planned timeframe, all three partners applied
for a no cost extension (NCE). YBT was extended for 1 month, CRS for 3 months
and HFH for 4 months.
-
YBT: The construction of t-shelters could already be finished on
31.05.19. However, YBT proposed for a NCE until September 2019 as they haven’t
spent the entire budget. They will implement a waste management activity and
build public latrines in Desa Jeringo since the community in Jeringo village
does not have sufficient sanitation facilities.
-
HFH: Proposed a NCE until November 2019. Per July 2019, 174 t-shelters were
built and occupied. 60 t-shelters are currently under construction and will be
finished by the end of August 2019.
-
CRS: The project will be finished in September, so far construction of
t-shelters has been finished, and construction of latrines is still ongoing...
Further
details about the projects can be retrieved from proposals, reports, etc.
3. Objective of the Evaluation
Objective: General reflection and overall evaluation of the Caritas
Germany t-shelter projects
The overall
objective of the evaluation is carried out to:
-
Reflect what should be improved by Caritas
Germany and its partners
-
Document the lessons learnt from this projects
-
Compare the three different strategies and
activities (including design of t-shelters & sanitation facilities)
-
Develop considerations for the planning and
implementation of future t-shelter and WASH programs after major disasters in
Indonesia
The
evaluation results will be used within Caritas Germany Indonesia and shared
with the partner organizations as well as Caritas Germany Head office.
4. Scope of the Evaluation
-
Thematic Coverage: whole program
-
Time Period: whole program period
-
Geographical focus: all the regions covered by the
project implementation should be analyzed during the evaluation process
-
Target group: the sample should include a
wide range of groups, including vulnerable groups, e..g. PwDs, single and female
headed households, elderly people
5. Sub Research Questions
This evaluation seeks to compare
the different projects regarding the following aspects:
-
Final construction inspection
o Determine the degree of completion
o Are people living in safe t-shelter and do they have access to safe and
healthy sanitation facilities?
o Check the construction dimensions/ assess the structure, stability,
technical safety of the constructed facilities
o Inform the residents of construction defects or possible risks
-
WASH: To what extent was the provision of drainage
and sanitation facilities integrated in the t-shelter program?
-
Technical aspects:
o In what way did the project implementation differ from the initial plan
regarding drawings, material (BoQ)?
-
Location of the t-shelters: Are the t-shelters/
settlements following regulations of relevant authorities regarding hazard and
risk assessments; are they at a safe distance from actual or potential threats?
-
Sphere: To what extend did the projects not meet the
Sphere Standards?
-
Participatory Implementation:
o
In what way do the beneficiaries feel that they (individually or as part
of the community) were involved in the design and/ or implementation of the
t-shelter and latrine program?
-
Vulnerable Groups:
o How did the programs take into account and support particularly vulnerable households
(PwDs, female headed households, older persons)?
o How did Caritas Germany’s partners strengthen the role of women and their
involvement in the projects (e..g. in designing and construction)?
-
Cooperation with stakeholders: How/ to
which extent were the interventions harmonized with other NGOs working in the
same area/ with the local government bodies?
-
Beneficiary selection process: Were there
other selection criteria than the damage of the houses? Did the financial
situation of beneficiaries play a role?
-
Beneficiary Capacity Building: To what
extent were local capacities developed or strengthened through the humanitarian
interventions? (BBS, DRR, Hygiene Promotion)
-
Acceptance of the t-shelter and sanitation
facilities in the communities: How satisfied are beneficiaries with the
facilities?
-
Temporary vs. permanent solution:
o Do the beneficiaries view the t-shelter as permanent or temporary houses?
o Is it possible to safely enhance their existing t-shelters and sanitation
facilities towards a permanent solution?
o Are beneficiaries who got t-shelters still eligible to receive permanent
houses from government programs?
-
Timeframe: What were the reasons for delayed
response?
-
Cost:
o Which one was the most cost-efficient program?
o Composition of the budget of each partner (direct and indirect cost)
-
Construction process: Which one of the approaches to
build the houses (manpower) was the most efficient and appropriate (setting up
of working groups, paying incentives to groups, only distributing material,
cash, etc.)?
-
Livelihood: How do the
projects influence the local livelihood of the community? (sourcing local labor
and materials, e.g. bricks, doors, sand)
6. Approach and Methodology
The Evaluator is expected to perform the
evaluation in a strictly methodical manner in order to produce verifiable information
and make recommendations that are sufficiently valid and reliably based on dependable
data and analysis, which are accessible to the client.
The evaluation will adopt a participatory,
transparent and solution-oriented approach using internal and external
stakeholders. The evaluation process, as well as the final results should be
gender-sensitive and human-rights-based. The evaluator will use mix-methods
that are able to appropriately address the primary evaluation questions, as
well as properly support its derivative conclusion and recommendation.
The evaluation methods
to be used may include, but are not limited to:
· Review
of project documentation (Desk Research): An array of major documents that should be studied (e.g. project documents,
monitoring reports, final reports, as well as statistical data, documents pertaining
to similar projects led by other donor organizations, etc.). Existing project
documents and reports are to be shared with the evaluator in order to
facilitate the realization of the tasks. The evaluator is invited to request
additional documents that may be needed for the completion of the evaluation.
· Interviews
with all the key informants and key players: (semi-)structured Interviews with beneficiaries are a must and should
be supported by interview protocols and the list of respondents (e.g. direct
project beneficiaries, local stakeholders such as head of village, head of
hamlet, BPBD, shelter cluster, local staff, etc.).
The selection criteria should be based on
gender, age, beneficiaries/non-
The exact sample size should be proposed by the
evaluator and discussed with Caritas Germany before the start of the
evaluation.
· Direct
observation during field visits:
Caritas Germany in cooperation with HFH, YBT and CRS will organize field visits
at different project sites..
· Standardized
Survey and questionnaires: to
quantify the result and deliver a statistical analysis.
7. Deliverables and Timeframe
i.
Inception
Report:
An inception report
will be submitted by the evaluating consultant in order to demonstrate his understanding
and planning of the evaluation, which will be reviewed and discussed with
Caritas Germany.
The inception report
should include an evaluation matrix[1] (including the final evaluation questions and
indicators); the overall evaluation design and methodology with a detailed
description of the data collection methods and data analysis techniques, as
well as a proposed timeframe for the activities and deliverables. The evaluator
is free to suggest additional methodological framework for the evaluation.
ii.
Workshops/ Meeting:
The organization of
any type of workshop or meeting (e.g. kick-off/mid-term/validation workshop) during
the conduction of the evaluation has to be discussed between Caritas Germany
and the evaluator.
The Kick-off workshop provides
an opportunity to discuss organizational processes, methodology, data
collection instruments, timetable, milestones, reporting dates, task and responsibilities.
Moreover, the mid-term workshop is useful to discuss problems that may arise in
the course of an evaluation and allow a joint development of strategies for
solutions.
During a validation
workshop, the evaluator will present the findings collected in the field to Caritas
Germany. The workshop will be organized in order to discuss and validate
findings, lessons learned and recommendations proposed by the evaluator. Stakeholders
are invited to make recommendations for amending the review.
iii.
Draft
Report:
The consultant is
expected to submit the primary findings resulting from his evaluation, as well
as his initial recommendations to Caritas Germany. The Draft Report should be
presented after the field work has been concluded, and should incorporate
comments supplied by Caritas Germany and its partner organizations.
iv.
Final Report:
The final report serves
to illustrate the relevant evidence corresponding with the evaluation issues,
questions and criteria listed in the Terms of Reference. The final report
should provide an executive summary in English. The Final report should take
all aspects reviewed during meetings
that were held into consideration, and is subject to approval by Caritas Germany.
The proposed report; its length should be discussed with
Caritas Germany. All documents and tools are to be written in English language.
8. Timeframe for Deliverables
The timeline for the
activities consists of the following phases:
Preparation Phase:
§ Analysis of
relevant project documents, as well as further research
§ Preparation of
inception report and exchange with HFH, YBT, CRS and Caritas Germany
§ Kick-off Meeting with
Caritas Germany
Field Phase:
§ Briefing with HFH,
YBT, CRS, Caritas Germany and other relevant actors
in Central Sulawesi and Lombok
§ Field visits
§ Validation Meetings
involving HFH, YBT, CRS and Caritas Germany individually
Synthesis Phase:
§
Reporting including management response workshop
§
Draft evaluation report
§
Produce final report including revision as per feedback
The key products
expected for the evaluation are the following:
|
Deliverable
|
Dates
|
|
Inception Report
|
15.10.2019
|
|
Draft Report
|
15.11.2019
|
|
Final Report
|
30.11.2019
|
The evaluator should
present a detailed work plan and timeframe of all activities including the
relevant resource allocation (see Annex
3).
9. Roles and Responsibilities
The evaluator is
responsible for organizing and facilitating the logistics to and in the relevant project sites. HFH, YBT, CRS and Caritas
Germany will provide access to all relevant project documents.
The evaluator will be
working under and reporting to the Caritas Germany Country Office Indonesia during
the evaluation phase.
10. Guiding Principles & Donor concepts
The evaluator is to
conduct the evaluation in accordance with the principles outlined in the “Caritas
Internationalis management standards” document, the “Caritas Code of conduct”,
as well as the “Guidelines on Combating Fraud and Corruption in the Project
Work of Caritas Germany”.
The evaluator must
take all required steps to ensure that the evaluation is designed and conducted
to respect and protect the rights and welfare of the people and the communities
of which they are members, as well as to ensure that the evaluation is
technically accurate, reliable, and legitimate, and conducted in a transparent
and impartial manner. Moreover, the evaluation should ideally contribute to
organizational learning and accountability.
11. Professional Qualification and Experience
Caritas Germany
Country Office Indonesia seeks expression of interest from evaluation
consultants/teams with the following skills/qualifications and expertise:
§ Minimum 8 years-experience in implementing temporary shelter programs
(program design and technical/engineering focus) and in undertaking technical
evaluation.
§ Minimum qualification of a master´s degree or equivalent combination of
education and relevant work experience
§ Sound and proved experience in conducting evaluations preferable on
temporary shelter issues, particularly utilization and learning focused
evaluations
§ Understanding of project management structures
§ In-depth knowledge and experience in Temporary Shelter and Sanitation
Projects
§ Knowledge of strategic and operational management of humanitarian
operations, as well as proven ability to provide strategic and practical
recommendation to key stakeholders Demonstrate understanding and sensitivity on
cross-culture, tradition and language of project targets, especially in Lombok
and Central Sulawesi
§ Strong analytical skills and ability to clearly synthesize and present
findings, draw practical conclusions, make recommendations and prepare
well-written reports in a timely manner
§ Experience in qualitative and/or quantitative data collection and data
analysis techniques
§ Strong expertise in using participatory tools
§ Familiarity with transparency and downward accountability processes and
their values
§ Able to travel and undertake data collection in Lombok and Central
Sulawesi
§ Fluency in written and spoken Bahasa Indonesia and English.
§ Country and regional experience in Indonesia
12. Terms of Payment
The evaluator is to receive payment from Caritas Germany in three instalments:
·
1st Payment: 30 % upon signing of the contract;
·
2nd Payment: 30 % upon the submission of the first draft of the evaluation report;
·
Final Payment: 40 % upon the submission of the final
evaluation report, subject to its acceptance by Caritas
Caritas Germany will not settle any payment unless the consultancy
institution accomplished all the tasks in a timely fashion. The basis for
payment scheduling is to be determined during contract negotiations.
13. Application Procedure
Interested candidates
should submit their application material by 20.09..2019
The application itself
should include the following components:
§ Curriculum Vitae
(CV) including 3 professional references, and indication of daily rates
§ Cover letter transparently
summarizing relevant experience in Temporary Shelter as well as practical experience in planning and conducting project
evaluations
§ Track record of
conducted studies, research, publication and references
§ A technical
proposal for the evaluation, including the proposed evaluation methodology and
work plan
§ Financial proposal[2]
underlying the evaluation, including proposed fee
§ A sample of recent
writing (report or similar) relevant to the terms of reference stated above
The proposal should be
addressed to:
Ms. Ade Ferry
Caritas Germany Country Office Indonesia
Perum Citra
Nirwana Blok A No. 4
Jl. Kalimantan –
Ring Road Utara
55284 Yogyakarta
Email: caritas.germany@gmail.com
No comments:
Post a Comment