Monday, June 22, 2020

Terms of Reference for Research and Evaluation Central Sulawesi Emergency Response & Disaster Emergency Committee (DEC) Phase 2 Final Evaluation June 2020


1.         PROJECT Background


Save The Children (STC) has been present in Indonesia since 1976, and became a locally registered foundation in Indonesia, known as Yayasan Sayangi Tunas Cilik (YSTC), in 2014. YSTC is one of the largest child-rights organisations in Indonesia, with over 500 staff, and delivering programmes across a number of thematic areas including health, nutrition, child protection, education and child poverty. YSTC has significant humanitarian experience, from the El Nino event in Sumba, Lombok Earthquake, Central Sulawesi Earthquake and Tsunami to the recent Covid-19 response. In these emergencies, YSTC responded with national staff through a holistic emergency response.

On Friday 28 September, a series of strong earthquakes struck the Central Sulawesi province of Indonesia. The strongest earthquake, registered at a magnitude of 7.4, was only 10 km deep, with its epicentre close to the provincial capital, Palu. The earthquake triggered a tsunami striking beach in Palu and Donggala. The earthquakes, tsunami and resulting liquefaction and landslides have caused devastating damage and high loss of life, affecting the lives of 1.5 million people including 375,000 children.  In October 2018, STC started its operation in Central Sulawesi after the earthquake and tsunami hit the province.
STC has operational presence in three city/district, namely Palu, Sigi, and Donggala with two operation field offices located in Palu and Donggala. STC implements programs in six sectors: child protection, education, water sanitation & hygiene (WASH), health & nutrition, shelter, and food security & livelihood (FSL).
The overall response goal is: Contribute to immediate and lasting change in the lives of earthquake and tsunami -affected children and their families: through urgent humanitarian assistance, continued access to basic services and with active participation in their own recovery. STC focus on three strategic priorities during the response, there are
  • 1). To maximise impact for the hardest to reach through integration;
  • 2) to leverage impact supporting the government with technical expertise;
  • 3) to be a lolised response through strengthened national capacity.
Education and Child Protection, the largest sectors, are at the centre of all programme design for geographical integration; this is complemented by further sector level integration. By ensuring programme, design and operations are integrated we expected the efficiency in the use of resources is increased, and, more importantly, the most vulnerable families receive a comprehensive package of support. To accommodate this, STC also developed response framework to operationalize the impact from each sector to the affected communities as follow:

Sector
Objectives
Outcome
Child Protection
Ensure life-saving protection and psychosocial well-being and resiliency support for children and families, including Unaccompanied and Separated Children (UASC), impacted by the Sulawesi earthquake and tsunami
Outcome 1. Family separation is prevented and responded to, and unaccompanied and separated children are cared for and protected according to their specific needs and best interest
Outcome 2. Girls and boys’ psychosocial well-being, positive coping mechanisms and resiliency are strengthened
Outcome 3.  Girls and boys are protected from violence, including sexual violence, and exploitation and survivors of violence have access to age and culturally appropriate information as well as a safe, responsive and holistic response

Education
Boys and girls (aged 4-14) affected by the earthquake and tsunami have access to safe, protective, inclusive and age appropriate learning opportunities, in displaced and host communities
Outcome 1. Children affected are accessing safe, protective and equipped learning spaces
Outcome 2. Improved knowledge and skills of teachers and community volunteers to deliver life-saving knowledge and skills to affected children
Outcome 3. Improved capacity of parents and caregivers to support children’s social and emotional learning
Outcome 4. Increased participation of children on risk reduction and disaster preparedness in school and community.
Outcome 5. Strengthened capacity of education sector at district and sub-district levels
Nutrition
To protect nutritional status and contribute to a reduction in morbidity and mortality amongst children, pregnant and lactating mothers
Outcome 1.1 Caregivers with children under 2 years and pregnant women in the affected population have access to IYCF-E services supporting recommended IYCF practices

Outcome 1.2. Adequate complementary feeding and nutritional sufficiency in pregnant and breastfeeding women is supported and protected during the emergency

Outcome 1.3. Strengthen national policy, capacity and systems to deliver an effective IYCF-E response for the current emergency and future emergencies
Outcome 1.4. Control, monitoring and follow up of BMS distributions and donations

Outcome 2.1. Children and PLWs with acute malnutrition are identified and referred for treatment
WASH
Targeted children and families have access to and use safe water and sanitation, and adopt improved hygiene practices
Outcome 1. Targeted children and families have access to and use safe water and sanitation and adopt improved hygiene practices

Shelter
Vulnerable children have better access to safe, protective, living and learning environments.
Outcome 1. Vulnerable children have better access to safe, protective, living and learning environments.

Outcome 2. Targeted households are enabled to build adequate transitional shelter (for midterm shelter solution) that provides protection from adverse weather during the monsoon seasons.                                                    
Food Security & livelihood
The most vulnerable and hardest to reach household households are able to meet basic household needs and fill food/nutrition gaps in the short and medium-term, while launching recovery activities for communities and households as soon as possible
Outcome 1. 6,000 vulnerable, earthquake-effected households supported with multi-purpose cash grants are better able to meet their basic needs while limiting their reliance on negative coping strategies
Outcome 2. 50 community-led recovery projects supported with cash-based and in-kind support provide greater voice and participation for effected communities during the recovery process
Outcome 3. 1,500 vulnerable, earthquake-effected women receiving fresh food vouchers have increased access to nutritious food for their children as livelihoods and income recover
Outcome 4. 1,000 vulnerable, earthquake-effected adolescent/youth equipped with skills and inputs to access a more stable income reduce their involvement in damaging economic activities
Outcome 5. 1,500 vulnerable, earthquake-effected households receiving cash-based and in-kind support to recovery their livelihood activities stabilise and increase their income

Up to now, the Central Sulawesi Emergency Response has reached around 218,253 beneficiaries including 104,807 children through various activities. The response is supported by various donors from different countries with total amount is approximately USD 17 Million for all sectors. The response is also supported by the Disaster Emergency Committee (DEC) from United Kingdom (UK). The DEC has supported Central Sulawesi Emergency Response through two phases where the first phases was delivery on response phase (November 2018 until March 2019) with total amount approximately GBP 2.1 Million while the second phase is delivery during April 2019 until September 2020 with total budget is GBP 2.3 Million.
In Phase 2, the DEC supported activities were focused to FSL, WASH, Shelter, and Education sectors in our priority villages in Sigi and Donggala with the following outcome:
Outcome 1.  Adolescent girls in Central Sulawesi are supported to develop the skills necessary to conduct viable and dignified income generating activities.
Outcome 2. Community groups in Central Sulawesi are support to design and implement recovery projects.
Outcome 3. Affected children and their families in Central Sulawesi have improved access to clean, safe and equitable quantities of water
Outcome 4. Affected children and their families in Central Sulawesi have improved hygiene and sanitation behaviour
Outcome 5. Affected community members have raised awareness and increased skills to build safer and stronger shelters.     
Outcome 6. Affected households in Central Sulawesi are enabled to build adequate transitional shelter (for midterm shelter solution) to minimise health and protection related risks   
Outcome 7 School committees are supported to carry out minor repairs to classrooms and school grounds.     
Through community engagement approach, STC has already reached around 30,000 beneficiaries (up to March 2020) whereas half of them are female beneficiaries. All the project activity was designed to engage community, including children closely. Through our complaint and feedback Mechanism (CFM) community also have opportunities to address their complaint and feedback via available channel such as hotline number, complaint and feedback box, face to face with staff and community/children consultation. STC has established strong and credible relations with the Government of Indonesia (GoI) and national civil society and is able to scale up and provide relief efforts with no restrictions.
 

2.         EVALUATION CONTEXT

 
Central Sulawesi is a new response area for STC, prior to the crisis STC had an office in Makassar, South Sulawesi. The decision to respond in Central Sulawesi indicated YSTC’s commitment and ambition to programme in the region for the foreseeable future.  Currently, STC is operating two field offices: Donggala Office located in Tambu Sub District that covers Donggala operation and Central West Office located in Palu to cover Palu and Sigi area. Each office is led by a Senior Field Manager (SFM) who report to Humanitarian Directors  based in Jakarta.
STC has established strong and credible relations with the Government of Indonesia (GoI) and national civil society and is able to scale up and provide relief efforts with no restrictions. In Central Sulawesi Response, STC working closely with the Provincial Response Lead along with relevant Provincial/District Office, such as Badan Penanggulangan Bencana Daerah (BPD)/Provincial Disaster Management, Education Office, Social Affair Office, and Health Office. Along with other humanitarian organization and UN agency, STC contribute in the relevant cluster activity, including jointly coordinating the Education cluster with UNICEF.
The Central Sulawesi response has been rated as high quality against international and Indonesian standards and are coordinated with the Indonesian government to build technical capacity. The technical quality team also developed quality benchmark that is referred by program implementation team as a standard for the activity. The quality benchmark was developed according to technical international humanitarian standards – SPHERE Standards, Child Protection Minimum Standard (CPMS) and Inter-Agency Network for Education in Emergencies (INEE) and Core Humanitarian Standard (CHS).
Six months after the disaster, STC reviewed the Master Strategy to give more context to the recovery period, as well as to enhance the effectiveness and efficiency of its intervention. Integration is one approach that was key in the programme design from the beginning. However, the implementation was still sectoral, so Save the Children established a Community Engagement team to ensure the sectoral integration implementation at field as well as to mobilize the community effectively. Alongside this, the field team also prioritised focus on priority villages to ensure the most vulnerable communities received integrated assistance.
The response also has several delays: it was not fully operational during March– April 2019 due to the National Election and its campaign period, (we did not deliver any distribution as per request by the government). We also had to minimize our activity during Ramadhan and Eid Holiday during May – June 2019.
The response itself has been reviewed twice already in the initial six months as a part of STC Category 2 emergency response: an Operation Cost Review (OCR) to assess the operational aspect and a Real Time Review (RTR) to assess the program quality during the response. Each review suggested several action plans, which have been followed up both by National and Field team.  This evaluation should focus specifically on the period six months onward from the disaster – the same period from when the STC funding for DEC Phase 2 was activated.
In March 2020, the Government of Indonesia (GOI) declared the global COVID-19 outbreak as a national emergency, restricting movement and activities outside the home to avoid the spread of the virus. This has also affected STC’s movements on the ground with the postponement of several activities and others adapted onto online platforms to adjust to the COVID-19 situation. STC have also adjusted their activity to support the Government Response on COVID-19 in Central Sulawesi. Hence, this final evaluation should also take account these circumstances both for the operations and program evaluation, as well as data collection processes.

3.         PURPOSE & Scope of evaluation

 

3.1         Purpose and objective

 
Purpose
This evaluation is being conducted at the end of the Central Sulawesi Emergency Response – and in the final period of DEC Phase 2 funding. It will build upon the sectoral baseline, internal end line assessment, internal assessment as well as regular monitoring.
 
The primary focus of the current evaluation is to provide information about the results of Central Sulawesi Emergency Response, including its success and failure as part of our accountability to affected population as well as relevant stakeholders, especially our donors, so STC can improve the quality of its responses in the  future.
 
Objectives
There are several objectives for the current evaluation as follows:
  • To describe, assess, review and critically evaluate the achievement of results - both intended and unintended, positive and negative and identify major factors which influence those results.
  • To examine the response/project design relevance and implementation fidelity
  • To gain insights into the level of beneficiaries and stakeholder (e.g., community and local/national government, implementing partners, donor) satisfaction and expectation towards the response activities.
  • To document the lessons learned from the project implementation, including those pertaining to approaches, sector integration, gender mainstreaming, child participation, project management, and partnerships.
  • To provide recommendations according to the findings of the evaluation to enable STC to sustain the benefits of the project and effectively adapt its Humanitarian Strategy for future humanitarian crisis response both in Indonesia and globally.

3.2        Scope


The evaluation will focus on several considerations as follow:
  • The evaluation will focus on the implementation of the activity from six months after the disaster
  • The evaluation will focus on the implementation of the whole emergency response that conducted by STC across the sectors along with the implementation and contribution of the DEC Phase 2 Funding
  • The evaluation needs to take into consideration the Development Assistance Committee (DAC) and CHS indicator to measure the success of response quality and operation, as well as lessons learned
  • The evaluation also needs to take into consideration all operational activity due to the COVID-19 crisis situation that may impact project implementation, as well as the planned evaluation implementation

3.3. Stakeholders/audiences

 
The key stakeholders/audiences for this evaluation are:
 
Stakeholder
Further information
Project donor
Pool Appeal Fund; DEC
Primary implementing organisation
Save the Children Indonesia
Implementing partners
N/A
Government stakeholders
BPBD
Central Sulawesi Government
Provincial and District of Social Affair Office
Provincial and District of Education Office
Provincial and District of Health Office
Community groups
Priority Villages including Community Based Child Protection (CBCP)
Beneficiaries
Children and adults involved in the programme/project and the evaluation
International development/ humanitarian community
DEC received Organization in Central Sulawesi, Relevant Cluster Coordination

The selected evaluation team will be required to propose how the evaluation findings will be shared with each of the different stakeholders in the table above, particularly outlining how reporting back to communities, beneficiaries and children will be conducted in an accessible and child friendly manner.

3.4.       Evaluation Questions


The primary question for the evaluation is how the response strategy is used and the benefits on the implementation of humanitarian response in Central Sulawesi.

The Evaluation team will be required to undertake consultation with the SC Evaluation Project Manager and the Evaluation Working Group at the commencement of the project in order to further refine the evaluation questions.


Cross cutting questions
In addition, the following specific questions should also be considered for summative evaluations:

Criteria
Questions
Gender sensitivity
  • How has the response and project considered gender sensitivity both in the design and its implementation of activities?
  • Has the project incorporated different needs and accessibility of boys and girls, men and women, and non-binary individuals?
  • What are the gender gaps that the project addressed and what remaining aspects need to be considered further?
 
Social inclusion
  • How did the response and project consider inclusion of vulnerable groups in the design and its implementation of activities?
 
Child participation
  • How have the children, their needs and desires been consulted and accounted for in project design and implementation?
  • How were children meaningfully involved in the project design and implementation? What impact did this have on the outcome of the project?
Child rights programming
  • How has the project design and implementation considered child rights approaches?
 
Child safe programming
  • Have the response and project been designed, planned, implemented and monitored to ensure it is safe for children?
  • How has child safety been integrated into the project design and implementation of activities? What aspects of the project make children feel safe?
  • How has the project assessed the risks for children and do these risks still exist to date? Have they been reduced, controlled and managed by the minimising actions? Are there new risks?  What further measures do we need to implement to reduce, remove and control these new emerging risks.
 
Accountability
  • How has the project approached accountability to children?
  • How did feedback from children influence decision making?

 

4.         Evaluation Methodology

 

4.1         Research design and sampling


It is expected that this evaluation will involve:
§     Mix methods (quantitative and qualitative methods) for relevant group
§     Purposive Sampling for Stakeholder, such as government, relevant NGO, relevant Cluster Coordination Group, including internal staff
§     Simple Random Sampling for Beneficiaries from the beneficiaries list Data

All primary data collected during the course of the evaluation must facilitate disaggregation by gender, age, location, disability status, including vulnerability status/group. STC will provide guidance on tools and classification schemes for this minimum dataset.

Existing STC data sources that can be drawn on in the evaluation include:
§     Response Strategy, including master log frames
§     Response Update
§     Project Report
§     Internal Review (RTR, OCR)
§     DEC 2 Project Documents
§     Monitoring, Evaluation, Accountability, Learning (MEAL) Data (e.g. Post Distribution Monitoring/PDM, Accountability in Brief, Outcome Monitoring Report)
§     Communication Materials, including Case Study

STC may provide enumerators to assist with primary data collection. Data triangulation is expected for this evaluation. It will be a requirement of the Evaluation team to source additional external data sources to add value to the evaluation, such as government administrative data.

A range of project documentation will be made available to the Evaluation team that provides information about response strategy, implementation and operation of the project

The Evaluation team is required to adhere to the STC Child Safeguarding, Data protection and Privacy policies throughout all project activities.

4.2         Methodologies

We may expect to have this methodology for the evaluation survey, but would not be limited to:
1.       Desk review of key documents, including strategy documents, prior evaluation reports, monitoring reports and other documents judged relevant.
2.       Literature search and review of material on the environment in which the project operates, and recent developments which impact objectives and activities
3.       Interviews with key project staffs, representatives of the project’s stakeholders (local government, implementing partners, key informants, past evaluators, donors, etc.)
4.       Probabilistic sample surveys of targeted beneficiaries or groups of stakeholders
5.       Focus group discussions with targeted beneficiaries and stakeholders
6.       Other participatory approaches, such as “most significant change”
7.       Case studies, which usually require site visits to judge the outcomes and impacts
8.       Physical inspection of some products or facilities and/or measurement of environmental factors affecting results.
9.       Independent assessment of prior baseline or end line survey/assessments.
10.   Analysis of results by methodologies such as “before/after” comparison of baseline and end line; or “with/without” comparison with a control group’
11.   Attendance at beneficiary meetings, workshops, and training activities.
12.   Review of evaluations and annual reports of other project in the same sector and with the same/similar target population

There will be discussion between the evaluation steering committee and the selected contractor/consultant on the methodology and work plan.  This occurs after the contractor have had the chance to review background materials and monitoring data, and after speaking with key project personnel.  This discussion can either take the form of an informal exchange of ideas over a select period of time, or the drafting by the contractor of a formal report or INCEPTION REPORT.

 

4.3         Ethical considerations


It is expected that the evaluation will adhere to ethical guidelines as outlined in evaluation association (e.g., the American Evaluation Association’s Guiding Principles for Evaluators). A summary of these guidelines is provided below, and a more detailed description can be found at www.eval.org/Publications/GuidingPrinciplesPrintable.asp.
It is expected that this evaluation will be:

  • Child participatory. Children should be meaningfully involved in the evaluation as a holistic process and not only as informants. Refer to the Practice Standards in Childrens Participation (International STC Alliance 2005); and Global Indicator technical guidance (SCI M&E handouts Package, Volume 2).
 
  • Inclusive. Ensure that children from different ethnic, social and religious backgrounds have the chance to participate, as well as children with disabilities and children who may be excluded or discriminated against in their community.

  • Ethical: The evaluation must be guided by the following ethical considerations:
o   Respect for People - evaluators respect the security, dignity and self-worth of respondents, project participants, clients, and other evaluation stakeholders.
 
    • Informed Consent - all participants are expected to provide informed consent following standard and pre-agreed upon consent protocols. This is to ensure that they can decide in a conscious, deliberate way whether they want to participate.
 
    • Child safeguarding demonstrating the highest standards of behaviour towards children
 
    • Sensitive to child rights, gender, inclusion and cultural contexts
 
    • Openness - of information given, to the highest possible degree to all involved parties
 
    • Confidentiality and data protection - measures will be put in place to protect the identity of all participants and any other information that may put them or others at risk.
 
    • Public access - to the results when there are not special considerations against this
 
    • Broad participation - the relevant parties should be involved where possible
 
    • Reliability and independence - the evaluation should be conducted so that findings and conclusions are correct and trustworthy
 
    • Systematic Inquiry - evaluators conduct systematic, data-based inquiries.
 
    • Competence - evaluators provide competent performance to stakeholders.
 
    • Integrity/honesty - evaluators display honesty and integrity in their own behavior and attempt to ensure the honesty and integrity of the entire evaluation process.
 
    • Responsibilities for general and public welfare - evaluators articulate and take into account the diversity of general and public interests and values that may be related to the evaluation.

It is expected that:

  • Data collection methods will be age and gender appropriate.
 
  • Evaluation activities will provide a safe, creative space where children feel that their thoughts and ideas are important.

  • A risk assessment will be conducted that includes any risks related to children or young peoples participation.
 
  • Informed consent will be used where possible.

The Evaluation team [will/will not] be required to obtain approval from a Human Research Ethics Committee.  STC will provide assistance with this process.

5.         Expected ACTVIITIES AND Deliverables


The evaluation deliverables and due dates (subject to the commencement date of the evaluation) are outlined below. The [Evaluation team lead] will advise [SC Evaluation Project Manager] immediately of any risks or issues that may impact on their ability to provide the deliverables by these due dates. [Use the below table as a guide and update as relevant to your project.]

5.1. Expected Activities

The following is an example of a plan of expected activities.  A Gantt chart can also be used.

 

Activities
Nmber of days
Expected timeline
1.     Desk review, literature search and discussions with key project staff
4
15 – 18  July 2020
2.     Develop and submit inception report for approval
3
20 -22 July 2020
3.     Develop data collection instruments
3
23 25  July 2020
4.     Develop and facilitate data collection training
3
25 - 27 July 2020
5.     Field data collection
10
27 July – 5 August 2020
6.     Report on training and completion of data collection
1
6 August 2020
7.     Clean and analyze data
5
7 - 11 August 2020
8.     Prepare and submit draft report
4
12 – 15 August 2020
9.     Finalize report in line with SC feedback
5
17 -21 August 2020
10.  Present findings to SC Indonesia staff and office representative as relevant
1
24 August 2020
Total expected workdays:
40
 
















5.2. Deliverables and Due Dates
The following is an example of details on deliverables and deadlines.  Indicate the language required for all deliverables and whether they need to be translated, and what role, if any, the evaluators are expected to play in such translations or reviews of the translated text.  Also state any page limitations, perhaps allowing for annexes of unlimited length, and indicate whether raw data or any special tabulations are to be provided and in what form

No
Deliverable
Due Date

1
The Evaluation Team is contracted and commences work
13 July 2020
2
The Evaluation Team will facilitate a workshop with the relevant stakeholders at the commencement of the project to develop the Inception report. The inception report will include:
  • evaluation objectives and key evaluation questions
  • description of the methodology, data sources, draft data collection tools (preferably against the key evaluation questions) and sampling considerations
  • caveats and limitations of evaluation
  • key deliverables, milestones and timelines
  • risk and issue management plan
  • a stakeholder communication and engagement plan
  • consultation protocols for consulting with children and other vulnerable groups (if applicable)
  • Logistical or other support required from STC

Refer to the Inception report guideline. Once the report is finalised and accepted, the evaluator/ evaluation team must submit a request for any change in strategy or approach to the evaluation manager or the steering committee.

14 July 2020
3
Ethics submission (if applicable):
Should approval from a Human Research Ethics Committee be required, an ethics submission should include:
  • study protocols (participant recruitment, data security and storage, consent and confidentiality etc.)
  • considerations for consulting with children and other vulnerable groups (if applicable)
  • participant information statement and consent forms

22 July 2020
4
A concise 1-page Progress Report is to be submitted every two weeks implementing progress against the evaluation plan including:
  • progress over the last period
  • risks and issues management report
  • key scheduled activities and deliverables for the next period

Every two weeks





5
Data collection tool
  • Survey instrument Available
  • Data collection Start conducted
22 July 2020
6
An Interim/Preliminary Report* including a summary of formative findings from the evaluation.

The focus will be on:

  • Summary of interim findings
  • Any emerging programme issues or risks (if applicable)
  • Key tasks for the next stage of the evaluation and any proposed refinements or changes to methodology (if applicable)

5  August 2020
7
An Evaluation Report*
Maximum 40 pages, exclude annexes
(Draft Version) including the following elements:
  • Executive summary
  • Background description of the Programme and context relevant to the evaluation
  • Scope and focus of the evaluation
  • Overview of the evaluation methodology and data collection methods, including an evaluation matrix
  • Findings aligned to each of the key evaluation questions
  • Specific caveats or methodological limitations of the evaluation
  • Conclusions outlining implications of the findings or learnings
  • Recommendations
  • Annexes (Project logframe, Evaluation TOR, Inception Report, Study schedule, List of people involved)

A consolidated set of feedback from key stakeholders will be provided by STC within [X] days of the submission of the draft report.

14 August 2020
8
Data analyses including all raw data, databases and analysis outputs

7 August 2020
9
Final Evaluation Report* incorporating feedback from consultation on the Draft Evaluation Report

21 August 2020
10
Knowledge translation materials:
  • PowerPoint presentation of evaluation findings
  • Evidence to Action Brief**

24 August

*All reports are to use the STC Evaluation report template [unless another format is required by the project donor].  Please also refer to STC technical writing guide.

** The Evidence to Action Brief is a 2-4 pages summary of the full report and will be created using the STC Evidence to Action Brief template.

All documents are to be produced in MS Word format and provided electronically by email to the SC Evaluation Project Manager. Copies of all PowerPoint presentations used to facilitate briefings for the project should also be provided to STC in editable digital format.

6.         Reporting and governance


The final evaluation will be governed by a Steering Committee that will be the final decision for every deliverable from the selected evaluator. the steering committee will be involved in each evaluation steps and selected evaluator need to have its approval to move to next step. The steering committee consist of programmatic and operation division that involve in Central Sulawesi response.

The Evaluation team lead is to provide reporting against the project plan. The following regular reporting and quality review processes will also be used:

  • Verbal reporting each week/biweekly to the Steering Committee STC Evaluation Project Manager]by outlining progress made over the previous period.

  • A written Progress Report (1-page) by email to the STC Evaluation Project Manager every fortnight  documenting progress, any emerging issues to be resolved and planned activities for the next month.

The PDQ Director will be accountable for approving the Final Evaluation Report.


7.         Evaluation team 


To be considered, the Evaluation team members together must have demonstrated skills, expertise and experience in:

  • Designing and conducting outcome evaluations in humanitarian setting
  • Conducting research and/or evaluation in the field of child right issues, particularly in relation to child protection, food & security livelihood, health & nutrition, and education.
  • Leading socio-economic research, evaluations or consultancy work in Indonesia that is sensitive to the local context and culture, particularly gender equality and child right issue
  • Conducting ethical and inclusive research and/or evaluation involving children and child participatory techniques
  • Conducting ethical and inclusive research and/or evaluation involving marginalised, deprived and/or vulnerable groups in culturally appropriate and sensitive ways
  • Managing and coordinating a range of government, non-government, community groups and academic stakeholders
  • Experience conducting research/evaluation in humanitarian contexts
  • Sound and proven experience in conducting evaluations based on OECD-DAC evaluation criteria, particularly utilisation and learning focused evaluations
  • Extensive experience of theories of change and how they can be used to carry out evaluations
  • Report writing and presentation skills

There is a high expectation that:
 
  • Members (or a proportion) of the evaluation team have a track record of working together.
  • A team leader will be appointed who has the seniority and experience in leading complex evaluation projects, and who has the ability and standing to lead a team toward a common goal.
  • The team has the ability to commit to the terms of the project, and have adequate and available skilled resources to dedicate to this evaluation over the period.
  • The team has a strong track record of working flexibly to accommodate changes as the project is implemented.

 

8.         Selection Criteria


Essential criteria


Understanding of requirements and proposal

  1. The bidder has legitimate business/official premises, or that they are registered for trading and tax as appropriate (Company Credential).
  2. The bidder confirms they are not a prohibited party under applicable sanctions laws or anti-terrorism laws or provide goods under sanction by the United States of America or the European Union and accepts that SCI will undertake independent checks to validate this.
  3. Demonstrate your understanding of the study requirements and provide your proposal for how you would approach the research/evaluation. Your proposal will be assessed on whether the approach and methodology are robust, appropriate (actionable, sensitive, responsible) and indicates that it will achieve the study requirements.
  4. Demonstrate your understanding of the deliverables and activities to be implemented, by:
    1. Describing your proposed approach to project management and track record of delivering on time and on budget.
    2. Providing a project plan with indicative timeline and defined roles and responsibilities of team members.
 

Commercial criteria

Commercial Criteria is defined as the criteria which cover all financial aspects of a supplier’s response including pricing, rebates, free services, discounts etc. The minimum weighting for standardized services for Commercial Criteria is 50% of the total scoring.


Capability criteria


Demonstrated Experience

  1. Demonstrate your experience and track record in conducting [large/medium/small scale]:
a.     [formative or process] evaluation using mixed-methods (qualitative and quantitative data collection and analysis)
b.     [impact/outcome or economic] evaluation using [experimental or quasi-experimental] design and mixed-methods (qualitative and quantitative data collection and analysis)
c.     economic evaluation in a social services context (including either cost effectiveness analysis, return on investment, cost-benefit analysis or cost efficiency analysis)
d.     [Applied, intervention, action, exploratory, longitudinal etc.] research [or needs assessment/situational analyses etc.]
 
  1. Demonstrate your experience and track record in conducting research and/or evaluation in the field of [insert thematic area/s], particularly in relation to [sub-thematic area]
 
  1. Demonstrate your experience and track record of leading socio-economic research, evaluations or consultancy work in [insert Country Name] that is sensitive to the local context and culture, particularly [select all that apply: child rights, gender equality, ethnicity, religion and minority groups and/or other factors]
 
  1. Demonstrate your experience and track record in conducting ethical, inclusive and participatory research and/or evaluations involving: a) children and b) marginalised, deprived and/or vulnerable groups

Bidder capacity

  1. Describe the Project lead’s coordination experience in leading consultancy work, research and/or evaluations of similar scale, and managing a team of diverse team of specialists.
 
  1. Nominate the key personnel and resource pool who will perform the work in relation to this contract. Your response will be assessed on whether the skills and experience of key personnel adequately covers all areas of expertise and experience required, and your combined team resources (number of members) as required to implement the activities within the set timeframe. Please indicate the ‘personnel type’ for each key personnel using the types outlined in the table below for the next question.
 

Financial criteria

This personnel profile, schedule of rates and cost elements will be used for the purposes of assessing cost effectiveness, as well as managing and negotiating the agreed cost of deliverables, or agreed scope variations if required.

Personnel allocations

  1. Use and adapt the table below to outline how much time has been allocated for the proposed team members to complete the required activities and deliverables. Indicate the type and number of personnel allocated, for example 1x5 days (one individual for 12 days = 12 days) or 3x10 days (three individuals for 10 days each = 30 days).
 
Activity/ Deliverable
[Project personnel]
[Project personnel]
[Project personnel]
[Project personnel]
[Add columns as needed]

Stage 1














Sub Total
 
 
 
 
 

Stage 2














Sub Total
 
 
 
 
 

Stage 3














Sub Total






TOTAL (All Stages)






Personnel Rates

  1. Please detail the daily rates for key categories of project personnel in the schedule below. 
 

Expected number of days
Daily Rate
Taxes
TOTAL
[Project personnel]




[Project personnel]




[Add rows as needed]




TOTAL





Cost elements

  1. Please specify all non-personnel related cost-elements that are budgeted for in this proposal.
 
Element
Budget allocated
Taxes
TOTAL
Inputs (please specify)



Outputs (please specify)



Travel (please specify)



Support costs (please specify)



Other disbursements (specify)




The consultant must be willing to comply with Save the Children’s relevant policies and procedures:
1) Child Safeguarding Policy
2) Anti-Fraud, Bribery & Corruption Policy
3) Slavery & Human Trafficking Policy
4) IAPG Code of Conduct
5) Conditions of Tendering

The consultant should submit the Company Credential:

1.         Copy of deed of establishment
2.         Copy of tax registration number & certificate
3.         Copy of institution registration certificate
4.         Copy of trading/institution license

How To Submitting Proposals:

Proposal Documents, Supplier Declaration and Company Credential are sent via e-mail to:


Or

Save The Children Indonesia
Pic: Procurement Jakarta
Jl. Bangka IX No.40 A-B
Kel. Pela Mampang
Kec. Mampang Prapatan
Jakarta Selatan 12720

Closing date for application is up to July 7th, 2020. Time: 17:00 WIB

(Only short-listed candidates will be notified)

No comments:

Post a Comment