Project Overview-
Search for Common Ground
(Search) Indonesia is seeking to hire a consultant to carry out a final
evaluation for its project DESA - “Gender Sensitive Village Planning and
Budgeting”. For this consultancy, Search Indonesia seeks to procure the
services of an independent, external consultant(s) to design, plan and conduct
a rigorous project final evaluation. The objective is to obtain a report on the
analysis and evaluation of the 36 months project on gender sensitive village
budgeting in Indonesia.
Background of the project
Search for Common Ground (SFCG) and co-applicant Institute for
Development and Economic Analysis (IDEA), propose a 36-month action entitled,
Gender Sensitive Citizen Budget Planning in the Indonesian Villages. The
initiative will support 9 local Civil Society Organisations (CSOs) in their
contribution towards reinforced local level governance and accountability in
Bogor District Lombok Barat and Tabanan Bali. By strengthening the capacity of,
providing support to, and promoting relationship building among the local CSOs
and citizens, the action will create an enabling environment to
institutionalised the active role of the CSOs in the local economic development
of the Indonesian villages.
The action draws from SFCG's international experience in
increasing citizen and civil society's participation in budgetary processes and
Public Finance Management (PFM) in ways that are away from adversarial
approaches. It also rooted in
IDEA’s expertise in promoting
public policies that respect economic, social, and cultural rights through
development planning and budget advocacy. As a core member of the action's
design, IDEA shares pivotal ownership of the proposed design. The local CSOs
are and will be at the forefront of the design and implementation of the
project, while SFCG will play a role in
adding international lessons learned for project methodology and management,
quality and compliance, and capacity building and cross-fertilisation.
SFCG and IDEA worked together to gain a deeper understanding of
PFM in the three-targeted districts and, to determine the extent to which the
citizens’ and CSOs’ lack of participation hinders their economic rights. This
included: (a) desk research on the issues and key themes related to PFM and (b)
consultations with a range of key state and non-state stakeholders. Further,
the action builds on a previous SFCG project funded by the EIDHR that
successfully increased women’s participation in local elections and civic life
in the target districts of this action. By engaging political parties across
gender divides during the previous project, SFCG learnt that gender inequality
is prevalent in all aspects of social, political, and economic life at the
village levels. Poor governance, especially in civic participation in public
budgeting, has resulted in an imbalance in the development for disadvantaged
groups, namely poor women and minority groups. Therefore, this action will
constructively engage women and men in gender sensitive planning processes that
will address gender inequality, poor governance, and poverty alleviation.
Background of the Organization
Search
is an international peacebuilding organization that strives to transform the
way the world deals with conflict, away from adversarial approaches; towards
collaborative problem-solving. Search has been working in Indonesia since 2002,
and works with governments, civil society, state institutions, youth, women,
media organizations and other stakeholder groups to promote peace,
reconciliation, tolerance, and collaboration across dividing lines.
Search,
in collaboration with local partners, supports the process of building peaceful
culture through media programming, dialogues, outreach activities, and capacity
strengthening. Search Indonesia works primarily with youth to prevent violent
extremism and religious intolerance as part of the challenges for peace and
tolerance in Indonesia.
Project
objectives
The overall objective
of the action is to enhance citizen involvement in gender sensitive budget
planning in local authorities at the village level.
The specific objectives of
the project are:
Objective 1: To increase the capacity of local Civil Society Organizations to
strengthen citizens participation in all phases of public budget processes in
a gender sensitive way;
Objective 2: To improve the capacity of citizens and local village leaders to
engage constructively in a gender sensitive, public budget process
Target groups
for the project:
a. CSO actors
Women and men in Indonesia
b. Local
village authorities
c. Citizens
(women and men) in target areas
The project
outputs and activities include the following:
- Citizen participation in public budget processes in 18 pilot villages in 3 districts: Tabanan in Bali, Lombok Barat NTB and Bogor District in West Java;
- 2 training module development workshops producing 3 modules
- 3 Training of Trainers (TOT) for 27 NGO personnel (9 per target area);
- Trainings for 54 women/men community members and local village leaders (3 trainings in 18 village target area);
- 3 local reflection forums (one mid-term per target area);
- 1 final national reflection meeting;
- Communications and public outreach and materials.
Objectives of
the Evaluation
Search
as an organization is committed to conducting evaluations for its projects in
order to maximize the effectiveness of its programming and engage in
continuous improvement and learning within programs and across the
organization. The evaluation will be
carried out in consultation and in participation with key relevant
stakeholders, appropriate community groups or key civil society individuals.
The final evaluation intends to measure the immediate impact of the project,
specifically whether the stated goal, objectives and results have been met..
Purpose of the
Evaluation
Accountability:
-
Provide
credible and reliable judgements on the programmes’ results, including in the
areas of programme design, implementation, immediate impact on beneficiaries
and partners, and overall results..
Provide high quality assessments accessible to a wide range of
audiences, including donors, women’s rights and gender equality organizations,
government agencies and other actors.
Learning:
-
Identify
novel/unique approaches to catalyze processes toward the development of gender
equality commitments.
-
Identify
particular approaches and methodologies that are effective in meaningfully and
tangibly advancing women’s economic and political empowerment.
Improved evidence-based decision making:
Identify lessons learned from the experience of grantees in order
to influence policy and practice at local and national levels. Inform and strengthen SFCG´s planning and
programming by providing evidence-based knowledge on what works, why and in
what context
Criteria and
Approach of the Evaluation
The
evaluation will analyze the relevance, effectiveness, efficiency,
sustainability and immediate impact of the project objectives in terms of
results achieved against objectives, change on human rights and gender
equality, ownership of stakeholders, sustainability of the action, both
financial and organizational.
No
|
OECD Evaluation Criteria
|
Specific Questions that Final Evaluation
will focus on
|
1
|
Relevance
|
1
Has the program intervened in impacting the significant issues in women’s lives?
How much does the program contribute to shaping women’s and/or minority groups priorities?
2
How well were the problems understood,
analyzed and strategies and actions developed thereby and thought through?
3
What further dimensions, strategies can
support to multiply the impact of program within Bogor, Tabanan and Lombok area, as well as to other areas?
4
In the evolving landscape, what is the significance of this program
and how the results meet the goals of women empowerment?
5
To what extent and in what ways did the
program contribute to the goals set by European Union in Indonesia?
|
2
|
Effectiveness
|
6
The program has adopted a cascade approach
for building an understanding of gender discrimination and patriarchy among
women. How effective has this approach been? What are the examples? Are
there alternative approaches used in different locations? What is the
experience there?
7
How effective has been the approach of
focusing upon enhancing women’s agency (women’s leadership within an
institutional framework) for bringing about change in different dimensions –
political, social, environment and economic.?
In the present and going into the future?
8
How well were the training programs and
accompaniment efforts designed / planned and have they contributed to the
achievement of the project goals? At the level of the team? Trainers? Women
groups?
|
3
|
Efficiency
|
9
What strategies have been adopted under the
program? Has there been coherence in the various strategies adopted by the
program?
10
Has the program been efficient in achieving
results as compared to the investments made? In what ways? What other
approaches could have been taken to maximize efficiency?
11
How adequate were the training program and
other inputs?
12
How does the program utilize existing local
capacities of state and non-state actors to achieve its outcomes?
|
4
|
Sustainability
|
13
What is the probability of the program
continuity at the level of the women groups in the village?
14
Would the CSOs anchoring the program sustain
beyond project period? How well are their institutions capacitated to
sustain this approach and understanding?
15
What is the probability of the project
results sustaining over a period of time? What are the reasons?
16
How does the younger members of the village
respond to the women’s rights agenda of the program? Are the older women
supportive of the younger women’s initiatives and concerns?
17
How does the village
governments respond to the gender equality agenda of the program? are they
supportive of the initiatives and concerns?
|
5
|
Immediate Impact
|
18
To what extent have
the objectives of the program been achieved? What have been the
immediate impact and the major achievements of the program? What have been
the gaps?
19
Have women’s issues become a part of the
discourse in the agenda of the village development plan and budgeting at
various levels? In what ways? What more needs to be done?
20
What is the immediate impact at the community
level beyond village development planning and budgeting? On duty bearers?
Public systems? On men? On informal community structures at the village and
societal level?
|
6
|
Partnership
|
21
How well has the partnership between SFCG,
partnered CSOs and related stakeholders worked in obtaining the results in
the project?
22
Is the partnership likely to continue beyond
the project period?
|
Additional
Questions for Evaluators apart from the Program mandate
1
How
well has the program been integrated into the operational processes of the
teams? What is the probability of the ethos and commensurate activities
thereof continuing beyond the project period? If yes, in what ways? What
support might be required to facilitate this process?
2
The
program has been mounted on existing social mobilization (group formation and
solidarity, livelihood promotion, leadership, democratic processes) in these
areas by the partnered CSO. What is the probability of achievement of these
results in an area without such investments?
3
What
are the changes produced by the program on legal and policy frameworks at the
local and national level?
The
evaluation will use methods and techniques as determined by the specific needs
of information, the availability of resources and the priorities of
stakeholders. The consultant is expected to identify and utilize a wide range
of information sources for data collection (documents, filed information,
institutional information systems, financial records, monitoring reports) and
key informants (beneficiaries, staff, experts, government officials and
community groups).
The
consultant is also expected to analyze all relevant information sources and
use interview and focus group discussions as means to collect relevant data
for the evaluation, using a mixed-method approach that can capture qualitative
and quantitative dimensions. The methodology and techniques (such as a case
study, sample survey, etc.) to be used in the evaluation should be described
in detail in the inception report and in the final evaluation report and
should be linked to each of the evaluation questions in the Evaluation Matrix.
The
methods used should ensure the involvement of the main stakeholders of the
program. State and non-state actors should be involved in meetings, focus
group discussions and consultations where they would take part actively in
providing in-depth information about how the program was implemented, what has
been changed in their status and how the program helped bring changes in their
lives. The evaluator will develop specific questionnaires pertinent to
specific group of stakeholders and their needs and capacities. When
appropriate, audio-visual techniques could be used to capture the different
perspectives of the population involved and to illustrate the findings of the
evaluation.
Methodology
The
Final Evaluation is intended to be a systematic learning exercise for SFCG and
European Union. The exercise is therefore structured to generate and share
experiences and practical knowledge gained from the implementation of the
Project activities. To achieve this,
the evaluation will take place in a consultative and participatory manner. It
is important to emphasize that the final evaluation is not conducted for the
purpose of measuring individual or institutional performance but for
validating the Project design and its effectiveness towards achieving the
results as set forth in the Project document. Based on the Consultation agreed
with the Partners, the Consultant will perform the following responsibilities
under this assignment:
a)
An
initial meeting of the Consultant with the SFCG and the partnered CSOs shall
be organized to get a briefing on the project, determine the scope and methods
and develop a feasible work plan.
b)
The
Consultant will conduct a desk review of relevant documents to feed into the
Inception Report with detailed scope of work and methodology including
sampling and data analysis framework with tools. The Inception Report should
detail the evaluators’ understanding of what is being evaluated and why,
contextualize the Framework of Evaluation Questions listed above to the
project, showing how each evaluation question will be answered by way of:
proposed methods; proposed sources of data; and data collection procedures..
The Inception Report should also include a proposed schedule of tasks,
activities and deliverables. The Inception Report should be around 10 pages in
length.
c)
The
Consultant will suggest and use methods and techniques as determined by the
specific needs of information, the availability of resources and the
priorities of stakeholders. The Consultant is expected to identify and utilize
a wide range of existing information sources for data collection (documents,
filed information, institutional information systems, financial records,
monitoring reports) and key informants (beneficiaries, staff, experts,
government officials and community groups).
d)
The
Consultant may use a mixed-method approach that can capture qualitative and
quantitative dimensions. The methodology and techniques (such as a case study,
sample survey, etc.) to be used in the evaluation should be described in
detail in the inception report and in the final evaluation report and should
be linked to each of the evaluation questions in the Evaluation Matrix.
e)
The
methods used should ensure the involvement of the main stakeholders of the
program. State and non-state should be involved in meetings, focus group
discussions and consultations where they would take part actively in providing
in-depth information about how the program was implemented, what has been
changed in their status and how the program helped bring changes in their
lives.
f)
The
Consultant will develop specific questionnaires pertinent to specific group of
stakeholders and their needs. When appropriate, audio-visual techniques could
be used to capture the different perspectives of the population involved and
to illustrate the findings of the evaluation. The Consultant/s will collect
Case Studies to reflect best practices from the project areas.
g)
The
Consultant will use the baseline and end line data collected under the program
to inform the analyses (project tracking system). Based on the findings from the Quantitative
and/Qualitative Tools, the Consultant will use the data to validate and
triangulate the information to review the impact of the program against the
Evaluation Framework mentioned above.
h)
The
Consultant will share the Draft Report and make a presentation on the key
findings to the SFCG and partnered CSO.
i)
Based
on the feedback from the presentation, the Consultant will finalize
the draft report.
Evaluation
Deliverables
The Consultant/s will be
expected to provide 25 working days of inputs over a period of 2 months,
starting from 1 July 2019 to 31 August 2019 The consultant is responsible for
submitting the following deliverables:
Deliverables
|
Descriptions
|
Schedules
|
Inception Report
|
This
report will be completed after initial desk review of program documents. It
will be 10 pages maximum in length and will include:
-
Introduction
-
Background
to the evaluation: objectives and overall approach
-
Identification
of evaluation scope
-
Main
substantive and financial achievements of the program
-
Description
of evaluation methodology/methodological approach (including considerations
for rights-based methodologies), data collection tools, data analysis
methods, key informants, an Evaluation Questions Matrix, Work Plan and
deliverables
-
Criteria
to define the mission agenda, including “field visits”
This
report will be used as an initial point of agreement and understanding
between the consultant, DM&E Indonesia Coordinator and Senior Regional
DM&E Specialist.
|
Within 3 days after the contract signing
|
Field Work
|
The
Consultant would need to cover 2 of the 3 districts covered under the
program. The field visits should cover interactions with community, women
collectives, local key stakeholders, SFCG team, partnered CSOs, and any other.
Approximately 10 days would be required to make the field visits.
|
Within 10 days after the inception report approval
|
Presentation of the preliminary findings
|
It will be presented after field work and meetings with
stakeholders and actors are completed.
|
1-day presentation (at least 2 days after the field work)
|
Final
Evaluation Report
|
It will be of a maximum length of 30 pages and will
include:
-
Cover Page
- Executive
summary (maximum 2 pages)
-
Program
description
- Evaluation
purpose and intended audience
- Evaluation
methodology (including constraints and limitations on the study
conducted)
-
Evaluation
criteria and questions
-
Findings
and Analysis
-
Conclusions
- Recommendations
(prioritized, structured and clear)
-
Lessons
Learnt
- Annexes,
including interview list, data collection instruments, key documents
consulted, etc.
An executive summary will include a brief description of
the program, its context and current situation, the purpose of the
evaluation, its intended audience, its methodology and its main findings,
conclusions and recommendations. The Executive Summary should “stand alone”
and will be translated to ensure access by all stakeholders if needed.
A draft final report will be shared for final validation. The
final report will be approved by the Senior Regional DM&E
Specialist.
|
Within 11 days after finding presentation.
|
Duration & Deadlines
The duration of the contract will
be a total period 25 working days to begin 1 July to 31 August 2019 The
consultant will negotiate final dates and deadlines with the Search Indonesia
DM&E Coordinator.
Logistical Support
SFCG will provide preparatory and logistical assistance to the
evaluator, which include:
●
Background materials (project proposal, implementation plans,
progress reports, reflection notes, minutes of meetings, etc)
●
Quantitative and qualitative documentation of project activities.
●
List of potential Interviewees (and their contact information)
for KIIs and FGDs
●
Technical assistance with the review and approval of tools and
reports.
Travel and Meeting arrangements with stakeholders and
beneficiaries
The evaluation will be conducted by an individual consultant managed by the Search DM&E Indonesia Coordinator with technical oversight form Senior Regional DM&E Specialist.
Evaluator’s Competencies
Education:
-
A
Masters or higher level degree in International Development or a similar field
related to political and economic development, gender, etc.
Work
Experience:
-
A
minimum of 3 years’ relevant experience undertaking evaluations is required;
this must include expertise in undertaking gender-sensitive and human rights
based evaluations.
-
Sound experience working in the areas of
gender, and women’s economic and/or political empowerment is necessary.
-
Substantive
experience in evaluating similar development projects related to local
development and political and economic empowerment of women is required.
-
Substantive
experience in evaluating projects with a strong gender focus is preferred.
Language
Requirements:
-
Excellent
English writing and communication skills are required. The consultant(s) need
to be able to write strategic and concise reports, based on evidence and
data.
How to apply:
Individual
is required to submit a proposal of maximum 3 pages, which must include the
following items:
-
Summary
of consultant experience and background.
-
List
of the most relevant previous consulting projects completed, including a
description of the projects and contact details for references.
-
Brief
summary of the proposed methodology for the evaluation, including the
involvement of the Reference Group and other stakeholders during each
step. Proposed process for
disseminating the results of the evaluation.
-
CV
for consultant.
-
At
least 2 sample reports from previous consulting projects (all samples will be
kept confidential) or links to website where reports can be retrieved (highly
recommended).
-
Proposed
daily professional fee
All interested
and qualified candidates are requested to submit all of the above mentioned
documents to phandayani@sfcg.org cc to mrismayani@sfcg.org by 28 June
2019
No comments:
Post a Comment