I Final Evaluation (end of project)
Project Title: “Innovations in EE and RE for better adaptation to climate change and
poverty reduction EE phase III“
CACH project number: p220056
II Project proposal writing
Working name of the project: Fight against climate change, energy-induced poverty, and promotion of energy efficiency, renewable energy sources and related competences across BiH entities in support of a just green transition.
Envisaged consultancy for evaluation duration: 26/02/2025 – 26/03/2025 Envisaged consultancy for pro. proposal duration: 05/03/2025 – 26/03/2025. Envisaged number of days: 19 days
Deadline for submission of the final evaluation report 26/03/2025 Deadline for submission of the final project proposal: 26/03/2025
Country: Bosnia and Herzegovina
Context
Caritas Switzerland (CACH) has a long tradition of engagement in Bosnia and Herzegovina (BiH). In its strategy, CACH has chosen Climate Change as its area of action in BiH. Following a multi-stakeholder approach, with this project CACH sought to turn existing energy problems into opportunities: The idea was not to view alternative energy as a separate sector. It was planned to develop potential feedback and feed-forward links with the economy, local authorities and local communities through an integrated ap- proach to the development of renewable energy sources that raises awareness, provides knowledge and introduces innovative technology at the same time. This also included pilot-innovative interventions that were implemented through the Energy Service Company (ESCO) model, which is still quite innovative for BiH, and could offer a suitable model for this country. Considering the problem of inadequate representa- tion of topics related to EE and RES, CACH implemented a series of trainings for secondary vocational schoolteachers on these topics who will transfer the newly acquired knowledge to their students. Recog- nizing the need for qualified workers in this sector, CACH implemented with partners the launch of a new profession in two cantons in the FBiH.CACH helped local municipal structures and authorities’ social welfare offices protection, bring strategic plans fights against energy poverty, in mitigating increases of energy prices.
I Final evaluation:
1. Purpose and Objectives of the Final Evaluation
- General Objective of the Final Evaluation
The evaluation will be conducted by an external and independent consultancy. The purpose of the final evaluation is to assess the project against its defined outcomes and results. The final evaluation should as- sess the project design, activities and results in terms of their relevance, efficiency, impact, effectiveness
and sustainability. The final evaluation will serve as a learning opportunity for Caritas Switzerland (CACH) and inform the final report to donors. The evaluation should consider the relevance of the chosen approaches and methods, assess the capacities and performance of the partner organisations involved and identify the challenges faced by the project. It should also provide recommendations for the next phase of the project and the expansion of the project and define the necessary adjustments in the planning of activi- ties and the management structure, considering the strategic framework of CACH, as well as potential contributions donors.
1.2. Time Period and Components Covered
The Consultant will evaluate the entire implementation period and all three project components: energy poverty, raising public awareness and innovation in the field of renewable energy, and improved availabil- ity of qualified workers for energy efficiency and renewable energy sources.
1.3. Strategic Objective of the Project
The intended impact of the project is to reduce carbon emissions through improved energy efficiency and renewable energy sources and to raise the level of knowledge and skills in secondary vocational schools in the project area, as well as to assist local institutions in combating energy poverty in the Tuzla, Posavina, ZEDO Cantons of the FBiH as well as in Bijeljina, RS.
1.4. Scope, Focus and Key Questions for the Consultant Scope and focus of the evaluation:
The Evaluation must cover all components. It should be conducted through a combination of remote work and in field mission in Bosnia and Herzegovina. It should include interviews and interactions with all rele- vant actors, stakeholders, authorities, academia / researchers as well as Caritas Switzerland staff (CACH). In particular, the evaluation needs to provide clear and concise answers on the following key aspect:
I. Relevance:
The degree to which the objectives are in line with the requirements of the beneficiaries, the needs of the country, the policies of the partners, as well as the policies of the donors.
II. Effectiveness:
The extent to which objectives have been achieved or are expected to be achieved, considering their rela- tive importance.
III. Efficiency:
Are resources/inputs (funds, expertise, time, etc.) converted into outputs in an economically viable man- ner?
IV. Outcomes and Impact:
Positive and negative, primary and secondary long-term effects of an intervention, produced directly or indirectly, intended or unintended.
V. Sustainability:
The continuation of benefits from a development intervention after the main development assistance has ended. The likelihood of continued long-term benefits. The resilience of net benefit flows to risks over time.
Key Evaluation Questions:
- Has the project achieved its main objectives?
- Are the project results in line with the defined goal?
- What were the main challenges in promoting energy efficiency and renewable energy at the level of individual households, communities and public institutions?
- What were the challenges in implementing the education of secondary vocational schoolteachers, and especially in creating a new profession?
- Have the adopted local strategies to combat energy poverty contributed to bringing this problem into focus and to what extent have they contributed to increasing the implementation of activities at the local level?
- What lessons have been learned and what can be done to ensure sustainable project results?
- Were the selected indicators SMART and what can be improved regarding the monitoring and evaluation (M&E) setup in the future phase of the project?
1.5. Methodology and Approach
Regarding the methodology, the consultant will use a standard project evaluation methodology consisting of the following stages:
1. Preparatory Study
Analysis of all relevant documentation (project proposal, periodic reports of partner organizations, interim reports) to produce a short inception report that details the approach, agenda, methodol- ogy, sample, timeframe for fieldwork and necessary logistical arrangements. At the same time, develop an evaluation matrix that summarizes the key evaluation questions (2 working days).
2. Field Phase
Data collection from the most important stakeholders – CACH, partner organizations, relevant ministries and educational institutions – through semi-structured interviews lasting 50–60 minutes with key informants at selected project locations (4 working days).
- The Consultant will prepare and moderate the Final Evaluation Workshop, which will be broadly structured as follows:
- SWOT analysis of the project
- Assesment of alignment between achievements and objectives/outcomes/results
- Identification of good practices and lessons learned
- Recommendations for a possible future project
- Formulation of conclusions
Participants in the final evaluation workshop will be key stakeholders (representatives of collaborating and co-financing ministries, collaborating educational institutions and the project team) (1 working day).
4. Data Analysis, Coding and Interpretation of collected evidence
Will be prepared to present a draft of the final evaluation report within 10 days after the workshop Caritas will have two weeks to review the draft of the final evaluation report and provide its con- solidated comments to the consultant. (2 working days).
5. Finalization of the Final Evaluation Report (1 working day).
- Results
- Evaluation matrix with key evaluation questions.
- Initial briefing session with CACH staff in Sarajevo before the start of the mission.
- Formulation of conclusions by the consultant.
- Submission of draft report after completion of mission. Caritas will have the opportunity to review and comment on the draft report before its finalization.
- A properly edited final evaluation report in English, presenting the results as defined in the ToR, not exceeding 20 pages. Includes a summary of no longer than 2 pages, presentation of findings, conclusions, lessons learned and recommendations, structured in a logical sequence (recommen- dations derived from conclusions, conclusions based on facts and findings).
1.7 Documentation
The Consultant will receive all relevant documentation, including the project proposal, logical framework and reports.
1.8. Place, Time, Task Duration and Resources
The final evaluation of the project will be carried out in the period from 26.02.2025 to 26.03.2025. The total task should be completed within 10 working days, including all field visits covering Tuzla, Posavina and ZEDO Cantons, FBiH as well as in Bijeljina, RS:
| Activities | Duration in days | FROM | TO |
| Preparatory study | 2 | 26.02.2025 | 05.03.2025 |
| Field phase | 4 | 06.03.2025 | 18.03.2025 |
| Final evaluation workshop (including preparation and docu- mentation for follow-up activities) | 1 | 19.03.2025 | 21.03.2025 |
| Data analysis, coding and interpretation of collected evidence, submission of draft final evaluation | 2 | 21.03.2025 | 25.03.2025 |
| Finalization of the final evaluation | 1 | 25.03.2025 | 26.03.2025 |
II Project proposal writing:
In consultation with CACH BiH and based on evaluation findings and recommendations as well as on the outcomes of a project development workshop to be hosted by CACH BiH, the consultant will draft a pro- posal for a follow-up project. The project will address just green transition, the fight against energy-in- duced poverty and the promotion of energy efficiency and renewable energy sources and related compe- tences across the BiH entities. The project proposal will have to be submitted in English language, not ex- ceeding 20 pages, complying with donors’ standards, including following sections (not exhaustive):
- executive summary (max 1 page)
- background & context analysis, needs assessment
- intervention rationale
- project description & implementation plan per each component
- elaboration on key stakeholders & partners
- risk analysis & risk mitigation
- sustainability
- methods & minimal standards
- monitoring, steering, evaluation plan
- logical framework & activity plan
CACH BiH staff will provide input and will be consulted during proposal drafting. All relevant documents will be provided by CACH BiH.
2.11 Deadline
The deadline for writing the proposal for the new Energy Efficiency (EE) project is 26.03.2025. The task will take place between 05.03.2025 and 26.03.2025, with a total duration of 9 working days covering all necessary activities.
2.9 The main activities in the framework of the development of the project proposal:
| Activities | Duration in days | FROM | TO |
| Initial workshop to prepare project proposal writing (including prep- aration and documentation for follow-up activities) | 1 | 05.03.2025 | 07.03.2025 |
| Analysis, interpretation and elaboration of the collected proposals, submission of draft project proposal | 4 | 07.03.2025 | 17.03.2025 |
| Workshop for presenting draft project proposal | 1 | 18.03.2025 | 20.03.2025 |
| Finalization of the project proposal | 1 | 21.03.2025 | 24.03.2025 |
| Presentation of the project proposal | 1 | 24.03.2025 | 26.03.2025. |
| Working on any corrections after submitting the project proposal | 1 | 26.03.2025 |
III. General information
3.1 Documentation
The consultant will receive all relevant documentation including reports, proposals and previous estimates.
3.2 Process
- CACH will engage the consultant directly.
- CACH will organize meetings with the relevant contacts in agreement with the consultant.
- The consultant will analyse all collected data. Immediately after the field visits and data anal- yses, the consultant will prepare a preliminary evaluation report and recommendations.
3.3 Confidentiality
- Documents and data collected during conversation will be consider confidential and used solely for analyses. Respondents will not to be quoted in reports without theirs express permissions.
- The report and its findings are intellectual property of CACH. It will be used exclusively by CACH, and it will not be published publicly. However, on special request, results of these evalua- tions can be made available to interested third parties.
- Approval of the final reports is the basis for contracted payment compensation.
4. Mandate
The evaluation and proposal writing needs to be carried out under the mandate of CACH: CACH, Country office Bosnia and Herzegovina
Anna Goos, Country Director
Travnička 1, 71000 Sarajevo, Bosnia and Herzegovina Phone: +387 33 210 704
Web: www.caritas.ch / https://www.facebook.com/caritasswitzerlandinBiH
Based on these ToRs, a contract will be concluded between the consultant and CACH. In the exe- cution of this task the consultant will use own resources/materials and computer. The consultant is responsible for the own insurance and safety but adheres to security rules and regulations of CACH in BiH.
5. Qualifications of the consultant
- Experience in monitoring and evaluating projects, especially those related to energy efficiency, education and sustainable development.
- Ability to analyse data and reports related to EE, RES and energy poverty.
- Relevant professional knowledge and understanding of technologies and measures for improving EE and implementing RES.
- Understanding the problem of energy poverty and strategies to reduce it.
- Understanding the need for curriculum modernization in secondary vocational schools and knowledge of methods for implementing new professions.
- Knowledge of the context of Bosnia and Herzegovina or the Balkans is a precondition.
- Knowledge of the relevant laws, regulations and policies at local, regional and international levels.
- Excellent oral and written English; knowledge of the local language an advantage
5.1 Selection criteria
These selection criteria aim to ensure rigorous assessment proposal, emphasizing robustness plan and methodology, financial prudence, team expertise, relevant passed experiences and contextual understanding of the economic landscape development in the region.
Weight of the criteria:
| Criteria | Weight |
| Plan and Methodology of the Evaluation | 30% |
| Financial offer | 20% |
| Competency | 30% |
| Previous Experiences in project monitoring (preferably in energy, education and sustainable development) | 20% |
6. Standards and content of the offer
The evaluation shall be carried out in compliance with the OECD/DAC Quality Standards for Development Evaluation: Evaluation Criteria – OECD
The proposal should encompass the following components:
- Technical proposal: should include comprehensive service details which are offered, stating methodology, approach and included activities.
- Financial proposal: This section should contain information of daily prices, including interna- tional travel, accommodation, translation services and every other need necessary for implementa- tion of the evaluations. In addition, it should state banking data and account information for pay- ment. Specify is offer filed by individual or company. Financial offers need to be delivered in KM (Bosnian convertible mark).
- Curriculum Vitae (CV): Please deliver biography of individuals or members of the team which will conduct evaluation.
- Experience in projects funded by international donors (e.g. EU, UNDP, GIZ).
- Working samples of previous evaluation and analysis related to similar topics need to be in- cluded as reference.
- Additionally, candidates are required to submit Statement of compliance with the exclusion cri- teria, properly filled out and signed, on English or Bosnian language.
The proposal needs to be valid during duration of the evaluation, which is expected to take place in the period February – March 2025. The final version of the Evaluation must be submitted by March 26, 2025, while the final version of the Project proposal needs to be submitted until March 26, 2025.
Please submit your application by sending it to the official Caritas Switzerland email addressbih@caritas.ch no later than 23 February 2025