Evaluation and Learning Consultant, BPPS/SIU

Location : Home Based

Application Deadline : 19-Oct-21 (Midnight New York, USA)

Time left : 16d 1h 53m

Type of Contract : Individual Contract

Post Level : International Consultant

Languages Required :
English

Starting Date :
(date when the selected candidate is expected to start) 01-Nov-2021

Duration of Initial Contract : 4 months

Expected Duration of Assignment : 4 months

UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.

UNDP does not tolerate sexual exploitation and abuse, any kind of harassment, including sexual harassment, and discrimination. All selected candidates will, therefore, undergo rigorous reference and background checks.

Background

In line with the priorities expressed in UNDP’s Strategic Plan 2018-2021, embracing innovative practices is a foundation for the next generation UNDP. Innovation refers both to UNDP’s capacity to renew its own programmatic approach to respond to rapid changes in the external environment and to UNDP being able to bring relevant transformational capabilities to government counterparts. The Strategic Innovation Unit (SIU) leads the process of embedding innovation in UNDP’s performance, working closely with other parts of the GPN, Regional Bureaus, Country Offices and other internal and external stakeholders.

The UNDP Innovation Facility has acted as a catalyst mechanism to promote innovation in programmatic approaches in UNDP since 2014. Reflections over its implementation during the 2014-2018 period and changes in the organization led to a repositioning of the Innovation Facility in 2019. The updated business model aims to introduce a new investment logic nestled within a broader approach of directional systems innovation, striving to identify frontier issues and apply multiple parallel experiments to systemic issues. With the strategic intent of deploying capital with transformative effects, the Innovation Facility is adopting a portfolio approach to a select number of strategic risks identified as game changers and started supporting a selection of UNDP Country Offices in 2019 to design and implement portfolios to tackle systemic issues. This is done through so-called Deep Demonstrations (https://medium.com/@undp.innovation/deep-demonstrations-the-journey-begins-34bf063477bf). This model is an experimental endeavor – a first for the UNDP and the SIU. Therefore, its immediate primary objective is to generate learning to inform future cohorts of Deep Demonstration investments.

Duties and Responsibilities

SCOPE OF WORK, RESPONSIBILITIES AND DESCRIPTION OF THE PROPOSED ANALYTICAL WORK

Overall, this assignment is intended to help the Innovation Facility explore evaluation approaches that are suitable for dealing with complex challenges, that are coherent with system thinking, and able to inform ongoing adaptation. This translates into the dual objectives of i) documenting spin-offs from the Facility and ii) improving the learning from and evaluability of the Facility. In this context, the consultant will be expected to develop and deploy sound methodological methods in all aspects of the assignment with a view to generate rigorous and useful evidence that supports learning about whether and how changes has happened in the first cohort of investments made by the implementation phase of the innovation facility, building on existing secondary evidence and additional primary data collection. Based on this, the consultant will offer recommendations for approaches and methods well suited to support monitoring and evaluation of efforts dealing with complex challenges, that are coherent with system thinking, and able to inform ongoing adaptation.

Expected outputs and deliverables:
Under the overall guidance of the Innovation Facility Manager, the Consultant shall deliver the following outputs:

Deliverable 1: Inception brief. Submission date: 3 weeks after contract signature.

Produce inception report which frames and defines the methodological approach and key parameters of the evaluative exercise. This includes methodology for data collection, identification, and analysis of spin-off case studies as well as approach and plan for evaluability assessment. Spin-offs are efforts within or beyond UNDP that pick up and apply system transformation capabilities, approaches or discourse co-developed by the Innovation Facility in other policy areas or organizational contexts. This is done in collaboration with SIU staff, EOI representative, and CO representatives.

a. This will be based, but not limited to, an in-depth desk review of existing documentary materials on the Innovation Facility, its investments, and consultations with the direct stakeholders of the Innovation Facility (SIU, implementing partners, country office management and relevant staff). The deliverable should include preliminary observations, definition and refinement of the evaluation approach (including methodology, sample/case selection, process, and initial protocols) as well as an agreed set of evaluation questions such as i) whether and how Innovation Facility investments and other efforts have helped create change internally in UNDP (e.g. in shape of spin-offs/replication); ii) what factors (organizational, country contextual, etc.) that have shaped whether and how change happened; and iii) what monitoring, evaluation and learning frameworks and practices that are most suitable for real-time monitoring, learning, adaptation, and evaluation of the Innovation Facility.

b. Throughout the assignment we highly welcome alternative thinking. For instance, we encourage the consultant to suggest innovative and alternative methodological approaches for delivering the assignment.

Deliverable 2: Identify, analyze, evaluate, and document spin-offs. Submission date: 3.5 months after contract signature.

Report with studies produced on the selected cases, evidencing: i) that / what changes have happened, ii) how the change came about, iii) the role/contribution of IF support, iv) key factors (contextual and other) shaping whether and how change happened. The deliverable should include:

a.Clear presentation of the methodological approach including limitations

b.Development and facilitation of a consultation plan with relevant stakeholders of the innovation facility on the key findings of the study to (i) gather comments, potential factual errors, and omissions; (ii) generate new insights based on the results of the report. Feedback and results of these consultations should be used to finalize the report.

Under this deliverable the consultant will be required to deploy the approach developed and validated during the inception phase to conduct an evaluation of whether and how the Innovation Facility has contributed to change (in the form of so-called spin-offs), including:

a. Identify 8-10 spin-off cases. Case selection should be methodologically sound, potentially deploying methods such as Outcome Harvesting or Most Significant Change. We encourage the consultant to suggest innovative and alternative methodological approaches for delivering the assignment, without being restricted to Outcome Harvesting or Most Significant Change approaches.

b.Case selection should be done with a view to generate useful learning about whether and how change happens in relation to generation and deployment of systems capabilities and approaches at the Country Office level.

c.Cases should constitute instances of spin-offs within UNDP as well as spin-offs outside of UNDP.

d.At least 4 cases should be included of potential spin-offs generated by efforts not directly supported by the IF (so-called self-starter Country Offices).

e.Draw on a variety of existing primary and secondary data and evidence (qualitative and quantitative). We encourage the consultant to use a broad and eclectic mix of structured and unstructured data.

f. Undertake primary data collection (from remotely) via interviews and/or Focus Group Discussions with country office staff and other stakeholders. The consultant is encouraged to suggest and deploy other appropriate forms of primary data collection.

g. Deploy rigorous analytical/evaluate methods for establishing how change has happened and the role played by IF support (such as, but not restricted to, process tracing)

h. Undertake a comparison of cases to distill insights about key factors (contextual and other) shaping whether and how change happened in the cases

Deliverable 3: Produce learning and evaluability assessment and recommendations. Submission date: 4 months after contract signature.

Drawing on the conduct of the spin-off study, literature review, and additional data collection and analysis the consultant will be requested to produce a paper:

a. Summarizing evidence, lessons, and current thinking relevant for the Innovation Facility as it relates to monitoring, evaluation, learning, and adaptation in the areas of social innovation, dynamic portfolio management and adaptive programming based on recent literature and experiences from low and middle income countries.

b. Reviewing the information/data generated by and otherwise accessible to the Innovation Facility for M&E and learning purposes. This includes not only ‘hard’ quantitative M&E data, but the variety of qualitative and quantitative information (incl. anecdotal) that the Innovation Facility and country offices can draw on for monitoring, evaluation and learning purposes (incl. any existing data systems at country level, ATLAS, etc.).

c. Review the IF’s existing MEL framework and practices with a view to offer recommendations for how the IF/SIU may broaden, optimize and otherwise strengthen this, including its generation, capture, storage, analysis, and use of qualitative and quantitative (systematic and anecdotal) data that allows (or improves conditions) for real-time learning, adaptation, and evaluation of the Innovation Facility. In this connection we strongly encourage alternative thinking on approaches and methods well suited to support monitoring and evaluation of efforts dealing with complex challenges, that are coherent with system thinking, and able to inform ongoing adaptation.

The deliverable will cover ‘a’, ‘b’, and ‘c’ above, with key recommendations for i) the IF/SIU, ii) country offices, iii) other UNDP Business Units. The deliverable includes:

a. Additional consultations and socialization events within UNDP in coordination with the IF Manager (at least 3 events)

b. A section providing findings of the evaluability assessment and drawing from the conduct and results of the spin-off study, highlighting key assets, gaps, limitations, and opportunities in the present configuration of the Innovation Facility’s MEL system and tools.

c. Review of the IF’s MEL framework and practices with clear and practical recommendations aimed at supporting the achievement of Innovation Facility objectives as well as recommendations for how the Innovation Facility / SIU may strengthen its monitoring, evaluation and learning (incl. data generation and knowledge management) framework and practices to produce, capture, and make sense of data and evidence that allows (or improves conditions) for monitoring, learning, adaptation, and evaluation exercises to be undertaken.

Expected deliverables and payment schedule

Deliverables/ Outputs

Target Due Dates

Review and Approvals Required (Indicate designation of person who will review output and confirm acceptance)

% of payment

Inception brief delivered

3 weeks after contract signature

IF Manager

20% of total contract value

Report with studies produced on spin-offs

3.5 months after contract signature

IF Manager

40% of total contract value

Learning and evaluability assessment delivered

4 months after contract signature

IF Manager

40% of total contract value

Competencies

Demonstrates commitment to the UN’s values and ethical standards

Promotes the mission, vision and strategic goals of UNDP

Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability

Treats all people fairly and with impartiality.

Required Skills and Experience

Academic qualifications:
University degree (or equivalent) in monitoring and evaluation, international development, or other relevant field is required.

Experience:
Track record undertaking M&E functions and/or in leading the conduct of large/complex evaluations is required.

Minimum of five (8) years of progressively responsible performance in the area of monitoring and evaluation in an international development setting is required.

Familiarity with advanced research and evaluation methods such as outcome harvesting and process tracing is required.

Work experience in developing and least developed countries is an asset.

Familiarity with UN/ UNDP is essential.

Familiarity with developmental evaluation preferred.

Experience in a UN/UNDP country office preferred.

Prior experience in the conduct of evaluations and research in the area of social innovation in the context of multilateral organization and/or international development will be considered as an asset.

Language:
Fluency in written and spoken

Proficiency in Spanish, Arabic and/or French desirable.

Application Procedure

The application package containing the following (to be uploaded as one file):

A cover letter with a brief description of why the Offer considers her/himself the most suitable for the assignment.

Personal CV or P11, indicating all past experience from similar projects and specifying the relevant assignment period (from/to), as well as the email and telephone contacts of at least three (3) professional references.

Note: The above documents need to be scanned in one file and uploaded to the online application as one document.

Shortlisted candidates (ONLY) will be requested to submit a Financial Proposal.

The financial proposal shall specify a total lump sum amount, and payment terms around the specific and measurable deliverables of the TOR. Payments are based upon output, i.e. upon delivery of the services specified in the TOR, and deliverables accepted and certified by the technical manager.

The financial proposal must be all-inclusive and take into account various expenses that will be incurred during the contract, including: the daily professional fee; (excluding mission travel); living allowances at the duty station; communications, utilities and consumables; life, health and any other insurance; risks and inconveniences related to work under hardship and hazardous conditions (e.g., personal security needs, etc.), when applicable; and any other relevant expenses related to the performance of services under the contract.

This consultancy is a home-based assignment, therefore, there is no envisaged travel cost to join duty station/repatriation travel.

In the case of unforeseeable travel requested by UNDP, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between UNDP and Individual Consultant, prior to travel and will be reimbursed. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources.

If the Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under a Reimbursable Loan Agreement (RLA), the Offeror must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP.

The Financial Proposal is to be emailed as per the instruction in the separate email that will be sent to shortlisted candidates.

Evaluation process

Applicants are reviewed based on Required Skills and Experience stated above and based on the technical evaluation criteria outlined below. Applicants will be evaluated based on cumulative scoring. When using this weighted scoring method, the award of the contract will be made to the individual consultant whose offer has been evaluated and determined as:

Being responsive/compliant/acceptable; and

Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation where technical criteria weighs 70% and Financial criteria/ Proposal weighs 30%.

Technical evaluation – Total 70% (70 points):
Criteria 1: Years of experience with and track record undertaking M&E functions and/or in leading the conduct of large/complex evaluations. Weight = 20%; Maximum Points: 20;

Criteria 2: Familiarity with advanced research and evaluation approaches and methods (e.g. developmental evaluation, contribution tracing). Weight = 20%; Maximum Points: 20;

Criteria 3. Professional experience in developing and least developed countries as well as with UN/UNDP. Weight = 10%; Maximum Points: 10; and

Having reviewed applications received, UNDP will invite the top three shortlisted candidates for interview. Please note that only shortlisted candidates will be contacted.

Interview: Weight = 20%; Maximum Points: 20.

Candidates obtaining a minimum of 70% (49 points) of the maximum obtainable points for the technical criteria (70 points) shall be considered for the financial evaluation.

Financial evaluation – Total 30% (30 points)

The following formula will be used to evaluate financial proposal:

p = y (µ/z), where

p = points for the financial proposal being evaluated

y = maximum number of points for the financial proposal

µ = price of the lowest priced proposal

z = price of the proposal being evaluated

Contract Award

Candidate obtaining the highest combined scores in the combined score of Technical and Financial evaluation will be considered technically qualified and will be offered to enter into contract with UNDP.

Institutional arrangement

The consultant will work under the guidance and direct supervision of under the direct supervision of the IF Manager based in UNDP’s Headquarters in New York. The consultant will be required to directly conduct consultations with the IF Manager, other SIU staff, country office staff in UNDP, and other relevant partners.

The Consultant will be responsible for providing her/his own laptop.

Payment modality

Payments are based upon output, i.e. upon delivery of the services specified above and deliverables accepted and upon certification of satisfactory completion by the manager.

The work week will be based on 35 hours, i.e. on a 7-hour working day, with core hours being between 9h00 and 18h00 daily.

Annexes (click on the hyperlink to access the documents):
Annex 1 – UNDP P-11 Form for ICs

Annex 2 – IC Contract Template

Annex 3 – IC General Terms and Conditions

Annex 4 – RLA Template

Any request for clarification must be sent by email to [email protected]

The UNDP Central Procurement Unit will respond by email and will send written copies of the response, including an explanation of the query without identifying the source of inquiry, to all applicants.

Apply Now
To help us with our recruitment effort, please indicate your email/cover letter where (vacanciesinsyria.com) you saw this job posting.

Leave a Comment

Your email address will not be published. Required fields are marked *