Canada: Request For Proposals - GREAT Baseline Study

To access the full RPF Document, please click here.

1.0 RIGHT TO PLAY

Right To Play is an international humanitarian organization that uses the transformative power of sport
and play to promote the holistic development of children and youth in the most disadvantaged areas
of the world. Right To Play is committed to improving the lives of children and young people and to
strengthening their communities by translating the best practices of sport and play into opportunities
to promote learning, health and peace.

Right To Play programs foster healthy physical, social and emotional development of children and build
safer and stronger communities. Right To Play’s guiding principles are inclusion – which recognizes
the importance of children who may be marginalized for reasons of gender, ability/disability, religion,
ethnicity, or social background; child protection and safeguarding; and sustainability – which ensures
lasting impact.

As such, Right To Play is seeking a consultancy firm/group to undertake the baseline study for one of
its multi-country education programs including the development of an evaluation framework design;
the review, refinement and/or development of instruments; fieldwork administration and logistics
plan; data collection, review and cleaning; data analysis; reporting; and dissemination documents. This
will include the writing of any and all accompanying reports as specified in the key deliverables.

2.0 PROGRAM OVERVIEW

The Gender Responsive Education and Transformation (GREAT) program is a complex initiative that
aims to directly address the learning needs of children and youth through a five-year quality education
program in three countries: Ghana, Mozambique, and Rwanda. From 2018 to 2022, the GREAT
program endeavours to improve quality education for girls and boys at the primary school level through
a sustainable and replicable child-centred, play-based learning model. Right To Play will contribute to
this ultimate outcome through focused interventions at the school, community and policy level that
will result in:

• Increased integration of gender-responsive play-based learning by teachers into teaching
  practice
• Increased engagement of parents and caregivers in addressing gender-specific learning
  needs of girls and boys, including at-risk children
• Increased adoption of gender-responsive play-based learning in in-service and pre-service
  teacher training

3.0 OBJECTIVES

The primary objectives of the baseline study are as follows:

• To produce a rigorous evaluation framework design, including an analytical framework, which
  can be used for the midline and endline evaluations;
• To review, refine and/or develop reliable and valid survey and research instruments for
  measurement;
• To identify the starting points for the GREAT project’s intended outcomes;
• To inform the development of realistic and achievable targets that are grounded within the
  local context;
• To inform organizational strategic learning and continuous improvement in order to
  strengthen capacity to carry out quality program design, implementation, and monitoring and
  evaluation in the future.

4.0 EVALUATION OVERVIEW

The baseline study for the GREAT program will be conducted within the anticipated timeline of March
2018 to September 2018.

The initial part of the baseline study will involve a comprehensive review of all existing GREAT
program, monitoring, and evaluation plans including the logic model, performance measurement
framework, and measurement tools. This review is expected to lead to recommendations for
appropriate outcomes and indicators toward the development of an evaluation design framework.
The initial review will be followed by the development of a robust evaluation framework design using
the OECD/DAC and AfrEA criteria for evaluating development assistance with relevant research
questions, a rigorous sampling methodology and review, refined and/or draft measurement
instruments to be piloted during the training of data collectors and enumerators. The sampling
methodology should include both baseline and endline sample size calculations to enable meaningful
statistical testing at the endline, taking into account expected sample attrition rates. A fieldwork/data
collection administration and logistics plan will be developed and implemented in the three countries
of implementation, ensuring collaboration with and capacity building of Right To Play country teams.
Travel will be required and the consultancy team will be required to develop a robust data collection
strategy in three countries as well as ensure the ability to source, hire and train (as needed)
enumerators, research assistants, and/or associates with the ability to collect large amounts of
qualitative and quantitative data. Right To Play staff are expected to be integrally involved in the
planning process where we will provide the required logistical support at country level to support data
collection activities and also collaborate with the consultancy team to ensure capacity building for staff
(e.g. Right To Play MEL Officers will need to be involved/trained by the consultancy team in their data
analysis processes, participate in data collection training and be privy to the overall data analysis
framework). The consultancy team should be mindful of this during planning.

The final part of the baseline study process will consist of the collection, review, cleaning and
analysis of the data collected and drafting of the multi-country and country-level reports. The consultancy team must also produce relevant dissemination documents (presentation slides) and a
dissemination plan at the global and country levels.

For further details please reference the key deliverables section.

5.0 LOCATION

The evaluation framework design process is expected to be carried out at the consultants’ base, with
significant collaboration with the Right to Play Monitoring, Evaluation and Learning team in Toronto.
Should the consultant not be based in Toronto, face to face meetings will be required, and as such,
travel will be expected. For the field work and data collection, extensive in-country travel is expected
to all three implementing countries (Ghana, Mozambique and Rwanda). The evaluation findings
dissemination period may also require travel to these countries, but this is to be confirmed.

6.0 METHODOLOGY

The first part of the consultancy will involve a document review of the GREAT measurement
framework and its accompanying tools; desk research and literature review; and engagement with
the program team in order to produce a quasi-experimental evaluation design/framework that will be
used for the baseline and that will serve as the key reference for the endline evaluation, particularly
with regards to sample size. Any revisions to the performance measurement framework must feed
into the evaluation design/framework and where possible, sample sizes will be calculated using a
95% confidence level and confidence interval of 5. The sample sites, samples and groups proposed
should enable calculation of statistical significance at both the baseline and endline, as such, they
should account for potential future attrition as these same sample characteristics will be used at the
endline. Where relevant, sample selection criteria may also need to be developed. As noted, in
depth-engagement with relevant teams at Right To Play will be required to produce an evaluation
framework which will enable the program to produce critical, rigorous evidence in order to tell its
story in a meaningful way.

The second part of the consultancy will involve the planning and implementation of the baseline
study that will enable the program to understand its starting point, from a measurement perspective.
As the field work will occur in the countries of implementation, the consultancy is expected to
collaborate significantly with Right To Play country teams in order to successfully conduct the field
work.

The final part of the consultancy is the analysis of the data collected and the production of the
baseline reports and appropriate dissemination documents, incorporating and integrating feedback
from relevant Right To Play staff.

Through significant, collaborative engagement with relevant staff at Right To Play, particularly the
Monitoring, Evaluation and Learning team, it is expected that the consultancy will strengthen the
organizations’ M&E capacity, particularly in the development and implementation of sound, rigorous
research activities. As such, the consultancy will be expected to share and contribute to the Right To
Play’s knowledge-base while deepening the capacities of the organization to more effectively
conduct research in the future.

Data Collection Tools

The evaluation design framework will consist of a toolkit with relevant, appropriate tools to measure
progress on the outcomes selected and to adequately answer the research questions posed. Existing
tools will undergo a critical review and revision while new ones will be developed. The following is a
(non-exhaustive) list of tools that will need to be revised/developed:

• Teacher Literacy and Numeracy Assessments
• Teacher Motivation Assessment
• Teacher Observation
• Teacher Coaching and Mentoring Assessment
• Life Skills Assessment
• Student Literacy and Numeracy Assessments
• Interview Guides (stakeholders and beneficiaries)
• FGDs (children, parents, community members, other stakeholders)
• Children’s KAP
• Parents’ KAP
• School Development Plan Review Guide
• School/Classroom Environment Review Guide
• School Records Guide (for attendance, promotion and performance)

The baseline planning process will entail an in-depth training of enumerators and data collectors which will include piloting of the instruments to ensure satisfactory reliability and validity. Tools will be subsequently refined after training and prior to going to the field. High consideration will be given to firms who have implemented data collection using mobile tools and software.

Data Analysis

Data will be analyzed both quantitatively and qualitatively and will cover all areas described in
Section 7 below “Areas of Focus.” Moreover, an analytical framework will be submitted as part of the
evaluation design process which will detail the specific analytical methodology that will be used to
produce the result for each indicator measured and each research question posed. The consultant
will engage significantly with the Right To Play team to determine and agree on these.

The consultant is encouraged to utilize analytical software to analyze both the quantitative (e.g.
Excel, SPSS, STATA, R), and qualitative (e.g. NVIVO) data. Outputs from data analysis will be
submitted as part of the deliverables, as will the scripts (or list of commands) with clear
notes/guidance, particularly for quantitative data analyzed (in SPSS, STATA, R).

7.0 AREAS OF FOCUS

*To be determined once key indicators have been decided. A Performance Measurement Framework can be shared with shortlisted applicants*

8.0 GENERAL CONDITIONS OF THE CONSULTANCY

Steering Committee

A steering committee of key implementation stakeholders (i.e. Right To Play country, regional and
global staff) will be formed to guide and inform the research process. They will help to inform the
relevance and appropriateness of the evaluation design framework, the data collection tools and the
analytical framework. They will also help to ensure that the research planning and data collection
processes are sound, culturally appropriate and contextually relevant to Right To Play’s
programmatic needs and to the needs of all relevant stakeholders (i.e. beneficiaries, community
members and partners).

Measurement Plan

The measurement plan adheres to the Global Affairs Canada GREAT program performance
measurement framework (PMF) and uses a results-based management approach for tracking the
progress of outputs and outcomes against targets.

Consultancy Expectations

• The consultancy firm/group will have an orientation to Right To Play’s program delivery model;
• A validation meeting will be organized at country level with Right To Play staff, key partners and key beneficiaries (children, parents, teachers for example) for further analysis andinterpretation of the findings to inform the first draft of the baseline report
• The data analysis and draft reports will be shared with Right To Play with sufficient time to allow for Right To Play to review and provide feedback, which will be incorporated into subsequent work;
• After the completion of the baseline report,a presentation will be given to Right To Play staff and appropriate stakeholders to share both results and recommendations;
• Throughout each phase, the consultancy firm/group will be expected to maintain regular communications with Right To Play regarding progress;
• Travel and accommodations for visits to Right To Play intervention countries will be coordinated, booked and paid for by Right To Play as outlined in an agreed upon work plan;
• The consultancy firm/group must follow OECD-DAC and AfrEA principles for evaluation;
• All materials, processes, methodologies, reports, plans and other works provided to the consultancy firm/group or developed by the consultancy firm/group on behalf of Right To Play remain the property of Right To Play;
• All data must be stored in a safe and secure location, allowing full access to Right To Play staff during the evaluation process;
• Upon completion of the evaluation, all raw data must be submitted to Right To Play

9.0 ROLES & RESPONSIBILITIES (SUMMARY)

The consultancy firm/group will report directly to Emily Kere, Director, Monitoring, Evaluation and
Learning at Right To Play International, and all deliverables should be submitted to her according to
the schedule outlined in the “Key Deliverables and Timeline” section below.

The consultancy firm/group’s roles and responsibilities include, but are not limited to, the following:Background research to familiarize themselves with the GREAT program and Right To Play’s approach (i.e. program documents provided by Right To Play);
Document review of program, monitoring and evaluation plans, including logical models, performance measurement frameworks, and tools;
Development of the evaluation design/framework in collaboration with the Right To Play International Steering Committee;
Submission of a comprehensive inception report for validation prior to field work commencement.
Development and implementation of a fieldwork/data collection administration and logistics plan in the three countries of implementation
Data collection, entry & cleaning, and analysis
Data validation and interpretation through internal review of findings;
Completion of final reports;

Preparation and presentation of findings and recommendations

10.0 PROPOSED BUDGET AND PAYMENT SCHEDULE

Consultants are asked to provide a draft budget proposal along with their proposal for consideration.
Right To Play International offers competitive consultancy rates in keeping with market value and
international NGO standards.

First payment: After signing of contract agreement with Right To Play (10%)

• Second payment: Submission of evaluation framework design (including draft analysis framework) and relevant instruments (15%)
• Third payment: Submission of analyzed data appropriate for PMF entry (40%)
• Fourth payment: Submission of draft reports (15%)
• Final payment: Submission of final reports, PowerPoint presentations and final analysis framework approved by Right To Play (20%)

11.0 QUALIFICATIONS

• A consultancy firm/group with at least 7-15 years of experience in the research and/or evaluation field, including experience in quantitative and qualitative data collection, analyzing quantitative and qualitative data, and report writing;
• Extensive experience creating measurement frameworks, refining indicators, and creating measurement tools for education focused programs
• Extensive experience managing and designing evaluation studies in a diverse contexts (e.g. within multi-country contexts, with children and young people, in remote settings, etc.);
• Extensive experience in international education at the primary levels;
• Experience in life skills measurement and behavioural change measurement;
• Experience using participatory methodologies and following OECD-DAC and AfrEA principles for evaluation and measurement;
• Applicant should have a relevant degree in social sciences, international development, statistical sciences, or another related field;
• Excellent skills and experience with data analysis using statistical computing tools (Excel,SPSS, STATA, NVIVO);
• Excellent working proficiency in English

Interested organizations are requested to submit proposals including the following documents:

• Cover letter/expression of interest
• A complete profile of the firm/organization/group, highlighting previous experience and expertise in areas listed in the “Qualifications” section detailed in the above section;
• CVs of any other key team members who will be the part of the Multi-phased evaluation team
• Two writing samples, ideally reports the firm/organization/group has lead authorship on

The Proposal must be submitted no later than Monday March 12th, 2018 to Emily Kere, Director, Monitoring, Evaluation and Learning at: ekere@righttoplay.com, with Sarah Johnson, Monitoring, Evaluation and Learning Officer in copy at: sjohnson@righttoplay.com.

Proposals will be accepted on a rolling basis and will be reviewed as soon as they are received. Earlysubmissions are encouraged and Right To Play reserves the right to select a consultancy before theproposal submission date noted above.

While we thank all applicants for their interest, only those selected for interviews will be contacted.
Right To Play is a child-centered organization. Our recruitment and selection procedures reflect our
commitment to the safety and protection of children in our programs.

To learn more about how we are and what we do, please visit our website at www.righttoplay.com.