Data Quality Assessment (DQA) Consultant at Social Impact

Responsibilities and Tasks

With technical guidance and oversight from the ELMI DCOP, the consultants will be responsible for the following tasks:

• Desk Review: The DQA Consultants will review relevant project documents; the Activity Monitoring, Evaluation and Learning Plan (AMELP); Indicator Performance tracking tables; IP quarterly reports; and USAID Standard or Custom indicator lists and definitions, among other documents, to inform tool development and identify issues to be covered in the subsequent steps of the DQA process.
• Inception meeting with USAID staff: The consultants will participate in an inception meeting with USAID Activity managers and program office staff to level expectations on the DQA process. The inception meeting(s) will also include the implementing partners and sub-partners, where applicable.
• Development and/or finalization of data collection tools and protocols: The consultants will develop all the required data collection tools and protocols for the DQA. This may also entail reviewing and customizing existing data collection protocols and checklists.
• DQA training/sensitization: The consultants will conduct brief training or sensitization session for both USAID staff and IPs on the DQA process and data collection tools.
• Data Collection: The DQA Consultants will conduct primary data collection and verification and administer a system assessment protocol both at the IP and sub partners’ level. They will also conduct site visits to selected primary data collection sites. Please note that non-Somalis are not allowed to travel outside Mogadishu International Airport (MIA) and the consultant will be required to work with qualified DQA assistants to complete the data collection outside MIA.
• Debrief meeting with IP and USAID: At the end of the data collection exercise, the consultants will undertake a debrief for the relevant IP and USAID staff to share any emerging issues from the DQA process.
• Data Analysis: The DQA Consultant will lead analysis and writing of findings. They will oversee the review of each indicator against the five quality standards and complete a DQA checklist for each indicator. The analysis should also demonstrate any identified discrepancies in the assessed indicators.
• Documentation and Reporting: The DQA Consultants will draft and submit a detailed DQA report to ELMI using a template to be provided. The report will: (i) outline the overall approach and methodology used in conducting the DQA; (ii) present findings in terms of the five data quality standards for each indicator; (iii) summarize recommendations for improving data quality; and (iv) include a completed DQA checklist for each of the indicators. A final report incorporating all comments and feedback from the IP, USAID and ELMI will be submitted at the end of the exercise.
• Validation and Dissemination of findings and recommendations: The Consultants will share preliminary findings and recommendations with the IP for validation before sharing with USAID. S/he will also develop an action plan, that will be discussed and agreed upon with the IP and USAID, to address the identified gaps. The action plan should also include a timeframe for completing the agreed actions.
• Supervisory Responsibility: The consultants will supervise DQA Assistants who will be engaged separately by SI to support field-level data collection.

Qualifications:

• Master's degree in social sciences, international relations, economics, statistics, and/or any other relevant field from a recognized university.
• Minimum ten years’ experience in monitoring and evaluation in USAID context.
• Ability to work with and lead teams.
• Demonstrated experience planning and implementing rigorous DQAs of USAID indicators.
• A firm grasp of USAID ADS 201 policy and requirements on DQAs.
• Technical knowledge in democracy, stabilization and governance (DSG), economic growth (EG) or health sectors will be an added advantage.
• Ability to diplomatically communicate and work effectively with a wide range of stakeholders, including USAID IPs.
• Strong analytical and writing skills, with proven experience in synthesizing and analysing data into summarized reports and findings.
• Excellent English writing skills and speaking ability.
• Basic written and oral proficiency in Somali is desired.
• Good understanding of Somali operating environment or conflict affected and fragile states.
• Willingness and ability to travel to Mogadishu, Somalia as needed.