Dibogoh G. - AI Evaluator / AI Data Quality Analyst

Go to Website

Nairobi, Kenya

Experience

Oct 2025 - Nov 2025

2 months

AI Evaluator / AI Data Quality Analyst

Samasource (Sama AI)

Evaluated large language models (LLMs) and AI system outputs for accuracy, relevance, coherence, safety, and factual consistency.
Designed, executed, and reviewed AI evaluation tasks and prompt test cases to measure natural language understanding, generation quality, and contextual alignment.
Conducted side-by-side comparisons and scoring of AI responses, improving model reliability, fluency, and overall user experience.
Performed text, image, and video data annotation to train NLP, computer vision, and generative AI models.
Ensured high-quality labeled datasets by applying rigorous QA methods, achieving >98% annotation accuracy across multiple projects.
Identified and reported data anomalies, bias patterns, and hallucinations to enhance fairness and factual integrity of AI systems.
Collaborated with cross-functional AI research and engineering teams to refine evaluation rubrics, feedback loops, and data labeling standards.
Managed large-scale datasets using internal platforms, ensuring consistency, completeness, and ethical compliance.
Assisted in AI model fine-tuning and validation, contributing insights for improved performance and human-like reasoning.
Maintained precise documentation and communicated insights to data scientists and ML engineers for iterative improvements.
Enhanced AI model accuracy and reliability through systematic human evaluation and continuous feedback integration.
Reduced annotation error rates by 20%, improving dataset quality for machine learning training.
Recognized as a Top Performer and Quality Rater for maintaining consistent scoring accuracy and project completion efficiency.
Supported multilingual and multimodal AI projects, ensuring cultural, linguistic, and semantic accuracy.
Contributed to AI bias mitigation and fairness initiatives by identifying systemic errors and recommending corrective measures.

Aug 2025 - Sep 2025

2 months

Lorem ipsum dolor sit amet

RWS Group

Collaborated with international AI research teams to train and refine large-scale language and vision models through data annotation, evaluation, and linguistic analysis.
Performed fine-grained text, image, and video annotations for natural language processing (NLP), computer vision (CV), and speech recognition models.
Executed data labeling, categorization, and validation tasks ensuring high-quality datasets for supervised and reinforcement learning pipelines.
Conducted AI model evaluations, assessing accuracy, fluency, relevance, and factual consistency for LLMs and generative AI systems.
Applied prompt engineering and test case design for AI evaluation — contributing to model alignment, ethical compliance, and improved user experience.
Maintained rigorous quality assurance standards, surpassing client accuracy benchmarks (>97%) across multiple annotation projects.
Worked within agile project management frameworks using task management tools like Jira, Slack, and internal QA dashboards to streamline workflows.
Collaborated in cross-functional teams, providing feedback loops that informed data strategy and model retraining efforts.
Supported the development and fine-tuning of AI models powering chatbots, search engines, and image recognition systems used globally.
Achieved recognition as a Top Performer on multiple annotation projects for consistency, precision, and turnaround time.
Improved dataset quality by identifying and resolving data integrity issues, reducing annotation error rates by 15–20%.
Contributed to multilingual NLP projects, ensuring cultural and linguistic accuracy across diverse datasets.
Assisted in AI bias detection and mitigation, helping enhance model fairness and inclusivity.

Jul 2024 - Aug 2025

1 year 2 months

Kenya

Monitoring, Evaluation, Accountability, Research & Learning Specialist

Women of Hope Abled Differently

Spearheaded the design of robust MEAL plans across health and protection programs, enhancing impact tracking and learning.
Integrated gender and disability inclusion into all program cycles (planning, implementation, monitoring, and reporting), ensuring a survivor-centered and inclusive approach.
Conducted GESI and safeguarding training for over 200 community healthcare workers, frontline responders, and grassroots organization staff.
Led a coalition of 20 grassroots organizations to advocate for disability-inclusive policies, influencing county governments to adopt three new policies on equitable access to water, energy, and healthcare.
Championed the design of conflict-sensitive monitoring indicators and AGD-disaggregated data systems for refugee and vulnerable populations.
Developed and implemented safeguarding protocols for GEDSI projects, reducing incidents of exclusion and violence against women and persons with disabilities by 60%.
Led research synthesis on SGBV and sexual/reproductive health in crisis settings, producing over 10 policy briefs.
Supervised field data collection activities and mentored community healthcare workers on data tools.
Conducted accessibility audits and research synthesis on SRHR/GBV, producing policy briefs.
Supported strategic reviews and aligned work plans with donor requirements, contributing to program design and adaptation.
Managed study data, ensuring confidentiality and compliance with protocols.
Designed detailed workplans and field budgets; monitored expenditures and reconciled budgets weekly.
Recruited, trained, and mentored field teams; delivered in-person training and competency assessments.
Implemented a data management plan with encrypted data transfers and secure storage of consent forms.
Conducted preliminary data cleaning, produced analytic summaries, and collaborated with analysts to prepare draft results.
Prepared project progress reports and dissemination briefs for donors and stakeholders.
Managed escalation and resolution of field challenges, ensuring ethical compliance.
Improved data quality across 50 facilities through routine DQAs, CQI mentorship, and SQL-based validation checks.
Conducted spot-checks and accompanied interviewers for ethical consenting and accurate probing.
Conducted over 15 field assessments and qualitative interviews for health and WASH programs in Kajiado County.
Piloted a mobile-based AGD data collection system for HIV/GBV/SRHR programs.
Facilitated intergenerational dialogues on SRHR, breaking cultural taboos at the community level.
Developed activity-based annual work plans aligned with donor requirements and organizational objectives.

May 2023 - Jun 2024

1 year 2 months

Kenya

MEAL Officer

African Development and Emergency Organization (ADEO)

Aligned project M&E frameworks with MEARL policy, improving logical frameworks and KPIs for HIV and GBV programs.
Aligned M&E procedures with DCED standards, slashing reporting delays by 25%.
Achieved 95% data completeness across supported Kajiado County health sites through mentorship visits.
Partnered with county governments to distribute 5,000 IEC materials, improving hygiene practices in 20 drought-affected villages.
Generated quarterly reports for Kenya Red Cross, highlighting a 30% increase in oral health hygiene adherence.
Conducted 15 field assessments to identify water scarcity risks, informing rainwater harvesting design for 10 schools.
Supported sustainability assessments and strategy adaptations to improve long-term outcomes.
Mentored 20 health facilities on MoH tools, elevating data completeness from 75% to 95%.
Piloted a mobile-based AGD data collection system for HIV/GBV/SRHR programs.
Organized child protection and PSEA network meetings; led mapping of service providers to strengthen referral pathways.
Collaborated with health and nutrition teams to integrate WASH into maternal health initiatives, reducing infections by 25%.
Facilitated safeguarding and PSEAH awareness training for over 200 staff, volunteers, and partners.
Conducted safeguarding risk assessments and developed mitigation strategies.
Established and managed a secure complaints reporting and tracking mechanism.
Submitted detailed reports on trainings, complaints, and activities to management and donors.
Conducted regular field monitoring visits and data quality audits to ensure fidelity and high-quality data.

Oct 2017 - Jun 2019

1 year 9 months

Cartographic Mapping Agent

Kenya National Bureau of Statistics

Led GIS mapping for the 2019 Kenya Census and trained peers in digital mapping technologies.
Successfully mapped and delineated census enumeration areas, ensuring comprehensive coverage and accuracy.
Collected and verified geographic and demographic data, contributing to reliable and precise maps.
Utilized GIS technology to capture, store, analyze, and manage spatial data.
Worked collaboratively with local authorities, community leaders, and stakeholders to gather essential information and ensure community engagement.

Dec 2015 - Sep 2017

1 year 10 months

Kenya

Health Records & Information Officer

University of Maryland Global Initiative

Implemented HIPAA-compliant audits, resolving over 1,200 duplicate records via Excel.
Entered patient data from clinical encounters, laboratory results, and pharmacy dispensations into KenyaEMR for HIV, TB, GBV, and STIs.
Ensured all mandatory paper-based and electronic registers were updated and consistent with the EMR.
Assigned and tracked unique identifiers to prevent duplicate records and ensure patient continuity of care.
Conducted daily and weekly data quality checks within KenyaEMR to identify and correct errors.
Ensured data consistency across KenyaEMR, physical registers, and MOH summary reports.
Performed thorough data quality audits on all reports before submission to Sub-County M&E or DHIS2.
Compiled and submitted all mandatory MOH and NASCOP reports within deadlines.
Entered aggregated facility data into the national DHIS2 platform.
Generated specific data reports for clinical teams, facility management, and partners.
Prepared and presented performance data during facility CQI meetings.
Used data to identify improvement areas and tracked CQI intervention effectiveness.
Trained and mentored new clinical staff on M&E tools and their importance.
Served as the facility's first point of contact for KenyaEMR troubleshooting and ensured adequate supplies of M&E tools.

May 2014 - Dec 2015

1 year 8 months

Kenya

HMIS Assistant

KEMRI/CDC

Supported design of M&E systems, data quality assessments, dashboards, and stakeholder reporting for health programs under CDC standards.
Enhanced HMIS by implementing and optimizing electronic data collection and management systems.
Performed regular DQAs to ensure accuracy, completeness, and consistency of health data.
Identified and resolved data discrepancies to improve reliability of health information.
Contributed to research by analyzing health program data to identify trends and opportunities for improvement.
Documented and disseminated lessons learned and best practices to foster continuous learning.
Trained health facility staff and program partners on HMIS and MEARL tools and methodologies.
Developed training materials and conducted workshops on data quality, reporting, and electronic health information systems.

Summary

Results-driven Monitoring, Evaluation, Accountability, Research, and Learning (MEARL) Specialist with 6+ years of proven success in designing robust M&E systems, driving evidence-based programming, and strengthening data systems across humanitarian, health, and development sectors.

AI Data Trainer and Model Evaluator with 3+ years of experience improving large language model performance through high-quality annotation, prompt evaluation, and RLHF workflows. Skilled in NLP, data quality assurance, and ethical AI development. Adept at using Python and annotation platforms to create reliable, bias-aware datasets. Data Specialist with proven experience in evaluating large language models (LLMs), annotating complex datasets, and improving machine learning performance. Skilled in natural language processing (NLP), data labeling, prompt evaluation, and model assessment. Demonstrated success in enhancing data accuracy, AI fairness, and output reliability for top-tier clients. Adept at working in fast-paced, remote environments with global AI development teams.