Otieno (Quinton) F.
AI Agent Evaluation Analyst
Experience
Jan 2024 - Present
1 year 11 monthsKenya
AI Agent Evaluation Analyst
Freelance
- Reviewed and scored AI reasoning tasks and scenarios for logical coherence, completeness, and realism.
- Identified inconsistencies, missing assumptions, and vague decision points in evaluation workflows.
- Defined expected behaviors (gold standards) and annotated reasoning chains and cause-effect relationships.
- Collaborated with QA and developers to refine prompts, improve test coverage, and reduce model bias.
- Evaluated LLM responses for accuracy, relevance, and reasoning quality across multiple domains.
Jan 2024 - Present
1 year 11 monthsKenya
Conversational Content & Digital Engagement Assistant
Freelance
- Created instructional prompts and dialog flows for automated and human-AI interaction systems.
- Ensured tone consistency and clarity in AI-generated conversational scripts.
- Supported testing and optimization of language-based interaction frameworks.
Jan 2023 - Present
2 years 11 monthsKenya
AI Content & Annotation Specialist
Freelance
- Annotated image, video, and text datasets following structured guidelines and labeling frameworks.
- Reviewed and refined AI model outputs for accuracy, clarity, and logical soundness.
- Participated in quality assurance and calibration rounds to ensure inter-annotator consistency.
- Produced metadata and contextual documentation for AI model training and testing.
Jan 2023 - Present
2 years 11 monthsKenya
Freelance Research & Technical Writing Support
Freelance
- Authored structured documentation and technical guidelines for AI and automation workflows.
- Translated complex processes into readable, logically sequenced content.
- Supported knowledge-base development and consistency checking.
Summary
Analytical AI Evaluation & Annotation Specialist with hands-on experience training and assessing Large Language Models (LLMs) and structured datasets. Skilled in identifying logical inconsistencies, improving prompt clarity, and defining high-quality labeling and evaluation standards. Adept at reasoning through complex scenarios, reviewing AI-generated content, and producing structured feedback that improves model behavior. Passionate about contributing to research-driven AI model development and evaluation.
Languages
English
AdvancedSwahili
AdvancedSpanish
IntermediateItalian
ElementaryEducation
Maseno University
Bachelor of Science · Computer Science · Kenya
Kisii School
Kenya
Need a freelancer? Find your match in seconds.
Try FRATCH GPT More actions
Similar Freelancers
Discover other experts with similar qualifications and experience
- English
- Deutsch
2025 © FRATCH.IO GmbH. All rights reserved.