Josh S.

Freelance Quality Assurance & AI Content Reviewer

Neosho, United States

Experience

Jan 2020 - Present
5 years 11 months

Freelance Quality Assurance & AI Content Reviewer

Outlier AI, TELUS International, DataForce (TransPerfect), Remotasks (Scale AI)

  • Evaluate and enhance AI-generated text, image, and multimodal output for accuracy, coherence, and compliance with complex project guidelines.

  • Identify hallucinations, factual inaccuracy, or cultural bias in LLM responses, and provide fairness and context validity.

  • Apply complex rubrics and rating scales to provide consistency and reliability in datasets.

  • Provide concise, actionable feedback to peers and assist in driving continuous quality-standard iteration.

  • Collaborate with Project Managers and QA Leads in iterating evaluation criteria, prompt engineering, and data-quality pipelines.

  • Active participation in Discord and cross-team channels for the resolution of ambiguous cases and developing guideline consistency.

  • Registered a 98%+ reviewer accuracy rating on numerous large-scale Generative AI projects.

  • Received linguistic comprehension and excellence in moral judgment awards from Outlier AI and TELUS project managers.

  • Supported various fine-tuning model initiatives that trended toward safer and context-aware AI systems.

Jan 2019 - Dec 2021
3 years
United States

Lecturer & Training Facilitator (Part-Time)

Community College

  • Instructed undergraduate students in academic writing, communications, and research techniques.
  • Developed and evaluated course work that focuses on clarity, originality, and academic honesty.
  • Organized digital literacy training sessions introducing students to AI-assisted writing software.
  • Supported student engagement through feedback-based instruction and open dialogue.
Jan 2017 - Dec 2020
4 years

Academic Writer & Research Consultant

Freelance

  • Researched, edited, and proofread academic papers, dissertations, and research reports on behalf of overseas clients.
  • Had expertise in topics ranging from Engineering, Business, Technology, and Social Sciences.
  • Implemented rigorous quality controls to ensure accuracy, consistency, and compliance with referencing conventions (APA, MLA, Harvard).
  • Trained and mentored junior writers on academic writing, critical thinking, and plagiarism prevention.
  • Performed evidence-based critique of research, an activity directly transferable to analytical AI quality analysis.

Summary

Analytically driven and detail-oriented English Language Specialist with more than seven years of experience in AI testing, linguistic quality assurance, and academic research. Skilled at analyzing and enhancing multimodal AI outputs—including text, image captions, and prompts—to ensure accuracy, coherence, and cultural appropriateness.

I have worked with Outlier AI, Remotasks (Scale AI), TELUS International, and DataForce (TransPerfect) on large LLM and Generative AI projects, developing prompt analysis, annotation, and fine-tuning testing. These collaborations enhanced my expertise in human-in-the-loop quality control, bias detection, and ethical AI assessment.

Merging an English and Information Systems background with practical experience in AI model testing, I merge sharp attention to linguistic nuance, contextual accuracy, and guideline precision to help shape reliable, responsible AI systems.

Languages

English
Native

Education

Oct 2016 - Jun 2018

Virginia International University

Master of Science · Information Systems Management · United States

Oct 2012 - Jun 2016

Old Dominion University

Bachelor of Arts · English & Communication Studies · United States

Certifications & licenses

AI Prompt Engineering & Ethical AI Evaluation

Coursera

Certified Quality Assurance Professional (CQAP)

American Society for Quality

Professional Editing & Proofreading Certification

Chartered Institute of Editors and Proofreaders (CIEP)

Need a freelancer? Find your match in seconds.
Try FRATCH GPT
More actions