Project details
Recommended projects
AI Agent Evaluation Analyst (m/f/d)
We are looking for an Freelance Agent Evaluation Analyst to take ownership of quality, structure, and insight across the project. This role goes far beyond task-checking - it’s about critical thinking, systems-level analysis, and ensuring clarity, reliability, and consistency at scale. You’ll work as both a hands-on evaluator and an analyst, collaborating with domain experts, delivery managers, and engineers. Beyond reviewing outputs, you’ll be expected to understand the “why” behind the work, identify logical gaps or inconsistencies, and propose meaningful improvements.
This is a flexible, impact-driven role where you’ll have space to grow, contribute ideas, and help shape how evaluation and quality are scaled across the project.
This role is especially well-suited for:
Analysts, researchers, or consultants with strong structuring and reasoning skills Junior product managers or strategists curious about AI and evaluation work Smart problem-solvers (students or early-career professionals) who enjoy digging into logic, systems, and edge cases
You do not need a coding background. What matters most is curiosity, intellectual rigor, and the ability to evaluate complex setups with precision.
What you’ll be doing
- Fully own the QA pipeline for agent evaluation tasks;
- Review and validate tasks and golden paths created by scenario writers and experts;
- Spot logical inconsistencies, vague requirements, hidden risks, and unrealistic assumptions;
- Provide structured feedback and ensure quality alignment across contributors; Train, onboard, and mentor new QA team members;
- Collaborate with domain experts, delivery managers, and engineers to improve test clarity and coverage;
- Maintain and improve QA checklists, SOPs, and review guidelines;
- Contribute to test planning, prioritization, and quality benchmarks;
- Take initiative to suggest new approaches, tools, and processes that help scale validation and analysis.
Freelance AI Consultant (German) (m/w/d)
For our client, we are looking for a German-speaking AI consultant:
As a consultant, you may be invited to take part in online projects to train the model in your area of expertise.
This flexible role suits both experts seeking part-time work (minimum of a few hours per week) and those interested in full-time opportunities.
Responsibilities:
- Carefully review provided data (text, images, or videos).
- Review tasks submitted by the development team and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
- Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.
Freelance AI Consultant (Japanese) (m/f/d)
For our client we are looking for a Japanese speaking AI consultant:
As consultant, you may be invited to take part in online projects to train the model in your domain of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities.
Responsibilities:
- Carefully review provided data (text, images, or videos).
- Review tasks submitted by the developer team and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
- Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.
Test Manager (m/f/d)
The development and quality assurance of the data layer includes its complete provisioning through the respective web application. The data layer forms the central data foundation for analyzing user behavior and for personalized content during the website visit. To increase reliability and stability, automated tests should be used to significantly reduce manual regression tests. For this task, a Test Automation Engineer with a focus on Playwright (Elastic) is needed.
- Development and implementation of automated end-to-end tests with the npm package @elastic/synthetics (Playwright) for data layer tests.
- Analysis of existing test processes, identification and prioritization of automation potentials.
- Creation, maintenance, and optimization of test scripts considering current best practices.
- Integration of automated tests into existing CI/CD pipelines (e.g., Jenkins, GitHub Actions) to enable continuous test automation.
- Documentation of test cases, test results, and test coverage in tools like Jira and Confluence.
- Advising stakeholders on the selection and introduction of appropriate test strategies, test tools, and frameworks.
- Conducting code reviews for test automation scripts to improve quality and maintainability.
- Preparing decision templates and recommendations for action to further develop test automation.
- Providing advice on error analysis and resolution within test automation.
- Consulting on setting up reports and alerting with Elastic Observability.
- Promoting traceability and reproducibility of test results.
Freelance AI Consultant (Korean) (m/f/d)
For our client we are looking for a Korean speaking AI consultant:
As consultant, you may be invited to take part in online projects to train the model in your domain of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities.
Responsibilities:
- Carefully review provided data (text, images, or videos).
- Review tasks submitted by the developer team and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
- Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.
Freelance Consultant - AI Training (Portugese-Speaking)
For an AI lab we are looking for a Portugese speaking freelance consultants to train an AI model (Large Language Model - LLM) in various domains:
You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities
Responsibilities:
- Carefully review analyze provided data by AI in your domain of expertise.
- Improve the model in your domain of expertise.
- Review AI results and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
New
AI Evaluation Consultant (m/w/d)
We are seeking an analytical and technically-minded professional to:
- Evaluate AI outputs and processes
- Ensure quality, accuracy, and reliability
- Identify logical errors, risks, and structural inconsistencies
- Provide actionable insights and recommendations to the team
Ideal candidates:
- Consultants, auditors, analysts, data researchers, or business/technical analysts with strong reasoning skills
- Professionals curious about AI, process improvement, and quality evaluation
- Problem-solvers who enjoy analyzing complex systems, logic, and scenarios
Key Responsibilities:
- Lead evaluation of AI outputs and related processes
- Review tasks against expected/ideal scenarios; identify gaps and risks
- Provide structured, actionable recommendations to engineers, domain experts, and managers
- Maintain and improve evaluation guidelines, checklists, SOPs
- Suggest new approaches, tools, and processes to enhance AI evaluation
Freelance Data Annotator (Spanish) (m/f/d)
For an AI studio we are looking for a Spanish speaking data annotation specialist:
Annotation is what helps AI make sense of the world. As a QA Annotator, you may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities
Responsibilities:
- Carefully review provided data (text, images, or videos).
- Review tasks submitted by the Annotators team and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
- Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.
Freelance AI Consultant (Chinese) (m/f/d)
For our client we are looking for a Chinese-speaking AI consultant:
As a consultant, you may be invited to take part in online projects to train the model in your area of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum a few hours/week) and those interested in full-time opportunities.
Responsibilities:
- Carefully review provided data (text, images, or videos).
- Review tasks submitted by the developer team and ensure quality assurance/quality control.
- Label or classify content based on project guidelines.
- Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.
Project Manager Brand Guardianship (m/f/d)
The service is requested as part of the Brand Image Pool photoshoot project. The project includes:
- Managing sub-tasks throughout the entire image pool shoot project from January to June
- Taking on brand guardianship tasks during the pool shooting project period
- Detailed service description without reference to individuals:
- Independently defining, managing, and executing the project. This ranges from project management to creating roadmaps and project presentations
- Developing ideas and concepts for measures
- Actively managing project risks
- Actively handling project issues including professional advice on escalations
- Preparing and following up on stakeholder and steering board meetings
- Defining project scope and main project phases
- Providing transparent and appropriate information to the client regarding scope, quality, schedule, budget, and status
AI Agent Evaluation Analyst
For an AI lab we are looking for AI Agent Evaluation Analyst to train an AI model (Large Language Model - LLM).
You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities
- Reviewing evaluation tasks and scenarios for logic, completeness, and realism.
- Identifying inconsistencies, missing assumptions, or unclear decision points.
- Helping define clear expected behaviors (gold standards) for AI agents.
- Annotating cause-effect relationships, reasoning paths, and plausible alternatives.
- Thinking through complex systems and policies as a human would to ensure agents are tested properly.
- Working closely with QA, writers, or developers to suggest refinements or edge case coverage.
Freelance Physics Expert (with Python) - Quality Assurance / AI Trainer
Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills.
Although every project is unique, you might typically:
- Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Physics, while also developing references and examples of tasks.
- Experts Acquisition: Assess the qualification tests of experts, ensuring their competency.
- Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines.
- Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.
Magazine Production Project Manager (m/f/d)
- Responsibility for coordinating and managing the entire production process of magazine publications
- Planning and monitoring issue structure, deadlines, advertisements, and workflows
- Close collaboration with editorial team, publishing management, marketing, sales, printers, technical, and service providers
- Quality assurance of layouts, texts, and print approvals
- Cost estimation and organization of additional products (e.g., inserts, posters, supplements)
- Active role in strategic projects, conferences, and in launching new formats
Freelance AI Trainer - Writers (English) (m/w/d)
An AI Lab is seeking professionals experienced in working with tests to join their innovative team as English AI Trainers. The role involves crafting and editing texts, as well as evaluating AI-generated replies to ensure quality and accuracy. This position is ideal for individuals with expertise in writing, editing, and analyzing content, particularly in the context of AI and language models. As part of a cutting-edge AI lab, you will contribute to the development and refinement of advanced AI systems.
This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time.
Key responsibilities:
- Craft and edit high-quality texts tailored to specific requirements.
- Evaluate and analyze AI-generated replies for accuracy, relevance, and quality.
- Collaborate with teams to improve AI language models and content generation processes.
- Provide feedback and suggestions to enhance AI performance.
- Conduct research to ensure content aligns with industry standards and user expectations.
Freelance Java Developer (m/w/d)
For an AI lab we are looking for Java Developer to train an AI model (Large Language Model - LLM).
You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise.
This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities.
- Code generation and code review
- Prompt evaluation and complex data annotation
- Training and evaluation of large language models
- Benchmarking and agent-based code execution in sandboxed environments
- Working across multiple programming languages
- Adapting guidelines for new domains and use cases
- Following project-specific rubrics and requirements
- Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects
Freelance Mathematics Expert for AI Model Training (m/f/d)
An AI lab is looking for a freelance mathematics experts to evaluate AI models. The goal of the project is to assess the performance, accuracy, and reliability of AI models applied in mathematics contexts. The role involves working closely with the development team to ensure the models meet industry standards and provide actionable insights.
This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time.
Key responsibilities:
- Evaluate AI models for mathematics applications.
- Analyze model outputs and provide feedback for improvement.
- Collaborate with the development team to ensure alignment with industry standards.
- Document findings and recommendations for model optimization.
- Conduct tests to validate model performance and reliability.
Freelance Chemistry Expert for AI Model Training (m/f/d)
An AI lab is looking for a freelance chemistry expert to evaluate AI models. The goal of the project is to assess the performance, accuracy, and reliability of AI models applied in chemistry contexts. The role involves working closely with the development team to ensure the models meet industry standards and provide actionable insights.
This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time.
Key responsibilities:
- Evaluate AI models for chemistry applications.
- Analyze model outputs and provide feedback for improvement.
- Collaborate with the development team to ensure alignment with industry standards.
- Document findings and recommendations for model optimization.
- Conduct tests to validate model performance and reliability.
Freelance Physics Expert for AI Model Training (m/f/d)
An AI lab is looking for a freelance physics experts to evaluate AI models. The goal of the project is to assess the performance, accuracy, and reliability of AI models applied in physics contexts. The role involves working closely with the development team to ensure the models meet industry standards and provide actionable insights.
This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time.
Key responsibilities:
- Evaluate AI models for physics applications.
- Analyze model outputs and provide feedback for improvement.
- Collaborate with the development team to ensure alignment with industry standards.
- Document findings and recommendations for model optimization.
- Conduct tests to validate model performance and reliability.
New
Freelance Mechanical Engineer with Python Experience (m/w/d)
For an AI lab we are looking for Mechanical Engineer with python experience to train an AI model (Large Language Model - LLM).
GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills.
If you join you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically:
- Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Mechanical Engineering, while also developing references and examples of tasks.
- Experts Acquisition: Assess the qualification tests of experts, ensuring their competency.
- Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines.
- Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.
Developer for Consent Management Implementation (m/f/d)
For replacing the Consent Layers currently provided by third-party CMPs on the web for our international brands, these layers need to be reimplemented so we can run and serve them in-house. This requires solid knowledge of TypeScript, Vue.js, and classic web technologies (HTML and CSS). The goal is to deliver executable code that implements all requirements and includes automated tests to verify correct function.
What exactly is the scope of work: The focus is on preparing decision-making elements for the approach and implementing measures along the resulting project workflow. This specifically includes the following work packages:
- Implementation of code
- Implementation of executable tests that must pass with test coverage >= 80% before delivery
- Creation of documentation for the code
- Creation of brand-specific cmp-config files.
- Setting up a project (including asset management requirements) as a copy of the Consent Management Platform.
- Removal of netID references.
- Creation of brand-specific settings and files for custom purposes/vendors.
- Adding new brand-specific CSS themes (variable values, logos, etc.).
- Including the required official IAB GVL translations (ES, FR) in the weekly sync with GVL
- Implementation of I18n and preparation of brand-specific data sources
- Implementation of PMC2.0 backend usage modules
- Implementation of the playout logic
- Implementation of the layer initialization process (mode=default and mode=resurface)
- CDN upload and release process
- Project documentation
Project execution:
- The deliverable should be written in TypeScript and Vue.js, built with Vite, and tested with Vitest.
Frontend developer to HR platform with Angular experience
Reach out to us if you are interested in working with us on the project.
Sign up to get access to more exciting projects that match your skills and preferences!
Time's up! We are no longer accepting applications.
Quality Expert for Weld Inspection (m/f/d)
Industries
Automotive
Manufacturing
Area
Quality Assurance (QA)
Project info
- Period21.07.2025 - 21.10.2025
- Capacity100%
- Daily rate580 - 780€
- LocationHamburg, Germany
- Languages
- German(Native),
- English(Advanced)
- German
- Remoteup to 10%
Description
A leading automotive supplier is looking for an experienced quality expert to inspect welds on safety-critical body components. The project involves ensuring the highest quality standards through non-destructive testing methods.
- Typical tasks: independent planning, execution, and evaluation of non-destructive tests (NDT), especially visual testing (VT) and ultrasonic testing (UT). Creating and managing test plans and work instructions. Detailed documentation of test results in CAQ systems. Analysis of defect patterns and initiation of corrective actions in close coordination with welding and production planning. Calibration and maintenance of testing equipment.
- Relevant technologies/tools: ultrasonic testing devices, endoscopes, videoscopes, CAQ software (e.g. Babtec, QSYS), knowledge of standards DIN EN ISO 9712, ISO 5817, and relevant VDA volumes.
- KPIs/success metrics: First Pass Yield (FPY) > 98%, reduction of internal defect rate (PPM), zero defect tolerance for safety-critical seams (escape rate = 0), on-time completion of test orders.
- Key challenges: assessing complex weld geometries under time pressure. Clear interpretation of test results and distinguishing acceptable irregularities from critical defects. Enforcing quality standards with production.
- Deliverables: completed test reports, detailed failure analyses and reports, updated work and test instructions, contributions to FMEAs (failure mode and effects analysis).
- Best practices: regular team alignment (shopfloor management), continuous improvement of testing processes (CIP), raising awareness and training of production staff.
Requirements
- Completed technical training or degree, e.g. as a materials tester or engineer.
- Proven certification in non-destructive testing according to DIN EN ISO 9712, at least Level 2 in VT (visual testing) and UT (ultrasonic testing).
- Several years of practical experience in quality assurance, ideally in the automotive industry or metal fabrication.
- High sense of responsibility, extremely precise and careful work style, and assertiveness.
- Personality: detail-oriented, analytical, strong communication skills, and decisive.
- Must-haves: valid NDT certificates (ISO 9712), experience in an automotive environment.
- Nice-to-haves: additional certifications (e.g. PT, MT), experience with CAQ systems.
English
Powered by FRATCH.IO GmbH