We are looking for an Freelance Agent Evaluation Analyst to take ownership of quality, structure, and insight across the project. This role goes far beyond task-checking - it’s about critical thinking, systems-level analysis, and ensuring clarity, reliability, and consistency at scale. You’ll work as both a hands-on evaluator and an analyst, collaborating with domain experts, delivery managers, and engineers. Beyond reviewing outputs, you’ll be expected to understand the “why” behind the work, identify logical gaps or inconsistencies, and propose meaningful improvements. This is a flexible, impact-driven role where you’ll have space to grow, contribute ideas, and help shape how evaluation and quality are scaled across the project. This role is especially well-suited for: Analysts, researchers, or consultants with strong structuring and reasoning skills Junior product managers or strategists curious about AI and evaluation work Smart problem-solvers (students or early-career professionals) who enjoy digging into logic, systems, and edge cases You do not need a coding background. What matters most is curiosity, intellectual rigor, and the ability to evaluate complex setups with precision. What you’ll be doing - Fully own the QA pipeline for agent evaluation tasks; - Review and validate tasks and golden paths created by scenario writers and experts; - Spot logical inconsistencies, vague requirements, hidden risks, and unrealistic assumptions; - Provide structured feedback and ensure quality alignment across contributors; Train, onboard, and mentor new QA team members; - Collaborate with domain experts, delivery managers, and engineers to improve test clarity and coverage; - Maintain and improve QA checklists, SOPs, and review guidelines; - Contribute to test planning, prioritization, and quality benchmarks; - Take initiative to suggest new approaches, tools, and processes that help scale validation and analysis.

The development and quality assurance of the data layer includes its complete provisioning through the respective web application. The data layer forms the central data foundation for analyzing user behavior and for personalized content during the website visit. To increase reliability and stability, automated tests should be used to significantly reduce manual regression tests. For this task, a Test Automation Engineer with a focus on Playwright (Elastic) is needed. - Development and implementation of automated end-to-end tests with the npm package @elastic/synthetics (Playwright) for data layer tests. - Analysis of existing test processes, identification and prioritization of automation potentials. - Creation, maintenance, and optimization of test scripts considering current best practices. - Integration of automated tests into existing CI/CD pipelines (e.g., Jenkins, GitHub Actions) to enable continuous test automation. - Documentation of test cases, test results, and test coverage in tools like Jira and Confluence. - Advising stakeholders on the selection and introduction of appropriate test strategies, test tools, and frameworks. - Conducting code reviews for test automation scripts to improve quality and maintainability. - Preparing decision templates and recommendations for action to further develop test automation. - Providing advice on error analysis and resolution within test automation. - Consulting on setting up reports and alerting with Elastic Observability. - Promoting traceability and reproducibility of test results.

An AI Lab is looking for a AI Trainer for Vibe Coding. This role involves producing accurate, well-reasoned outputs across diverse domains, leveraging automation and AI tools. The position requires expertise in coding and optimizing Python scripts, handling large datasets, improving AI-generated content, and formatting and troubleshooting technical workflows. This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time. Key responsibilities: - Develop and optimize Python scripts for automation and AI tasks. - Handle and analyze large datasets efficiently. - Improve and refine AI-generated content for accuracy and quality. - Format and troubleshoot technical workflows to ensure smooth operations. - Collaborate with cross-functional teams to enhance AI tools and processes.

For replacing the consent layers currently provided by third-party CMPs on the web for our international brands, these layers will be newly implemented so they can be operated and delivered in-house. This requires solid knowledge of TypeScript, Vue.js and classic web presentation techniques (HTML and CSS). The goal is to deliver executable code that implements all requirements and includes automated tests that verify correct functionality. What exactly is the scope of the engagement: The main focus is on developing elements to decide on the approach and implementing measures along the designed project course. This specifically includes the following deliverables: - Implementation of code - Implementation of executable tests that must pass for delivery, test coverage >= 80% - Creation of documentation for the code - Creation of brand-specific cmp-config files - Creation of a project (including requirements for asset management) as a copy of the Consent Management Platform - Removal of netID references - Creation of brand-specific settings and files for custom purposes/providers - Addition of new brand-specific CSS themes (variable values, logos, etc.) - Inclusion of required official IAB GVL translations (ES, FR) in the weekly sync with the GVL - Implementation of I18n and preparation of brand-specific data sources - Implementation of PMC2.0 backend usage modules - Implementation of playout logic - Implementation of the layer initialization process (mode=default and mode=resurface) - CDN upload and release process - Project documentation Project implementation: - The desired result should be written in TypeScript and Vue.js, built with Vite, tests with Vitest.

The Digital Analytics department uses Adobe Experience Cloud to deliver personalized user experiences. The goal is to increase conversion rates and improve customer experience through targeted personalization and testing. The technical implementation is handled independently by specialized consultants. - A core part of the tasks includes maintaining the existing implementation within the Adobe Experience Platform. This particularly involves monitoring the data and troubleshooting source connectors. - As part of preparing new features for use in the Adobe Experience Platform, requirements and data are first translated into Adobe’s Experience Data Model. This includes creating entity-relationship diagrams (ERDs) and contextualizing the relevant data. - Based on that, the corresponding schemas are created within the platform and datasets are prepared for further use. - Further activities include designing and setting up both new activation channels and additional data sources. - In addition, new business-relevant use cases are developed across the various phases of the customer journey to specifically increase business value. - Creating segments and performing error analyses using targeted SQL queries. - Consulting on all newly introduced processing activities, covering compliance with applicable data protection regulations, the required internal approval processes, as well as documenting legal and technical specifics.

A company is looking for experienced project managers and account managers who can execute international campaigns on a hands-on basis. The role requires close collaboration with various markets and stakeholders to ensure campaigns are run effectively and on time. The position is ideal for candidates with extensive agency experience, especially in traditional campaign execution. Experience at leading agencies like Media Monks or similar is a plus. Main tasks: - Planning, execution, and monitoring of international campaigns - Close collaboration with international markets and stakeholders - Ensuring adherence to schedules and budgets - Coordination of teams and resources - Reporting and analysis of campaign results

- Independently market our brand portfolio through innovative licensing, brand, and lifestyle partnerships to create unique brand experiences - Responsible for defined sectors in the sales team, including strategic development, identifying and reaching target customers, and ongoing market and trend analysis - Build new partnerships by acquiring new license partners and managing and developing existing licensees - Plan, manage, and control the budget for your assigned sectors with a strategic focus - Participate in relevant industry trade shows to catch up on trends and acquire potential partners - Adapt marketing materials and proposals to specifically match individual customer needs - Act as the interface and first point of contact for external sales partners, including evaluating and aligning sales potentials - Promote effective collaboration between Sales and Brand Management - Maintain and use the CRM system and potential overviews

For an AI lab, we are looking for a Java Developer to train an AI model (Large Language Model - LLM). You help AI make sense of the world. As a consultant, you may be invited to take part in online projects to train the model in your area of expertise. This flexible role suits both experts seeking part-time engagement (at least a few hours per week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

We are seeking experienced data scientists to create computationally intensive data science problems for an advanced AI evaluation project. This is a remote, project-based opportunity for experts who can design challenging problems that require computational methods to solve and mirror the full data science lifecycle - from data acquisition and processing to statistical analysis and actionable business insights. What You'll Do - Design original computational data science problems that simulate real-world analytical workflows across industries (telecom, finance, government, e-commerce, healthcare) - Create problems requiring Python programming to solve (using pandas, numpy, scipy, sklearn, statsmodels, matplotlib, seaborn) - Ensure problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks) - Develop problems requiring non-trivial reasoning chains in data processing, statistical analysis, feature engineering, predictive modeling, and insight extraction - Create deterministic problems with reproducible answers - avoid stochastic elements or require fixed random seeds for exact reproducibility - Base problems on real business challenges: customer analytics, risk assessment, fraud detection, forecasting, optimization, and operational efficiency - Design end-to-end problems spanning the complete data science pipeline (data ingestion → cleaning → EDA → modeling → validation → deployment considerations) - Incorporate big data processing scenarios requiring scalable computational approaches - Verify solutions using Python with standard data science libraries and statistical methods - Document problem statements clearly with realistic business contexts and provide verified correct answers

For an AI lab we are looking for Rust Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

- Responsible for coordinating and managing the entire production process of magazine publications - Planning and monitoring issue structure, schedules, ads, and workflows - Close collaboration with editorial team, publishing management, marketing, technical, sales, printers, and service providers - Quality assurance for layouts, texts, and print approvals - Cost calculation and organization of supplementary products (e.g. inserts, posters, extensions) - Active role in strategic projects, conferences, and launching new formats

The Digital Analytics department uses the Adobe Experience Cloud to deliver personalized user experiences. The goal is to boost conversion rates and improve the customer experience through targeted personalization and testing. Technical implementation is handled independently by specialized consultants. - Designing and technically implementing personalized user experiences with Adobe Target - Implementing A/B and multivariate tests, including quality assurance in live environments - Integrating Adobe Target into complex system landscapes with Adobe Experience Platform and Adobe Experience Manager - Developing targeting logic based on segments, real-time data and user behavior - Advising on new features and best practices within the Adobe Experience Cloud - Preparing technical decision papers to advance the personalization strategy - Documenting and handing over the developed solutions in Confluence and similar tools - Preparing technical documentation for data protection, especially data flow diagrams - Advising on GDPR-compliant use of Adobe Target and related systems - Conducting workshops to introduce Adobe Target

For an AI lab we are looking for phycists with python experience to train an AI model (Large Language Model - LLM). GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as a phycist, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: - Design original computational physic problems that simulate real research workflows. - Create problems requiring Python programming to solve (using numpy, scipy, sympy). - Ensure problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks). - Develop problems requiring non-trivial reasoning chains. - Base problems on real research challenges or practical applications from physical practice. - Verify solutions using Python with standard libraries. - Document problem statements clearly and provide verified correct answers.

For an AI studio we are looking for a Spanish speaking data annotation specialist: Annotation is what helps AI make sense of the world. As a QA Annotator, you may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities Responsibilities: - Carefully review provided data (text, images, or videos). - Review tasks submitted by the Annotators team and ensure quality assurance/quality control. - Label or classify content based on project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

For an AI lab we are looking for a Ruby Developer to train an AI model (Large Language Model - LLM). You help AI make sense of the world. As a consultant, you may be invited to join online projects to train the model in your area of expertise. This flexible role suits both experts seeking part-time work (minimum a few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) - Adapting guidelines for new domains and use cases - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

- You develop modern, high-performance web frontends with React, TypeScript, HTML, and CSS - You implement responsive designs with a focus on accessibility and performance - You plan and run unit and integration tests (for example with Playwright) - Troubleshooting in development, test, or live environments

- A company from the energy and energy services sector is looking for an experienced IT Project Manager for a ServiceNow project. - The goal of the project is to lead and successfully implement an enterprise ServiceNow project with a focus on ITSM and Customer Service Management (CSM). - The role includes planning, controlling, and ensuring a stable project flow in close collaboration with internal and external stakeholders. - Operational & strategic service management of the ServiceNow platform - Process ownership for ITSM and CSM (B2B & B2C) - Process design, governance & continuous optimization - Management of external providers and vendors - Monitoring, KPI analysis & deriving improvements - Ensuring a stable platform operation

For our client we are looking for a German-speaking AI consultant: As a consultant, you may be invited to take part in online projects to train models in your area of expertise. This flexible role suits both experts looking for part-time work (minimum a few hours per week) and those interested in full-time opportunities. Responsibilities: - Carefully review the provided data (text, images, or videos). - Check tasks submitted by the development team and ensure quality assurance/quality control. - Label or classify content according to project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

For our client we are looking for a Japanese speaking AI consultant: As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. Responsibilities: - Carefully review provided data (text, images, or videos). - Review tasks submitted by the developer team and ensure quality assurance/quality control. - Label or classify content based on project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

An AI lab is looking for a freelance mathematics experts to evaluate AI models. The goal of the project is to assess the performance, accuracy, and reliability of AI models applied in mathematics contexts. The role involves working closely with the development team to ensure the models meet industry standards and provide actionable insights. This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time. Key responsibilities: - Evaluate AI models for mathematics applications. - Analyze model outputs and provide feedback for improvement. - Collaborate with the development team to ensure alignment with industry standards. - Document findings and recommendations for model optimization. - Conduct tests to validate model performance and reliability.