We are looking for an Freelance Agent Evaluation Analyst to take ownership of quality, structure, and insight across the project. This role goes far beyond task-checking - it’s about critical thinking, systems-level analysis, and ensuring clarity, reliability, and consistency at scale. You’ll work as both a hands-on evaluator and an analyst, collaborating with domain experts, delivery managers, and engineers. Beyond reviewing outputs, you’ll be expected to understand the “why” behind the work, identify logical gaps or inconsistencies, and propose meaningful improvements. This is a flexible, impact-driven role where you’ll have space to grow, contribute ideas, and help shape how evaluation and quality are scaled across the project. This role is especially well-suited for: Analysts, researchers, or consultants with strong structuring and reasoning skills Junior product managers or strategists curious about AI and evaluation work Smart problem-solvers (students or early-career professionals) who enjoy digging into logic, systems, and edge cases You do not need a coding background. What matters most is curiosity, intellectual rigor, and the ability to evaluate complex setups with precision. What you’ll be doing - Fully own the QA pipeline for agent evaluation tasks; - Review and validate tasks and golden paths created by scenario writers and experts; - Spot logical inconsistencies, vague requirements, hidden risks, and unrealistic assumptions; - Provide structured feedback and ensure quality alignment across contributors; Train, onboard, and mentor new QA team members; - Collaborate with domain experts, delivery managers, and engineers to improve test clarity and coverage; - Maintain and improve QA checklists, SOPs, and review guidelines; - Contribute to test planning, prioritization, and quality benchmarks; - Take initiative to suggest new approaches, tools, and processes that help scale validation and analysis.

A company is looking for an experienced Head Of Electronic Development to take over the technical and disciplinary leadership of a hardware and software development team. The goal of the project is to ensure the quality of technical work products, plan and carry out strategic pre-development, and optimize existing processes and systems. The role includes working in agile project management, cost estimation and proposal preparation, as well as team and capacity planning. The candidate will be responsible for the professional development of team members and will communicate closely with customers and suppliers. Main tasks: - Technical and disciplinary leadership of a HW+SW development team - Participation in agile project management, cost estimation and proposal preparation - Team and capacity planning - Professional development of team members - Responsibility for the quality of formal and technical work products - Cost calculation and pricing of products, especially PCBA - Planning and execution of strategic pre-development - Communication with customers and suppliers - Optimization of existing processes and systems

The Translation Project Manager acts as the central interface between the end Client Leads, Local Market Reviewers and Acolad. - Steering and managing Acolad as vendor on a daily basis, including briefings, monitoring delivery, quality checks, and deadline control. - Coordinating complex multilingual translation, transcreation and localisation workflows. - Ensuring all deliverables are complete, consistent, error-free, and aligned with brand and language guidelines. - Managing timelines, resources, and budgets under strict SLAs. - Acting as the first escalation point for any linguistic or operational issues.

A company is looking for experienced project managers and account managers who can execute international campaigns on a hands-on basis. The role requires close collaboration with various markets and stakeholders to ensure that campaigns are run effectively and on time. This position is ideal for candidates with extensive agency experience, particularly in executing traditional campaigns. Experience at renowned agencies like Media Monks or similar is an advantage. Key responsibilities: - Planning, executing and monitoring international campaigns - Close collaboration with international markets and stakeholders - Ensuring adherence to timelines and budgets - Coordinating teams and resources - Reporting and analyzing campaign results

A company is looking for an experienced SAP IS-U consultant with a focus on market communication and regulatory processes in the energy sector. The project aims to optimize and transform market processes while supporting the implementation of new regulatory requirements. The consultant will play a key role in planning and conducting workshops, analyzing processes, and supporting the go-live process. They will also assist with quality assurance and test management. Key responsibilities: - Planning, leading, and moderating workshops as well as creating fit-and-gap analyses - Developing and documenting new market processes and adjusting existing workflows - Implementing master data and processes in the area of market communication - Supporting the client with test management and quality assurance - Revising and improving regulatory processes and market roles - Supporting the go-live process and assisting with production rollout - Independently handling topics such as market communication setup, regulatory processes, configuration of market roles (e.g., DSO, suppliers), deregulated market processes, compliance, and market message processing and outbound/inbound communication

For replacing the previously displayed consent layers by third-party CMPs on the web for our international brands, these layers will be reimplemented so they can be maintained and deployed in-house. This requires solid knowledge of Typescript, Vue.js, and classic web rendering technologies (HTML and CSS). The goal is to deliver executable code that implements all requirements and includes automated tests proving correct functionality. What exactly is the scope of the assignment: The main focus is on developing elements for a decision-making template on the approach and on implementing measures along the designed project course. Concretely, this includes the following work packages: - Implementation of code - Implementation of executable tests, which must pass for delivery, with test coverage >= 80% - Creation of documentation for the code - Creation of brand-specific cmp-config files. - Creation of a project (including asset management requirements) as a copy of the consent management platform. - Removal of netID references. - Creation of brand-specific settings and files for custom purposes/vendors. - Adding new brand-specific CSS themes (variable values, logos, etc.). - Inclusion of required official IAB GVL translations (ES, FR) in the weekly GVL synchronization. - Implementation of I18n and preparation of brand-specific data sources. - Implementation of PMC2.0 backend usage modules. - Implementation of playout logic. - Implementation of the layer initialization process (mode=default and mode=resurface). - CDN upload and release process. - Project documentation Project implementation: - The desired result should be written in Typescript and Vue.js, build via Vite, tests via Vitest.

GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: - Evaluate and red team AI models and agents and machine learning systems for vulnerabilities and safety risks. - Create offline reproducible & auto-evaluable test cases to test safety & capability of AI agents. - Develop and implement automation scripts, custom tools, environments and test harnesses. - Lead or contribute to security research initiatives, especially in AI safety, creating and implementing realistic and challenging attack scenarios for the model. - Advise on cybersecurity best practices and policy implications.

For an AI lab we are looking for cybersecurity consultants to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities - Evaluate and red team AI models and agents and machine learning systems for vulnerabilities and safety risks. - Create offline reproducible & auto-evaluable test cases to test safety & capability of AI agents. - Develop and implement automation scripts, custom tools, environments and test harnesses. - Lead or contribute to security research initiatives, especially in AI safety, creating and implementing realistic and challenging attack scenarios for the model. - Advise on cybersecurity best practices and policy implications.

A company is looking for a Technical Lead to oversee AI training projects. The role involves acting as a team lead and reviewer, ensuring technical quality across both frontend and backend development. The ideal candidate will contribute to the project's success by reviewing and approving tasks, mentoring junior developers, managing technical debt, and ensuring coherence between backend and frontend systems. The goal is to keep the project aligned with product objectives while maintaining high technical standards. Key responsibilities: - Act as team lead and reviewer for technical quality across frontend and backend. - Decompose features into tasks and guide junior developers. - Review and approve tasks to ensure alignment with product goals. - Mentor junior developers and foster their growth. - Manage technical debt and ensure coherence between backend and frontend systems. - Collaborate on system design, architecture, and code reviews.

For our client we are looking for a German-speaking AI consultant: As a consultant, you may be invited to take part in online projects to train the model in your area of expertise. This flexible role is open to both experts looking for part-time work (minimum a few hours per week) and those interested in full-time opportunities. Responsibilities: - Carefully review provided data (text, images, or videos). - Go through tasks submitted by the development team and handle quality assurance/quality control. - Label or classify content according to project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

For our client we are looking for a Japanese speaking AI consultant: As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. Responsibilities: - Carefully review provided data (text, images, or videos). - Review tasks submitted by the developer team and ensure quality assurance/quality control. - Label or classify content based on project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

For an AI lab we are looking for Java Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

For an AI lab we are looking for AI Agent Evaluation Analyst to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities - Reviewing evaluation tasks and scenarios for logic, completeness, and realism. - Identifying inconsistencies, missing assumptions, or unclear decision points. - Helping define clear expected behaviors (gold standards) for AI agents. - Annotating cause-effect relationships, reasoning paths, and plausible alternatives. - Thinking through complex systems and policies as a human would to ensure agents are tested properly. - Working closely with QA, writers, or developers to suggest refinements or edge case coverage.

For an AI lab we are looking for Kotlin Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

For our client we are looking for a Korean speaking AI consultant: As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. Responsibilities: - Carefully review provided data (text, images, or videos). - Review tasks submitted by the developer team and ensure quality assurance/quality control. - Label or classify content based on project guidelines. - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material.

A company is building a platform that integrates movement, breath, and meditation into one place, aiming to contribute to a more mindful world. To support this mission, they are seeking a Senior Backend Engineer to help build and scale their microservices architecture, ensuring systems are robust, maintainable, and future-proof. The role involves working on backend services in Go, creating efficient gRPC APIs for service-to-service communication, managing builds, testing, and deployments using Bazel, and running services on Google Cloud Platform (GCP) with a focus on scalability and reliability. The engineer will contribute to a modular microservices architecture that supports a growing product.

The overall goal is to implement the “Omni-Channel Optimization with AI” project within the given timeframe, resources, and requirements. In this context, the enhancement of the NV Agent Assist, the development of AI use cases, and their implementation will be supported. - Consulting on the enhancement of the NonVoice Assist (agent-facing AI product in the Assist and Automation division) - Analyzing and defining required data streams to generate additional information for the AI assistant - Analyzing integration options and evaluating the commercial effects - Designing use cases along the transaction flows that include the new information/data and implementing or embedding them into existing (service) subprocesses - Designing the integration of the use cases into the existing IT infrastructure and extending their applications by linking along the flows and processes - Documenting solution approaches and analyses using Confluence - Defining the use cases in JIRA, optionally in Excel, to be uploaded to JIRA - Creating commercial presentations in the form of a management deck

For an AI lab we are looking for Ruby Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) - Adapting guidelines for new domains and use cases - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might typically: - Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Physics, while also developing references and examples of tasks. - Experts Acquisition: Assess the qualification tests of experts, ensuring their competency. - Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines. - Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.

For an AI lab we are looking for a Rust Developer to train an AI model (Large Language Model (LLM)). You help AI to make sense of the world. As a consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (at least a few hours per week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects