We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed tasks and define gold-standard behavior to compare agent actions against. You’ll work to ensure each scenario is clearly defined, well-scored, and easy to execute and reuse. You’ll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions. Although every project is unique, you might typically: - Designing structured test scenarios based on real-world tasks. - Defining the golden path and acceptable agent behavior. - Annotating task steps, expected outputs, and edge cases. - Working with devs to test your scenarios and improve clarity. - Reviewing agent outputs and adapting tests accordingly

- Identification and analysis of cyber risks emerging from changes in the digital landscape and from attackers' evolving capabilities. - Development and assignment of suitable countermeasures, as well as the creation of roadmaps for effectively handling digital threats. - Translating security incidents and threats into concrete, business-relevant risks with appropriate countermeasures. - Continuous improvement of processes for managing the cyber risk lifecycle and increasing the maturity of the Cyber Risk Desk. - Preparation of project reports on the status, impact, and required actions related to identified risks. - Creation of risk analyses and management processes that meet applicable regulatory standards (SOX, PCI, data protection). - Conducting an initial risk assessment (likelihood, impact, risk level), including a precise description of risks, impacts, and probability of occurrence. - Evaluation and detailed description of the remaining residual risk after the potential implementation of identified risk mitigation measures.

The service is requested as part of the Brand Image Pool photoshoot project. The project includes: - Managing sub-tasks throughout the entire Brand Image Pool photoshoot project from January to June - Taking on brand guardianship tasks during the pool shoot project - Specific service description without reference to individuals: - Independently defining, managing, and executing the project. This ranges from project management to creating roadmaps and project presentations - Developing ideas and concepts for measures - Active management of project risks - Active handling of issues in the project including technical advice on escalations - Preparing and following up stakeholder and steering board meetings - Defining the project scope and overarching project phases - Transparent and appropriate communication to the client regarding scope, quality, schedule, budget, and status

- Responsibility for coordinating and managing the entire production process of magazine publications - Planning and oversight of issue structure, schedules, adverts and workflows - Close collaboration with editorial, publishing management, marketing, technical, sales, printing plant and service providers - Quality assurance for layouts, texts and print approvals - Cost calculation and organization of supplementary products (e.g., inserts, posters, extensions) - Active role in strategic projects, conferences and the launch of new formats

A company in the automotive supplier industry is looking for support in the field of cyber security. The goal of the project is to close gaps as part of the ISO 27001 certification. The IT project manager will play a central role in managing and monitoring the gap closure measures. - Managing and monitoring gap closure measures. - Consistently tracking tasks, deadlines, and responsibilities. - Coordinating between IT, business units, information security, and, if necessary, external service providers. - Ensuring that measures are implemented in an ISO-27001-compliant, verifiable, and documented manner. - Providing transparent status reports to program management and stakeholders. - Supporting audit preparation (evidence, action status, maturity level).

An organization is seeking an experienced post-merger integration consultant with a strong focus on technology and commercial aspects. The goal of the project is to ensure a successful integration after a merger or acquisition by addressing technical and business challenges. The role requires someone with proven leadership experience at larger technology companies, capable of taking on strategic and operational tasks. Key Responsibilities: - Leading and coordinating post-merger integration processes - Analyzing and optimizing technical and commercial structures - Developing and implementing integration strategies - Collaborating with internal and external stakeholders - Ensuring adherence to timelines and budgets

A company in the automotive and robotics industry is looking for an experienced EHS Specialist to support cell manufacturing processes. The goal of the project is to ensure compliance with environmental, health, and safety regulations and to foster a safety culture within the manufacturing environment. The role requires close collaboration with cross-functional teams to implement and maintain EHS standards, conduct risk assessments, and drive continuous improvement initiatives. Key responsibilities: - Develop, implement, and maintain EHS policies and procedures specifically tailored to cell manufacturing. - Conduct regular risk assessments and audits to ensure regulatory compliance. - Train and guide employees on EHS best practices. - Investigate incidents and implement corrective actions to prevent recurrence. - Collaborate with internal teams to promote a culture of safety and sustainability. - Monitor and report on EHS performance metrics.

- A company in the energy and energy services sector is looking for an experienced IT project manager for a ServiceNow project. - The goal of the project is to lead and successfully implement an enterprise ServiceNow project with a focus on ITSM and Customer Service Management (CSM). - The role includes planning, controlling, and ensuring a stable project process in close collaboration with internal and external stakeholders. - Operational & strategic service management of the ServiceNow platform - Process ownership for ITSM and CSM (B2B & B2C) - Process design, governance & continuous improvement - Management of external providers and vendors - Monitoring, KPI analysis & deriving improvements - Ensuring stable platform operations

We are seeking an analytical and technically-minded professional to: - Evaluate AI outputs and processes - Ensure quality, accuracy, and reliability - Identify logical errors, risks, and structural inconsistencies - Provide actionable insights and recommendations to the team Ideal candidates: - Consultants, auditors, analysts, data researchers, or business/technical analysts with strong reasoning skills - Professionals curious about AI, process improvement, and quality evaluation - Problem-solvers who enjoy analyzing complex systems, logic, and scenarios Key Responsibilities: - Lead evaluation of AI outputs and related processes - Review tasks against expected/ideal scenarios; identify gaps and risks - Provide structured, actionable recommendations to engineers, domain experts, and managers - Maintain and improve evaluation guidelines, checklists, SOPs - Suggest new approaches, tools, and processes to enhance AI evaluation

A company is seeking support within the project for evaluating, implementing, and further developing quality surveys in digital channels. The goal of the project is to increase customer satisfaction in digital channels, evaluate, implement, and further develop survey methods to enable consistent measurement of customer satisfaction across all channels. Improvement potentials should be identified and implemented. The role includes consulting, developing, and executing measures for collecting and improving customer satisfaction in digital channels. Main tasks: - Advising on survey methods for capturing customer experience and quality in digital channels, market standards, benchmarks, and future orientation. - Developing a future model for quality in digital channels, relevant KPIs and survey methods, as well as standard processes. - Implementing the decided measures, including interface management and coordination with technology partners and social partners. - Testing implemented measures for data collection and ensuring they meet the required criteria. - Consolidating and listing existing and missing customer survey methods/Quality KPIs in all responsible digital channels. - Advising on the preparation of decision templates and implementing the necessary measures. - Identifying improvement potentials and developing a standard process for transparency and implementation.

A company is looking for an experienced ERP Transformation Manager who will take overall responsibility for planning and steering a comprehensive ERP transformation program. The project aims to harmonize processes, introduce a new ERP system, and implement IFRS requirements. The ERP Transformation Manager will analyze, redesign, and standardize the commercial core processes in civil engineering and track construction. This includes translating IFRS requirements into system structures and posting logic, closely coordinated with the Finance, Controlling, Project Management, and IT departments. The role covers steering the ERP implementation, including fit-gap analyses, process design, test management, and migration. In addition, a unified reporting and KPI framework for group reporting and project control will be established. The manager will act as the central interface between operational units, finance, executive management, and the group, and will set up a sustainable change and training concept for users. - Planning and steering the ERP transformation program (IFRS transition, process harmonization, ERP rollout) - Analyzing, redesigning, and standardizing commercial core processes - Translating IFRS requirements into system structures and posting logic - Steering the ERP implementation including fit-gap analyses, process design, test management, and migration - Building a unified reporting and KPI framework - Stakeholder management and ensuring smooth communication - Leading interdisciplinary project teams and managing external consultants and implementation partners - Establishing a sustainable change and training concept - Ensuring measurable process improvements after the ERP system go-live

- Vision & Strategy: You shape the roadmap for the POS system of the future and ensure we not only meet but anticipate our customers' needs. - Multi-Platform Excellence: You manage the development of our app ecosystem with a focus on Android. You understand the challenges of different form factors (from the compact card terminal to the large stationary tablet). - Delivery Management: You lead your cross-functional development team with clarity and enthusiasm. You facilitate ceremonies, remove blockers, and celebrate releases. - Requirements Engineering: You translate complex business logic into precise technical requirements and user stories that leave no questions unanswered for developers.

A company is looking for an experienced EHS Specialist to support their Body in White (BIW) operations. Body in White refers to the stage in car manufacturing where the vehicle's sheet metal components are welded together to form the body shell, prior to painting and the installation of the engine, chassis, or interior trim. The goal of the project is to ensure compliance with environmental, health, and safety regulations during this critical manufacturing phase while optimizing processes and maintaining high safety standards. The role involves collaborating with production and engineering teams to identify risks, implement safety measures, and foster a culture of safety within the organization. Key responsibilities: - Conduct risk assessments and ensure compliance with EHS regulations specific to BIW operations. - Develop and implement safety protocols and procedures tailored to BIW processes. - Monitor and report on EHS performance metrics within the BIW stage. - Provide training and guidance to employees on EHS best practices in automotive manufacturing. - Investigate incidents and implement corrective actions to prevent recurrence. - Collaborate with cross-functional teams to improve safety standards and processes in BIW.

An organization is looking for support from a Safety and Health Protection Coordinator (SiGeKo) and Safety Specialist (SiFa) for a construction project in Hamburg. The project’s goal is to ensure compliance with all relevant safety and health regulations on the construction site and to minimize risks and hazards. The role includes coordinating and implementing safety measures, advising site and project management, and creating and updating safety plans. The focus is on the practical application of safety concepts and continuously improving safety standards on the site.

For our client company in the financial services sector, we are looking for a Partner Sales Manager (m/f/d). The client has commissioned us to steer a cross-departmental sales project to acquire new software distribution partners. The focus is on developing a partner sales strategy and integrating it into existing financial services solutions. Tasks: - Steering the cross-departmental sales project to acquire new distribution partners in integrated software solutions (ISV – Independent Software Vendor) - Supporting the acquisition of these strategically important partners - Developing a comprehensive software partner sales strategy and defining relevant KPIs - Managing the integrated sales together with the client's financial services solutions - Supporting the design and implementation of the software partner sales strategy - Collaborating in the development and implementation of new processes and shaping the organization

A company is looking for an experienced Product Owner to develop an Android app within a large organization. The focus is on leading and coordinating the development process, and a solid understanding of hardware is a plus. Main responsibilities: - Lead the development of an Android app in a corporate environment - Work closely with development teams and stakeholders - Ensure project goals and deadlines are met - Translate business requirements into technical specifications - Prioritize and maintain the product backlog

A company from the automotive and robotics industry is looking for an experienced Construction & Contractor Safety Specialist (SiGeKo) to ensure safety on construction sites and in collaboration with contractors. The project goal is to implement safety standards, minimize risks, and ensure compliance with legal regulations. In this role, you will be responsible for safety coordination on construction sites and work closely with internal and external stakeholders. - Monitor and coordinate safety measures on construction sites. - Ensure compliance with safety regulations and standards. - Conduct safety inspections and audits. - Advise and train employees and contractors on safety issues. - Create and maintain safety documentation. - Collaborate with authorities and other relevant organizations.

Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might typically: - Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Physics, while also developing references and examples of tasks. - Experts Acquisition: Assess the qualification tests of experts, ensuring their competency. - Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines. - Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.

For an AI lab we are looking for Java Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages - Adapting guidelines for new domains and use cases - Following project-specific rubrics and requirements - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

An AI lab is looking for a freelance chemistry experts to evaluate AI models. The goal of the project is to assess the performance, accuracy, and reliability of AI models applied in chemistry contexts. The role involves working closely with the development team to ensure the models meet industry standards and provide actionable insights. This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time. Key responsibilities: - Evaluate AI models for chemistry applications. - Analyze model outputs and provide feedback for improvement. - Collaborate with the development team to ensure alignment with industry standards. - Document findings and recommendations for model optimization. - Conduct tests to validate model performance and reliability.

To replace the consent layers on the web that were previously provided by third-party CMPs for our international brands, these layers need to be reimplemented so they can be maintained and deployed in-house. This requires solid knowledge of TypeScript, Vue.js and classic web technologies (HTML and CSS). The goal is to deliver executable code that implements all requirements and includes automated tests that verify correct functionality. What exactly is the scope of the assignment: The main focus is on developing elements for decision templates on the approach and on implementing measures throughout the project as designed. This specifically includes the following service packages: - Implement code - Implement executable tests that must pass on delivery, test coverage >= 80% - Create documentation for the code - Create brand-specific cmp-config files - Create a project (including asset management requirements) as a copy of the Consent Management Platform - Remove netID references - Create brand-specific settings and files for custom purposes/vendors - Add new brand-specific CSS themes (variable values, logos, etc.) - Include the required official IAB GVL translations (ES, FR) in the weekly sync with GVL - Implement I18n and prepare brand-specific data sources - Implement PMC2.0 backend usage modules - Implement the playout logic - Implement the layer initialization process (mode=default and mode=resurface) - CDN upload and release process - Project documentation Project execution: - The deliverable should be written in TypeScript and Vue.js, built with Vite, tested with Vitest.

A company is looking for an experienced EHS Specialist to ensure safety and environmental standards in a state-of-the-art production facility. The goal of the project is to ensure compliance with legal regulations, minimize risks, and create a safe working environment. In this role, you will work closely with facility management and other departments to develop, implement, and monitor safety and environmental programs. Main tasks: - Develop and implement EHS programs and policies. - Conduct risk analyses and safety inspections. - Train employees on safety and environmental regulations. - Monitor compliance with legal and internal requirements. - Collaborate with authorities and external partners. - Prepare reports and documentation on EHS topics.

Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might typically: - Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Physics, while also developing references and examples of tasks. - Experts Acquisition: Assess the qualification tests of experts, ensuring their competency. - Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines. - Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.

A company is looking for an experienced Quality Compliance Auditor responsible for ensuring adherence to GCP, GCLP, and GVP standards. The goal of the project is to conduct internal and external audits, prepare for and support regulatory inspections, and identify compliance gaps and derive corrective actions. The role includes planning and conducting audits, supporting regulatory inspections, and ensuring compliance with ICH guidelines as well as EMA/FDA regulations. - Conduct internal and external audits (GCP, GCLP, GVP) - Prepare for and support regulatory inspections (e.g. MHRA, FDA, EMA) - Identify compliance gaps and derive corrective actions

- Independently marketing our brand portfolio through innovative licensing, branding, and lifestyle collaborations to create unique brand experiences - Responsible for defined industries in the sales team, including strategic development, identifying and approaching target customers, and ongoing market and trend analysis - Building new partnerships by acquiring new licensing partners and managing and developing existing licensees - Planning, managing, and controlling the budget for the responsible industries with a strategic focus - Participating in relevant industry trade shows to catch trends and attract potential partners - Adjusting marketing materials and proposals to tailor them to individual customer needs - Acting as a liaison & first point of contact for external sales partners, including evaluating and aligning sales potentials - Promoting effective collaboration between sales and brand management - Maintaining and using the CRM system and opportunity overviews

For an AI lab we are looking for Ruby Developer to train an AI model (Large Language Model - LLM). You help AI to make sense of the world. As consultant, you may be invited to take part in online projects to train the model in your domain of expertise. This flexible role accommodates both experts seeking part-time engagement (minimum few hours/week) and those interested in full-time opportunities. - Code generation and code review - Prompt evaluation and complex data annotation - Training and evaluation of large language models - Benchmarking and agent-based code execution in sandboxed environments - Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) - Adapting guidelines for new domains and use cases - Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects

A company is looking for an experienced FSC Chain of Custody (CoC) Auditor to ensure compliance with FSC CoC standards. The project involves conducting audits, reviewing supply chain processes, and supporting clients in maintaining their FSC certifications. The role requires solid knowledge of FSC CoC requirements and the ability to provide actionable recommendations to clients.

- You develop modern, high-performing web frontends with React, TypeScript, HTML and CSS - You implement responsive designs with a focus on accessibility and performance - You plan and execute unit and integration tests (for example with Playwright) - Troubleshoot in development, test, or live environments

A company is looking for an experienced Commissioning & Qualification (C&Q) Engineer to qualify and commission production facilities in line with GMP standards. The project goal is to ensure the technical and organizational requirements for the GMP-compliant qualification of the production facilities. - Independent execution of commissioning and qualification activities, especially in the area of IOQ - Operation of PCS7 systems - Working with single-use equipment - Execution of commissioning and qualification activities for production facilities - Ensuring all technical and organizational prerequisites for C&Q - GMP-compliant qualification of the associated production facilities

A medical technology company is looking for an experienced Cyber Security Consultant to act as an independent advisor at the intersection of software architecture, DevOps and regulatory affairs. The goal of the project is to develop and secure innovative digital health products (Software as a Medical Device / Connected Devices). This position includes purely specialist consulting, technical assessments and delivery of validated security artifacts, without operational management decisions. The focus is on translating regulatory requirements (FDA, MDR, EU CRA, NIS2) into technical solutions and objectively assessing security risks. - Holistic Threat Modeling: Conduct STRIDE-based analyses for APIs, cloud-native services, AI components and CI/CD pipelines, and maintain formal threat model reports. - Security Architecture & Design: Create technical data flow diagrams (DFD) and security architecture review reports to document security decisions in cloud and container environments. - DevSecOps & Supply Chain Security: Advise on hardening CI/CD pipelines, implementing "security-by-default" and managing SBOM artifacts (third-party risk). - Penetration Testing Support: Define the scope for pen tests and fuzzing, and technically validate the results and CVSS scores. - Vulnerability Management: Assess vulnerabilities (vulnerability impact assessments) and develop remediation plans. - Audit Preparation: Compile technical evidence and documentation for regulatory submissions (FDA, MDR, MDS2).