We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed tasks and define gold-standard behavior to compare agent actions against. You’ll work to ensure each scenario is clearly defined, well-scored, and easy to execute and reuse. You’ll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions. Although every project is unique, you might typically: - Designing structured test scenarios based on real-world tasks. - Defining the golden path and acceptable agent behavior. - Annotating task steps, expected outputs, and edge cases. - Working with devs to test your scenarios and improve clarity. - Reviewing agent outputs and adapting tests accordingly

We are seeking an analytical and technically-minded professional to: - Evaluate AI outputs and processes - Ensure quality, accuracy, and reliability - Identify logical errors, risks, and structural inconsistencies - Provide actionable insights and recommendations to the team Ideal candidates: - Consultants, auditors, analysts, data researchers, or business/technical analysts with strong reasoning skills - Professionals curious about AI, process improvement, and quality evaluation - Problem-solvers who enjoy analyzing complex systems, logic, and scenarios Key Responsibilities: - Lead evaluation of AI outputs and related processes - Review tasks against expected/ideal scenarios; identify gaps and risks - Provide structured, actionable recommendations to engineers, domain experts, and managers - Maintain and improve evaluation guidelines, checklists, SOPs - Suggest new approaches, tools, and processes to enhance AI evaluation

The service is requested as part of the Brand Image Pool photoshoot project. The project includes: - Managing subtasks throughout the Brand Image Pool photoshoot project from January to June - Taking on Brand Guardianship tasks during the pool shooting project period - Detailed service description without reference to individuals: - Independent definition, management and execution of the project. This ranges from project management to creating roadmaps, project presentations - Development of ideas and concepts for measures - Active management of project risks - Active management of issues in the project including professional advice on escalations - Preparation and follow-up of stakeholder and steering board meetings - Definition of project scope and overarching project phases - Transparent and appropriate communication to the client regarding scope, quality, schedule, budget and status

An organization is seeking an experienced post-merger integration consultant with a strong focus on technology and commercial aspects. The goal of the project is to ensure a successful integration after a merger or acquisition by addressing technical and business challenges. The role requires someone with proven leadership experience at larger technology companies, capable of taking on strategic and operational tasks. Key Responsibilities: - Leading and coordinating post-merger integration processes - Analyzing and optimizing technical and commercial structures - Developing and implementing integration strategies - Collaborating with internal and external stakeholders - Ensuring adherence to timelines and budgets

A company is looking for support within the project to evaluate, implement and further develop quality surveys in digital channels. The goal of the project is to increase customer satisfaction in digital channels, evaluate, implement and further develop survey methods to enable a consistent collection of customer satisfaction across all channels. Improvement potentials are to be identified and implemented. The role includes consulting, developing and implementing measures to collect and improve customer satisfaction in digital channels. Main tasks: - Advising on survey methods to capture customer experience and quality in digital channels, market standards, benchmarks and future orientation. - Developing a future model for quality in digital channels, relevant KPIs and survey methods as well as standard processes. - Implementing the decided measures, including interface management and coordination with technology partners and social partners. - Testing implemented measures to collect data and ensure the required criteria. - Consolidating and listing existing and missing customer survey methods/quality KPIs in all responsible digital channels. - Advising on the preparation of decision-making documents and implementing the measures required for this. - Identifying improvement potentials and developing a standard process for transparency and implementation.

A company is looking for an experienced ERP Transformation Manager who will take full responsibility for planning and managing a comprehensive ERP transformation program. The project aims to harmonize processes, introduce a new ERP system, and implement IFRS requirements. The ERP Transformation Manager will analyze, redesign, and standardize the financial core processes in civil and track construction. This includes translating IFRS requirements into system-side structures and posting logics, closely aligned with Finance, Controlling, Project Management, and IT departments. The role covers managing the ERP implementation, including fit-gap analyses, process design, test management, and migration. A unified reporting and KPI framework for consolidated financial statements and project control will also be built. The manager will act as the central interface between operational units, finance, executive management, and the group, and establish a sustainable change and training concept for users. - Planning and management of the ERP transformation program (IFRS transition, process harmonization, ERP rollout) - Analysis, redesign, and standardization of financial core processes - Translation of IFRS requirements into system-side structures and posting logics - Management of ERP implementation including fit-gap analyses, process design, test management, and migration - Development of a unified reporting and KPI framework - Stakeholder management and ensuring smooth communication - Leading interdisciplinary project teams and managing external consultants and implementation partners - Establishing a sustainable change and training concept - Ensuring measurable process improvements after ERP system go-live

- A company in the energy and energy services sector is looking for an experienced IT Project Manager for a ServiceNow project. - The goal of the project is to lead and successfully implement an enterprise ServiceNow project with a focus on ITSM and Customer Service Management (CSM). - The role includes planning, steering, and ensuring a stable project flow in close collaboration with internal and external stakeholders. - Operational & strategic service management of the ServiceNow platform - Process responsibility for ITSM and CSM (B2B & B2C) - Process design, governance & continuous optimization - Management of external providers and service vendors - Monitoring, KPI analysis & deriving improvements - Ensuring stable platform operations

- Responsibility for coordinating and managing the entire production process of magazine publications - Planning and monitoring issue structure, schedules, ads, and workflows - Close collaboration with editorial team, publishing management, marketing, tech, sales, print shop, and service providers - Quality assurance of layouts, texts, and print approvals - Cost calculation and organization of additional products (e.g., inserts, posters, add-ons) - Active role in strategic projects, conferences, and launching new formats

A company in the automotive supply industry is looking for support in the area of cyber security. The project's goal is to close gaps as part of the ISO 27001 certification. The IT project manager will play a central role in controlling and monitoring the gap closure measures. - Controlling and monitoring the measures for gap closure. - Consistently tracking tasks, deadlines, and responsibilities. - Coordinating between IT, business units, information security, and, if needed, external service providers. - Ensuring that measures are implemented ISO-27001-compliant, auditable, and documented. - Providing transparent status reports to program management and stakeholders. - Supporting audit preparation (evidence, action status, maturity level).

- Vision & Strategy: You shape the roadmap for the POS system of the future and ensure that we not only meet our customers’ needs but anticipate them. - Multi-Platform Excellence: You oversee the development of our app ecosystem with a focus on Android. You understand the challenges of different form factors (from the compact card terminal to the large stationary tablet). - Delivery Management: You lead your cross-functional development team with clarity and enthusiasm. You facilitate ceremonies, remove blockers, and celebrate releases. - Requirements Engineering: You translate complex business logic into precise technical requirements and user stories that leave developers with no questions.

For our client company in the financial services sector, we are looking for a Partner Sales Manager (m/f/d). The client has commissioned us to steer a cross-departmental sales project to acquire new software distribution partners. The focus is on developing a partner sales strategy and integrating it into existing financial services solutions. Tasks: - Steering the cross-departmental sales project to acquire new distribution partners in integrated software solutions (ISV – Independent Software Vendor) - Supporting the acquisition of these strategically important partners - Developing a comprehensive software partner sales strategy and defining relevant KPIs - Managing the integrated sales together with the client's financial services solutions - Supporting the design and implementation of the software partner sales strategy - Collaborating in the development and implementation of new processes and shaping the organization

A transformation and modernization project at the HKW Tiefstack site in Hamburg is looking for support. The goal of the project is to develop the energy and heat infrastructure into a future-proof and flexible system. Plant engineering, hydraulics, energy supply, and control technology play a central role. The project is in the implementation phase. The previous lead will leave the project in about 2 months, so there is an immediate need to take over and ensure a smooth handover.

A company in the automotive supplier industry is looking for an experienced Infor AS Consultant to support the team in further developing and optimizing ERP functionalities. The project's goal is to ensure long-term system stability and functionality and continuously optimize ERP processes. The Consultant will work closely with the business units to implement system requirements, taking on an advisory and supportive role. The assignment is ideally 50% remote and 50% on-site near Schweinfurt, with at least one on-site visit required each month. - Designing, developing and optimizing ERP functionalities, taking into account legal and organizational requirements - Analyzing and resolving system disruptions and identifying root causes - Supporting business units through customizing and implementing ERP solutions - Providing second-level support for technical inquiries - Developing, administering and enhancing interfaces and maintaining existing integrations - Conducting and evaluating statistical analyses to monitor system functionality - Performing tests and handing over new processes to internal stakeholders - Providing ongoing support and assistance in optimizing active ERP processes

To replace the consent layers on the web that were previously provided by third-party CMPs for our international brands, these layers need to be reimplemented so we can run and serve them in-house. This requires solid knowledge of Typescript, Vue.js, and classic web technologies (HTML and CSS). The goal is to deliver executable code that meets all requirements and includes automated tests proving correct functionality. What exactly is the scope of work: The main focus is to develop decision templates for the approach and implement measures according to the designed project plan. This specifically includes the following work packages: - Implement code - Implement executable tests that must pass for delivery, with test coverage >= 80% - Create documentation for the code - Create brand-specific cmp-config files - Create a project (including asset management requirements) as a copy of the consent management platform - Remove netID references - Create brand-specific settings and files for custom purposes/vendors - Add new brand-specific CSS themes (variable values, logos, etc.) - Include the required official IAB GVL translations (ES, FR) in the weekly GVL sync - Implement I18n and prepare brand-specific data sources - Implement PMC2.0 backend usage modules - Implement the playout logic - Implement the layer initialization process (mode=default and mode=resurface) - CDN upload and release process - Project documentation Project execution: - The final deliverable should be written in Typescript and Vue.js, built with Vite, tested with Vitest.

A company is looking for an experienced Product Manager to develop an Android app. The focus is on leading and coordinating the development process, with a good understanding of hardware being an advantage. Main tasks: - Leading the development of an Android app - Working closely with development teams and stakeholders - Ensuring project goals and deadlines are met - Translating business requirements into technical specifications - Prioritizing and maintaining the product backlog

A company is looking for an experienced Commissioning & Qualification (C&Q) Engineer to qualify and commission production equipment according to GMP standards. The goal of the project is to ensure the technical and organizational prerequisites for GMP-compliant qualification of the production equipment. - Independently carry out commissioning and qualification activities, especially in IOQ - Operate PCS7 systems - Work with single-use equipment - Carrying out commissioning and qualification activities for production equipment - Ensuring all technical and organizational prerequisites for C&Q - GMP-compliant qualification of the associated production equipment

A company is looking for support in the "Crisis Management Enhancement" project. The aim of the project is to drive forward the development of crisis management (CM) and complete the implementation of the CM lifecycle. The CM lifecycle includes regular reviews of the crisis management plan, preparation and execution of crisis management exercises and workshops, as well as analysis and improvement of the crisis management system and crisis risks. The role involves coordinating all steps of the CM lifecycle, objectively evaluating the crisis management system, and developing proposals for improvement. Company-specific templates and presentations are also developed, and tests and exercises are prepared and followed up. Documenting and tracking lessons learned are part of the tasks, along with advising on and implementing potential improvements.

- Independently market our brand portfolio through innovative licensing, branding and lifestyle partnerships to create unique brand experiences - Own responsibility for defined sectors within the sales team, including strategic development, identifying and reaching target clients, and ongoing market and trend analysis - Build new partnerships by winning new licensees and managing and developing existing ones - Plan, manage and monitor the budget for your sectors with a strategic focus - Attend relevant trade fairs to pick up trends and attract potential partners - Adapt marketing materials and proposals to tailor them to individual client needs - Act as liaison and first point of contact for external sales partners, including evaluating and aligning sales potentials - Promote effective collaboration between Sales and Brand Management - Maintain and use the CRM system and opportunity overviews

A company is looking for an experienced Quality Compliance Auditor responsible for ensuring adherence to GCP, GCLP and GVP standards. The project goal is to conduct internal and external audits, prepare and support regulatory inspections, and identify compliance gaps to derive corrective actions. The role includes planning and conducting audits, supporting regulatory inspections, and ensuring compliance with ICH guidelines as well as EMA/FDA regulations. - Conduct internal and external audits (GCP, GCLP, GVP) - Prepare and support regulatory inspections (e.g. MHRA, FDA, EMA) - Identify compliance gaps and derive corrective actions

A company is looking for a Senior Regulatory Compliance Expert to support its team in preparing for FDA inspections. The role includes conducting mock inspections, strategic consulting on inspection readiness, as well as support for pre-approvals and routine inspections. The ideal candidate has extensive expertise in regulatory compliance, especially FDA standards, and plays a key role in ensuring the company meets global compliance requirements. - Conducting mock inspections according to FDA standards - Strategic consulting on inspection readiness - Support for pre-approval and routine inspections

An organization is looking for support from a Safety and Health Protection Coordinator (SiGeKo) and Safety Specialist (SiFa) for a construction project in Hamburg. The project’s goal is to ensure compliance with all relevant safety and health regulations on the construction site and to minimize risks and hazards. The role includes coordinating and implementing safety measures, advising site and project management, and creating and updating safety plans. The focus is on the practical application of safety concepts and continuously improving safety standards on the site.

A company is seeking support in the digital transformation of investment controlling. The role is part of a Scrum team in the finance department. The focus is on developing and optimizing TM1 Planning Analytics as the core system, including building interfaces, processing data in the model, and providing it for reporting purposes.

A company is looking for an experienced Java IT Architect for a project at a development bank with a duration of five months. The project's goal is to develop and optimize the IT architecture of operational and administrative systems and to analyze and implement business requirements into the bank's IT architecture. - Development of the IT architecture for operational and administrative systems. - Conducting impact analyses of business requirements on the IT architecture. - Monitoring and analyzing portfolio changes and preparing them for management decisions. - Creating IT concepts and performing migration tasks. - Using and evaluating AI plugins to support software development. - Ensuring security aspects in software development (secure coding, authentication, encryption). - Documenting the architecture and interfaces.

The company is undergoing a phase with an increased need for highly specialized expertise in group taxation. The internal tax processes are to be reviewed, further developed, and realigned in selected areas. There are also requirements to optimize existing structures, review the Tax Compliance Management System, and prepare for upcoming audits and strategic decisions. The aim of the project is to analyze, develop, and align the company’s tax-relevant structures, processes, and control mechanisms in line with legal requirements and strategic business objectives. The results should enable the company to make its tax processes more efficient and transparent and to provide a solid foundation for future tax decisions and audits. Services - Analysis of the existing tax processes and structures within the company, including assessment of potential optimization areas. - Development of professional recommendations for tax strategies and for aligning relevant tax workflows within the company. - Creation of concepts for the further development of the Tax Compliance Management System, including the identification of appropriate control mechanisms and documentation requirements. - Preparation of professional decision-making materials for management on tax issues, especially for complex business decisions with tax implications. - Preparation of an objective assessment for upcoming or ongoing tax audits and coordination of procedures with external consulting partners. - Technical review of tax calculations and documents such as tax returns or year-end financial statement elements.

A medical technology company is looking for an experienced Cyber Security Consultant to act as an independent advisor at the intersection of software architecture, DevOps and regulatory affairs. The goal of the project is to develop and secure innovative digital health products (Software as a Medical Device / Connected Devices). This position includes purely specialist consulting, technical assessments and delivery of validated security artifacts, without operational management decisions. The focus is on translating regulatory requirements (FDA, MDR, EU CRA, NIS2) into technical solutions and objectively assessing security risks. - Holistic Threat Modeling: Conduct STRIDE-based analyses for APIs, cloud-native services, AI components and CI/CD pipelines, and maintain formal threat model reports. - Security Architecture & Design: Create technical data flow diagrams (DFD) and security architecture review reports to document security decisions in cloud and container environments. - DevSecOps & Supply Chain Security: Advise on hardening CI/CD pipelines, implementing "security-by-default" and managing SBOM artifacts (third-party risk). - Penetration Testing Support: Define the scope for pen tests and fuzzing, and technically validate the results and CVSS scores. - Vulnerability Management: Assess vulnerabilities (vulnerability impact assessments) and develop remediation plans. - Audit Preparation: Compile technical evidence and documentation for regulatory submissions (FDA, MDR, MDS2).

At our client, changes in operations support and related work in the cloud native environment are on the agenda. - Development of the delivery pipeline - Development of the applications catalog for ODC - Development of the ITSM/CMDB integration

A company is looking for an experienced Data Engineer to carry out a migration from Snowflake to ClickHouse. The focus is on using Apache Spark for data processing and on managing and optimizing Kubernetes environments. The goal is to build and operate a powerful and scalable data platform. - Executing the migration from Snowflake to ClickHouse - Developing and optimizing data pipelines with Apache Spark - Managing and optimizing Kubernetes clusters - Ensuring the performance and scalability of the data platform - Implementing solutions in Python - Optional: Working with Snowplow for data analytics

An insurance company in Nuremberg is looking for a Senior Factor 10 Developer with expertise in IPS and IPM. The project covers the development and optimization of software solutions in the insurance sector, focusing on high performance and reliability. The role requires solid knowledge of Factor 10 and its applications in the insurance industry. Main tasks: - Develop and optimize applications using Factor 10, especially in IPS and IPM. - Collaborate with cross-functional teams to ensure seamless integration and functionality. - Analyze and resolve complex technical issues. - Provide technical guidance and mentoring to junior developers. - Ensure compliance with industry standards and best practices.

A company in the automotive and robotics industry is looking for an experienced Construction & Contractor Safety Specialist (SiGeKo) to ensure safety on construction sites and in cooperation with contractors. The project aims to implement safety standards, minimize risks, and ensure compliance with legal requirements. In this role, you will be responsible for coordinating safety on construction sites and work closely with internal and external stakeholders. - Oversee and coordinate safety measures on construction sites. - Ensure compliance with safety regulations and standards. - Conduct safety inspections and audits. - Advise and train employees and contractors on safety issues. - Prepare and maintain safety documentation. - Collaborate with authorities and other relevant organizations.

A company in the automotive and robotics industry is looking for an experienced EHS Specialist to support cell manufacturing processes. The goal of the project is to ensure compliance with environmental, health and safety regulations and foster a safety culture within the manufacturing environment. The role requires close collaboration with cross-functional teams to implement and maintain EHS standards, conduct risk assessments and drive continuous improvement initiatives. Main tasks: - Develop, implement and maintain EHS policies and procedures specifically tailored to cell manufacturing. - Conduct regular risk assessments and audits to ensure regulatory compliance. - Train and guide employees on EHS best practices. - Investigate incidents and implement corrective actions to prevent recurrence. - Work with internal teams to promote a culture of safety and sustainability. - Monitor and report on EHS performance metrics.