We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed tasks and define gold-standard behavior to compare agent actions against. You’ll work to ensure each scenario is clearly defined, well-scored, and easy to execute and reuse. You’ll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions. Although every project is unique, you might typically: - Designing structured test scenarios based on real-world tasks. - Defining the golden path and acceptable agent behavior. - Annotating task steps, expected outputs, and edge cases. - Working with devs to test your scenarios and improve clarity. - Reviewing agent outputs and adapting tests accordingly

As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. This is a remote part-time role that can be flexibly tailored to your availability – from just a few hours per week to full-time. Key Responsibilities: - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.

Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might typically: - Content Creation & Refinement: Create and refine content to ensure accuracy and relevance across a variety of topics in Physics, while also developing references and examples of tasks. - Experts Acquisition: Assess the qualification tests of experts, ensuring their competency. - Chat Moderation: Provide support by addressing project-related questions from other experts in Discord chats, especially those related to project guidelines. - Auditing Work: Review and evaluate tasks completed by other experts, ensuring they align with project guidelines. Provide constructive feedback, verify expertise-related information, and edit content as necessary to improve quality.

A company is looking for an experienced Construction Manager (m/f/d) according to LBO – Civil and MEP for a major construction project in Berlin. The project aims to build a new heat generation unit to produce hot water for district heating. The plant includes three gas-fired hot water boiler systems of 40 MW each, flue gas exhaust/chimney, natural gas and district heating systems, as well as pipe bridges and secondary steel structures. The Construction Manager (m/f/d) will be responsible for the client-side supervision of the contractors to ensure a safe, professional, and on-time execution of all mechanical work on site. The position reports directly to the Project Manager. Main tasks: - Technical advice and coordination of all activities on site. - Monitoring compliance with health, safety, and environmental regulations. - Conducting and documenting construction meetings and project coordination meetings. - Reviewing installation plans, work instructions, and progress reports. - Ensuring compliance with HSSE guidelines and legal requirements. - Creating and maintaining the site diary and reporting to the project management.

A company is looking for an experienced Java IT Architect for a project at a development bank with a duration of five months. The project's goal is to develop and optimize the IT architecture of operational and administrative systems and to analyze and implement business requirements into the bank's IT architecture. - Development of the IT architecture for operational and administrative systems. - Conducting impact analyses of business requirements on the IT architecture. - Monitoring and analyzing portfolio changes and preparing them for management decisions. - Creating IT concepts and performing migration tasks. - Using and evaluating AI plugins to support software development. - Ensuring security aspects in software development (secure coding, authentication, encryption). - Documenting the architecture and interfaces.

A company in the automotive supplier industry is looking for an experienced Infor AS Consultant to support the team in further developing and optimizing ERP functionalities. The project's goal is to ensure long-term system stability and functionality and continuously optimize ERP processes. The Consultant will work closely with the business units to implement system requirements, taking on an advisory and supportive role. The assignment is ideally 50% remote and 50% on-site near Schweinfurt, with at least one on-site visit required each month. - Designing, developing and optimizing ERP functionalities, taking into account legal and organizational requirements - Analyzing and resolving system disruptions and identifying root causes - Supporting business units through customizing and implementing ERP solutions - Providing second-level support for technical inquiries - Developing, administering and enhancing interfaces and maintaining existing integrations - Conducting and evaluating statistical analyses to monitor system functionality - Performing tests and handing over new processes to internal stakeholders - Providing ongoing support and assistance in optimizing active ERP processes

A company is looking for an experienced E Engineer specialized in the design and construction of electric motors. The project's goal is to qualify an insulation system, analyze operating points, and optimize electric motors. In addition, expertise in frequency converters (FU) is required to oversee tests and support the tuning of the KBK. - Qualification of an insulation system according to 60034-18-41 - Analysis of electrical operating points with field weakening and efficiency - Optimization of electric motor lamination stacks in terms of cost and torque density - Support for frequency converter tests to tune the KBK

We are looking for cybersecurity consultants to help train an AI model (Large Language Model - LLM) for an AI lab. You will help the AI understand the world. As a consultant, you might be invited to join online projects to train the model in your area of expertise. This flexible role is open to experts seeking part-time work (at least a few hours per week) or those looking for full-time opportunities: - Evaluate and red-team AI models, agents, and machine learning systems for vulnerabilities and safety risks. - Create offline, reproducible and auto-evaluable test cases to assess the safety and capabilities of AI agents. - Develop and implement automation scripts, custom tools, environments, and test harnesses. - Lead or contribute to security research initiatives, especially in AI safety, by designing and executing realistic, challenging attack scenarios for the model. - Advise on cybersecurity best practices and policy implications.

An established medical technology company is looking for an experienced Cyber Security Consultant to act as an independent advisor at the intersection of software architecture, DevOps and regulatory affairs. The goal of the project is to develop and secure innovative digital health products (Software as a Medical Device / Connected Devices). The position is purely advisory, with technical assessments and delivery of validated security artifacts, without operational management decisions. The focus is on translating regulatory requirements (FDA, MDR, EU CRA, NIS2) into technical solutions and objectively evaluating security risks. - Holistic Threat Modeling: Carry out STRIDE-based analyses for APIs, cloud-native services, AI components and CI/CD pipelines, and maintain formal threat model reports. - Security Architecture & Design: Create technical data flow diagrams (DFDs) and Security Architecture Review Reports to document security decisions in cloud and container environments. - DevSecOps & Supply Chain Security: Advise on hardening CI/CD pipelines, implementing "security by default" and managing SBOM artifacts (third-party risk). - Penetration Testing Support: Define the scope for pen tests and fuzzing, and provide technical validation of results and CVSS scoring. - Vulnerability Management: Assess vulnerabilities (vulnerability impact assessments) and create remediation plans. - Audit Preparation: Compile technical evidence and documentation for regulatory submissions (FDA, MDR, MDS2).

A company is looking for an experienced auditor to plan and conduct audits according to the FSC and PEFC Chain of Custody standards. The audits focus on clients in Germany. The role requires close collaboration with various internal departments, such as the certification body, product management, sales, and customer support. In addition, you will be expected to carry out reviews of FSC audits. Main tasks: - Plan and conduct audits according to the FSC and PEFC Chain of Custody standards. - Support clients in Germany with a focus on audit processes. - Work closely with the certification body, product management, sales, and customer support. - Carry out reviews of FSC audits.

A company is looking for an experienced auditor to plan and conduct audits in the areas of labor rights, workplace safety, health protection, and environmental standards. The audits will focus on clients in Germany. The role requires close collaboration with product management, sales, and customer support to ensure compliance with the relevant standards. Main responsibilities: - Plan and conduct audits on labor rights, workplace safety, health protection, and environmental standards. - Support clients in Germany with a focus on the mentioned topics. - Work closely with product management, sales, and customer support.

A company is looking for an experienced auditor to plan and conduct audits in sustainable events. The main task is to assess ISO 20121 compliance of well-known clients in the event sector. The audits focus on clients in Germany. The role requires close collaboration with product management, the certification body, sales, and customer support to ensure compliance with sustainability standards. Main tasks: - Planning and conducting audits in sustainable events. - Assessing ISO 20121 compliance of clients in the event sector. - Managing clients in Germany with a focus on sustainability standards. - Close collaboration with product management, the certification body, sales, and customer support.

A law firm is looking for an expert to optimize and automate processes. The goal of the project is to make workflows more efficient, especially in the areas of PDF processing, file management, and accounting processes in an SQL environment. In addition, a user-friendly user interface (UI) should be developed that is tailored to the needs of lawyers and secretaries. - Automation of PDF processing tasks (e.g. merging, converting, editing). - Development of solutions for automated management of file extensions and structures. - Optimization and automation of accounting processes in an SQL environment. - Creation of an intuitive and user-friendly UI for non-technical users such as lawyers and secretaries. - Integration of open-source libraries to extend functionality. - Collaboration with firm staff to gather requirements and develop solutions. - Documentation of the developed solutions and training of users.

A company is looking for experienced support to build and further develop programs and content on Kajabi. The goal is to optimize the setup, structuring, and professional build-out of the content. The role includes support for product structure, automations, and the membership area. Ideally, the freelancer brings experience in interim management, freelance experts, and independent consulting. A long-term collaboration is desired.

A company is seeking a Staff Product Manager to lead the realization of design visions for consumer-facing, multimodal experiences across voice, chat, and beyond. The role involves bringing the product vision to life within the product team, ensuring clarity and usability across various interfaces. The successful candidate will collaborate closely with product managers, engineers, and AI specialists to align on priorities, user needs, technical feasibility, and business impact. The focus will be on balancing simplicity and delight, ensuring interfaces feel natural and human-like across voice, chat, and graphical touchpoints. Key responsibilities: - Drive the realization of the design vision for multimodal experiences. - Partner with cross-functional teams to align on priorities and user needs. - Prototype and test interaction models for intuitive and trustworthy AI agents. - Take end-to-end ownership of design within the product team. - Deliver high-quality, hands-on work to shape product direction.

A company is seeking support for the project "Further Development of Crisis Management". The aim of the project is to drive the advancement of crisis management (CM) and complete the implementation of the CM lifecycle. The CM lifecycle includes, among other things, regular reviews of the crisis management plan, the preparation and execution of crisis management exercises and workshops, as well as the analysis and improvement of the crisis management system and crisis risks. The role involves coordinating all steps of the CM lifecycle, objectively assessing the crisis management system and developing proposals for improvement. You will also create company-specific templates and presentations, and handle the preparation and follow-up of tests and exercises. Documenting and tracking lessons learned is also part of the tasks, as well as advising on and implementing potential improvements.

An organization is looking for support from a Safety and Health Protection Coordinator (SiGeKo) and Safety Specialist (SiFa) for a construction project in Hamburg. The project’s goal is to ensure compliance with all relevant safety and health regulations on the construction site and to minimize risks and hazards. The role includes coordinating and implementing safety measures, advising site and project management, and creating and updating safety plans. The focus is on the practical application of safety concepts and continuously improving safety standards on the site.

A transformation and modernization project at the HKW Tiefstack site in Hamburg is looking for support. The aim of the project is to further develop the energy and heat infrastructure into a future-proof and flexible system. Plant engineering, hydraulics, energy supply, and control systems play a central role in this. The project is in the implementation phase. The current lead will leave the project in about two months, so there is an urgent need for takeover and to ensure a smooth handover.

A company is looking for support in the digital transformation of investment controlling. The role takes place within a SCRUM team in the finance department. The focus is on developing and optimizing TM1 Planning Analytics as the core system, including building interfaces, processing data in the model, and providing it for reporting purposes.

The company is in a phase with an increased need for highly specialized expertise in group taxation. The internal tax processes are to be reviewed, further developed, and realigned in selected areas. In addition, there are requirements to optimize existing structures, review the Tax Compliance Management System, and prepare for upcoming audits and strategic decisions. The goal of the project is to analyze, enhance, and align the company’s tax-related structures, processes, and control mechanisms in line with legal requirements and strategic corporate objectives. The results should enable the company to make tax processes more efficient and transparent and provide a solid foundation for future tax decisions and audits. Services - Analysis of existing tax processes and structures in the company, including assessment of potential optimization areas. - Development of expert recommendations for tax strategies and the alignment of relevant tax workflows within the company. - Development of concepts to further advance the Tax Compliance Management System, including identification of suitable control mechanisms and documentation requirements. - Preparation of professional decision-making materials for the management board on tax issues, especially for complex corporate decisions with tax relevance. - Creation of an objective assessment to prepare for planned or ongoing tax audits, and coordination of approaches with external consulting partners. - Expert review of tax calculations and content such as tax returns or annual financial statement components.

A company from the automotive supplier sector is looking for support in the field of cyber security. The goal of the project is to close gaps as part of the ISO 27001 certification. The IT Project Manager will play a central role in controlling and monitoring the measures for gap closure. - Controlling and monitoring the measures for gap closure. - Consistently tracking tasks, deadlines and responsibilities. - Coordinating between IT, business units, information security and, if needed, external service providers. - Ensuring that measures are implemented ISO 27001 compliant, verifiable and documented. - Transparent status reports to program management and stakeholders. - Support in audit preparation (evidence, measure status, maturity level).

At our client, changes in operations support and related work in the cloud native environment are on the agenda. - Development of the delivery pipeline - Development of the applications catalog for ODC - Development of the ITSM/CMDB integration

- Vision & Strategy: You shape the roadmap for the POS system of the future and make sure we not only meet our customers' needs but anticipate them. - Multi-Platform Excellence: You steer the development of our app ecosystem with a focus on Android. You understand the challenges of various form factors (from compact card terminals to large stationary tablets). - Delivery Management: You lead your cross-functional development team with clarity and enthusiasm. You facilitate ceremonies, unblock issues, and celebrate releases. - Requirements Engineering: You translate complex business logic into precise technical requirements and user stories that leave no questions for developers.

A company is looking for an experienced Data Engineer to carry out a migration from Snowflake to ClickHouse. The focus is on using Apache Spark for data processing and on managing and optimizing Kubernetes environments. The goal is to build and operate a powerful and scalable data platform. - Executing the migration from Snowflake to ClickHouse - Developing and optimizing data pipelines with Apache Spark - Managing and optimizing Kubernetes clusters - Ensuring the performance and scalability of the data platform - Implementing solutions in Python - Optional: Working with Snowplow for data analytics

A company is looking for an experienced Commissioning & Qualification (C&Q) Engineer to qualify and start up production equipment according to GMP standards. The goal of the project is to ensure the technical and organizational requirements for the GMP-compliant qualification of the production equipment. - Independently carry out commissioning and qualification activities, especially in IOQ - Operate PCS7 systems - Work with single-use equipment - Carry out commissioning and qualification activities for production equipment - Ensure all technical and organizational requirements for C&Q - GMP-compliant qualification of the related production equipment

A company is looking for an experienced Quality Compliance Auditor responsible for ensuring compliance with GCP, GCLP, and GVP standards. The project aims to conduct internal and external audits, prepare and support regulatory inspections, and identify compliance gaps and derive corrective actions. The role includes planning and conducting audits, assisting with regulatory inspections, and ensuring compliance with ICH guidelines and EMA/FDA regulations. - Conduct internal and external audits (GCP, GCLP, GVP) - Prepare for and support regulatory inspections (e.g., MHRA, FDA, EMA) - Identify compliance gaps and derive corrective actions

A company is looking for a Senior Regulatory Compliance Expert to support its team in preparing for FDA inspections. The role includes conducting mock inspections, providing strategic advice on inspection readiness, and assisting with pre-approval and routine inspections. The ideal candidate has extensive expertise in regulatory compliance, especially FDA standards, and plays a key role in ensuring the company meets global compliance requirements. - Conducting mock inspections according to FDA standards - Strategic advising on inspection readiness - Support during pre-approval and routine inspections

A company in the automotive and robotics sector is looking for an experienced Construction & Contractor Safety Specialist (SiGeKo) to ensure safety on construction sites and in collaboration with contractors. The goal of the project is to implement safety standards, minimize risks, and ensure compliance with legal requirements. In this role you will take responsibility for safety coordination on construction sites and work closely with internal and external stakeholders. - Monitoring and coordinating safety measures on construction sites. - Ensuring compliance with safety regulations and standards. - Conducting safety inspections and audits. - Advising and training employees and contractors on safety issues. - Creating and maintaining safety documentation. - Collaborating with authorities and other relevant organizations.

A company in the automotive and robotics industry is looking for an experienced EHS Specialist to support cell manufacturing processes. The goal of the project is to ensure compliance with environmental, health, and safety regulations and to foster a safety culture within the manufacturing environment. The role requires close collaboration with cross-functional teams to implement and maintain EHS standards, conduct risk assessments, and drive continuous improvement initiatives. Key tasks: - Develop, implement, and maintain EHS policies and procedures tailored specifically to cell manufacturing. - Conduct regular risk assessments and audits to ensure compliance with regulations. - Train and guide employees on EHS best practices. - Investigate incidents and implement corrective actions to prevent recurrences. - Collaborate with internal teams to promote a culture of safety and sustainability. - Monitor and report on EHS performance metrics.

A company is looking for an experienced EHS Specialist to support their Body in White (BIW) operations. Body in White refers to the stage in car manufacturing where the vehicle's sheet metal components are welded together to form the body shell, prior to painting and the installation of the engine, chassis, or interior trim. The goal of the project is to ensure compliance with environmental, health, and safety regulations during this critical manufacturing phase while optimizing processes and maintaining high safety standards. The role involves collaborating with production and engineering teams to identify risks, implement safety measures, and foster a culture of safety within the organization. Key responsibilities: - Conduct risk assessments and ensure compliance with EHS regulations specific to BIW operations. - Develop and implement safety protocols and procedures tailored to BIW processes. - Monitor and report on EHS performance metrics within the BIW stage. - Provide training and guidance to employees on EHS best practices in automotive manufacturing. - Investigate incidents and implement corrective actions to prevent recurrence. - Collaborate with cross-functional teams to improve safety standards and processes in BIW.