Tech & Product Lead AI Development

Worked with a Language Model (LLM) infrastructure, initially created in 2023, transitioning from proprietary OpenAI APIs to a variety of open-source LLM frameworks with the goal to interpret and analyze a large number of scanned and PDF documents for a specific domain.

Defining the architecture, implemented and integrated some document reader modules and autonomous agents, leveraging the capabilities of the LangChain framework to enhance functionality.

Implemented and refined relevance and generative adversarial network (RAG) schemes, improving the system's interpretative and responsive capabilities.

Conducted a assessment of multiple vector databases, identifying optimal solutions for efficient data indexing and retrieval to support sophisticated language models.

Led the development of a language model (LLM)-based document analysis platform for a pioneering US startup, enhancing the capability to process and understand large volumes of textual data. Configured and deployed LLM solutions, utilizing OpenAI's models to create a robust framework for document parsing, analysis, and interpretation. Collaborated closely with data scientists to integrate advanced LLM functionalities, including OpenAI's ChatGPT and bespoke open-source models, to tailor the system to the unique analytical needs of the startup. Used Langchain to construct dedicated agents, providing seamless interaction and retrieval of information across the platform. Investigated and evaluated a suite of vector databases, mainly Weaviate, for optimal data storage and quick querying, significantly improving the initial solution's performance.

Leading the development and successful deployment initially of a Proof of Concept (PoC), followed by the launch of the final production-ready solution. The product is consisting of the backend business logic, which is running on an embedded device. The second part is the mobile frontend based on Ionic (Android, iOS), targeting a market entry in Q1, 2025.

Defined and implemented a mobile application for iOS and Android using Ionic and Angular, integrating the mobile client with the embedded Golang server. Implementing specific system services for IR, BLE and 433 MHz subsystems. Implementing the backend with IoT and edge computing capabilities for real-time data processing. Starting to analyze different user behavior to provide even better user experience.

Implemented the automatic generation of credentials (serial number, WLAN details, ansible related details etc.) product generation flow based on n8n and PocketBase. Implemented the automatic image and configuration system for an Ubuntu target based on custom PocketBase (Golang) business logic and Ansible for system setup and configuration.

Implemented a diverse range of sensor and radar technologies to enhance device interactivity and data accuracy to improve healthcare monitoring and diagnostics use cases. Defined three LLM-based use cases and implemented the initial FTI pipeline based on initial MLOps scenarios and current tooling. The first use case uses the customer and internal documentation and uses a local model, Ollama, RAG, a vector database and a dedicated UI to allow users to chat with the AI Agent. Various fine-tuning sessions (LoRa) were part of this task. The second use case will analyze log data to improve the products. The third use case is based on radar technology to analyze user/patient health state etc. with a visual transformer model.

Planning closely with the startup team to ensure a seamless handover of the current solution, including detailed documentation and user guides created with Figma and wireframing tools.

Setting up team/company related tools (mailcow, n8n, nextcloud).

Worked on the design and implementation of one of the world's first intelligent Vehicle-to-Grid (V2G) systems for electric vehicles (EVs), focusing on an intelligent scheme for bi-directional energy distribution. Covering end-to-end project tasks, from concept to implementation, creating a scalable environment for Wallbox/HEM (Home Energy Manager) pooling systems. Built proof of concept (PoC) models and evolved them into a fully functional demo, enabling the team to conduct initial test deployments.

Orchestrated stakeholder meetings, aligning multiple companies and development teams to ensure project cohesiveness and goal alignment. Analyzed and mapped data flow scenarios within the electrical grid marketplace to optimize the energy distribution logic for battery electric vehicles (BEVs).

Finalized the project with the delivery of a Minimum Viable Product (MVP), seamlessly transitioning the system for partner integration and field deployment. Demonstrated expertise in system architecture, delivering a robust solution capable of supporting future expansions and integrations.

Worked as CTO, leading development teams for two ventures with a focus on digitalizing the travel industry. Implemented a 'mobile-first' strategy to enhance user experience and workflow efficiencies. Managed offshore teams across multiple countries, emphasizing the construction of scalable systems to support business growth. Guided the development team in adopting modern methodologies and exploring new technological avenues for system enhancement. Oversaw the development of microservice-based backend infrastructures, ensuring robust, maintainable, and scalable applications. Developed user-friendly dashboards using Angular and crafted mobile applications with a combination of Angular and Ionic, prioritizing responsive design and cross-platform compatibility. Established Kubernetes-based production environments, promoting high availability and facilitating continuous integration and delivery processes. Utilized NestJS and Quarkus for backend development, fostering a robust and agile environment conducive to rapid iteration and deployment.

Worked on a comprehensive evaluation of machine learning applications within the context of bank security, focusing on the enhancement of alerting mechanisms and video stream analytics. Utilized Nvidia's hardware infrastructure to develop advanced machine learning models, significantly improving the detection and response capabilities for security incidents. Formulated a strategic proposal that outlined the scope and roadmap for a final proof of concept (PoC), highlighting key stages and requirements for the full implementation of machine learning solutions. Identified necessary follow-up actions to transition from the PoC phase to full deployment, ensuring the alignment of the project with the bank's security objectives and technological capabilities.

Developed a comprehensive live streaming platform tailored for concerts, conferences, and group chats, inclusive of an integrated ticketing system that handles backend processes and front-end user interactions. Built and integrated a multifaceted file exchange, chat, and collaboration system coupled with a robust payment processing framework. Analyzed real-time data to identify trending topics, informing content curation and enhancing user engagement. Established a scalable infrastructure capable of accommodating a growing user base and fluctuating demand. Directed UX/UI development, from creating wireframes and user stories to managing their execution with an offshore team in India, focusing on a clean and intuitive interface. Worked on connecting microservices securely, ensuring data protection and system integrity. Orchestrated the DevOps strategy, including continuous integration and deployment (CI/CD), monitoring, and system resilience. Implemented a WebRTC-based solution for versatile video/audio/data interactions across multiple streaming modalities (one-to-one, one-to-many, many-to-many). Configured a scalable proxy frontend utilizing Traefik and Keycloak for enhanced API security, authentication, and authorization protocols. Enabled diverse connectivity options among front-end applications, clients, and the backend systems through REST, gRPC, and GraphQL. Integrated third-party services for video streaming, collaboration, and file sharing, enriching the platform's functionality. Implemented a video streaming pipeline employing machine learning to provide adaptive streaming quality and additional feature sets.

Working as a Senior Technical Architect overseeing numerous projects focused on the integration and analysis of systems in Smart Cities, Smart Sensors, IoT, and traffic signaling/prediction. Developed software architectures to facilitate the connectivity of external systems with Siemens Concert/Sitraffic systems, ensuring smooth data interchange and system functionality.

Defined the architecture of a scalable Data Space environment based on microservices for a new IoT infrastructure, enhancing the big data analysis capabilities. Defined ontologies for data objects and strategies for metadata enrichment during the data ingestion process, contributing to more refined data analytics.

Created a secure, data-driven flow system to ensure data integrity and privacy across all channels. Designed and deployed Kafka Stream/Connect components to handle high-throughput data processing, providing robustness and reliability. Executed several proof of concept (PoC) variations for the Data Broker component.

Defined communication protocols for Center-to-Center interactions, playing a crucial role in international traffic management initiatives. Transitioned Hadoop-based PoCs to a more agile and efficient Presto SQL solution concept, optimizing for real-time data processing. Maintained a regular schedule of code reviews and daily discussions with the development teams, addressing a wide spectrum of technical challenges and ensuring best practices.

Managed two offshore development teams based in Pune, India, overseeing system architecture decisions, framework selection, and code review processes, supplemented by face-to-face workshops to enhance team collaboration.

Defining the migration process and all needed UI/UX components for an existing "in train" portal to current technologies (frontend). Implementing the migration tools, setting up the new system. Implementing the new ICE portal based on the defined structure and Angular 6/7 from scratch based on the rules of Atomic Design. Defining UE atoms, molecules, organisms. Implementing business logic in TypeScript.

Conducted a comprehensive market analysis to assess emerging trends and technologies in the Home Appliance and SmartHome sectors, informing BSH's strategic direction in IoT and connectivity. As a result driving the integration of internal projects between BSH and Bosch, fostering enhanced collaboration and exchange of technology insights. Defining and implementing of proof of concept (PoC) solutions employing machine learning, deep learning, and natural language processing (NLP) to advance home automation. Collaborated with BOSCH Corporate Research teams in Renningen and Sunnyvale (USA) to refine NLP tools and establish an abstraction layer for intelligent device communication. Worked on a concept and guidelines for content format creation within the company, geared towards nurturing a community-driven approach to content engagement. As a result conceptualized a potential content management system (CMS) tailored for connected device ecosystems, ensuring seamless content delivery and interaction. Explored and integrated additional functionalities such as gesture recognition into SmartHome products, enhancing the user experience. Demonstrated and architected advanced browser-based applications and novel UX methodologies for embedded systems, leveraging Angular and Qt 5. Abstracted natural language input/output processes, integrating cutting-edge machine learning and NLP techniques to refine user-device interactions. Formulated a robust CMS architecture and an end-to-end ecosystem, capable of supporting the diverse needs of SmartHome solutions. Organized and led workshops to disseminate knowledge, establish common ground for various technical topics, and encourage the practical application of machine learning and NLP in product development.

Performed a wide, holistic analysis of existing platforms to craft strategic roadmaps, delineating the progression path for next-generation connected devices. Formulated and validated various proof-of-concept (PoC) models, which served as the cornerstone for the design and architecture of connected devices, steering the project toward innovative solutions. Defined and implemented the system design and architecture for connected devices, ensuring seamless integration within SmartHome ecosystems and advanced language processing frameworks. Assessed various embedded Linux environments, including Tizen, AGL, Genivi, and MEL, to identify optimal platforms for device operations. Defined a suite of content formats tailored for internal and community engagement, enhancing the collaborative content creation process. Designed a versatile content management system (CMS) suitable for a connected device setting, facilitating content dissemination and user interaction. Analyzed and integrated NLP and speech control add-ons, enriching the device's interactive capabilities. Showcased and structured browser-based application technologies using AngularJS and Qt 5, tailored for embedded solutions, thereby optimizing user interface efficiency. Specified upcoming use cases, drawing a clear roadmap for future application development and user engagement strategies. Abstracted natural language input/output to streamline device communication, deploying machine learning and NLP methods to simplify user-device interactions. Conducted evaluations of GUI frameworks suitable for entry-level embedded systems, aiming to enhance the user experience while maintaining system simplicity. Proposed comprehensive system architectures for app ecosystems and frameworks, ensuring their cohesion with the integrated SmartHome environment. Managed workshops, encouraged hands-on PoC development, and fostered a community of sharing and collaboration among stakeholders and technical teams.

Implementing a Location Based Services scheme for iBeacons on Android.

As Co-Founder and CTO played a pivotal role in outlining the scope, defining use cases, and architecting the foundational structure for a startup specializing in location and context-based services for targeted mobile advertising. Directed the development of client-side and all server-side components, including a dynamic dashboard for real-time data monitoring and management. Deployed in-house location-based and sensor services optimized for energy efficiency, ensuring robust performance for mobile applications. Established a robust big data analysis system designed to manage key performance indicators (KPIs) and intelligent ad targeting scenarios, enhancing the effectiveness of marketing efforts. Created and launched a custom, scalable, cloud-based push notification service as a major enabler alongside a comprehensive big data analytics infrastructure, to allow for timely and relevant user engagement. Developed the database architecture for both client and server environments, ensuring data integrity and seamless flow between systems. Implemented the Android Software Development Kit (SDK) and developed Android applications, complemented by an AngularJS-based dashboard and a Grails-based RESTful API, providing a full-stack solution. Assessed various browser runtime solutions, such as Cordova and Ionic, for their capability to handle background processing tasks effectively. Led and coordinated efforts of a geographically dispersed development team, overseeing multiple sites and ensuring a cohesive development strategy across on-site and offshore units.

Leading the development of a comprehensive technical infrastructure for a global music marketing portal, facilitating both digital and physical distribution. Managed the entire IT framework, enhancing the portal's aesthetics, functionality, and security, while ensuring robust cloud computing and ecommerce capabilities.

Implemented RESTful interfaces, JSON, open APIs, and XML for seamless interactions with music labels and online stores.

Automated the ecommerce processes, streamlining operations and improving user experience. Defining and implementing content management strategies, including cloud storage solutions and backup systems, to handle vast content volumes efficiently. Working and various legal intricacies, including international tax strategies, and compiling investor documentation to secure and maintain project funding.

Directed comprehensive project management activities for a diverse international team, consisting of developers and designers, ensuring coherent collaboration and timely delivery of project milestones. Driving the transition from the initial monolithic architecture to a more modern microservices approach, increasing the system's scalability and maintainability.

Designed and implemented mobile applications for Android and an Ionic-based media player for enhanced mobile access, catering to the platform's expanding mobile user base.