Senior Data Engineer

Development of a data platform for precision medicine research for the pharma and biotech industries as part of multi-omics integration.

Responsibilities:

• Design and deployment of Azure-based data lakehouse solutions, including Azure Databricks. This included configuring the Unity Catalog and setting up the network.

• Implement complex data engineering pipelines for ingestion, transformation, and persistence of data into Delta tables using Python, Scala, and SQL, ensuring readiness for analytics and downstream workflows.

• Data lake ingestion using real-time streaming and batch technologies like Kafka, Spark Structured Streaming, and Event Hubs.

• Automated deployment of the lakehouse platform on Azure DevOps pipelines using IaC with Terraform (azurem) for version control, deployment, and automated testing.

• Integration of Databricks with Azure ADLS Gen2 and identity management (managed identities, access connectors) to optimize governance and access control.

• Implement data privacy measures to comply with GDPR, including pseudonymization and anonymization of user identifiers, role-based access control (RBAC) with Azure AD integration, data retention policies with automated deletion workflows, column- and row-level security, and data masking.

• Ensure data quality using the Expectation Management framework.

• Support internal teams by setting up self-service environments, configuring clusters, documenting setup processes, and troubleshooting deployment issues. I am available as of 03.11.2025.

Clients: ORAYLIS GmbH, Telefónica Deutschland

• Technical leadership at the project level, coordinating teams of up to five people.

• Responsible for designing, implementing, and successfully deploying new cloud data solutions to production.

• Close collaboration with stakeholders and technical coaching within the team.

Projects & Results

• Migrated an Oracle Exadata on-premise DWH to the cloud.

• End-to-end development of data-driven applications, including support and documentation.

Clients: Volkswagen Financial Services (VWFS)

• Created automation dashboards with PowerShell Universal and Azure Intune.

Technologies: Azure Databricks, Spark (Scala, SQL, Python), Synapse Analytics, Kafka, Power BI, Azure DevOps, ADLS Gen2, Spark Structured Streaming, PowerShell Universal, Microsoft Azure Intune.

Development of ETL pipelines and web interfaces to automate ordering and delivery processes, inventory checks, payments, shipping, and customer feedback in the e-commerce sector.

• Full-stack development of web applications and web portals.
• Database administration and troubleshooting.
• Testing and designing test plans.

Technologies: PHP, Java, Python, JavaScript