Frankfurt am Main, Germany Experience
Oct 2023 - Present
1 year 10 months
- Evaluation of potential providers (Snowflake vs Databricks) and design of the analytics data platform using Databricks
- Data storage and ingestion layer with Amazon S3
- Creation of ETL processes and data transformations with AWS Glue and Databricks notebooks
- Orchestration with AWS Glue Workflow, Databricks Workflows and Databricks DLT
- Processing of unstructured data, including text, images and video
- Databricks workspace setup and administration
- Setting up a medallion architecture to ensure data quality
- Evaluation of BI tools (Power BI, AWS QuickSight, Tableau)
- Establishing MLOps with MLflow
- Implementing data governance and data lineage with Unity Catalog
Oct 2021 - Sep 2023
2 years
- Designing and development of a serverless microservice architecture on AWS
- Migrating existing monolithic services to the microservice architecture
- Productionizing machine learning models with AWS Lambda and ECS
- Automating and building CI/CD pipelines with Bitbucket Pipelines and Docker
- Building user-friendly interfaces with React
- Introducing observability (logging, monitoring, tracing)
Apr 2021 - Aug 2021
5 months
- Support for exercise groups in programming assignments
Oct 2020 - Mar 2021
6 months
- Migration of a data warehouse to Amazon Redshift
- ETL processes and data transformations with KNIME
- Calculation and aggregation of marketing KPIs and analytics in Tableau
- Creating meaningful dashboards for management and department heads
- Preparing data sources for running and evaluating marketing campaigns
- Establishing data governance with Collibra