Ashkan Zadeh
Senior Data Engineer / Senior Data Scientist
Experience
Jan 2022 - Jun 2025
2 years 6 monthsSenior Data Engineer / Senior Data Scientist
Vattenfall Europe
- Advising on the use of analytics and BI tools and services in the Microsoft Azure stack (e.g. MS Fabric, Synapse Workspaces and dedicated SQL pools, SQL Database, PostgreSQL, Snowflake, Databricks, Data Factory, SSIS, Analysis Services, Function Apps, Power BI, ML ...)
- Independent design of analytics solutions with Python, SQL, etc.
- Designing and implementing ETLs and data pipelines
- Creating and maintaining APIs
- Applying CI/CD, testing and version control independently
- Data modeling
- Model development and model optimization
- Anomaly detection with AI
- Predictive analytics
- Technologies used: Snowflake, Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Azure DevOps, Databricks, Spark, CI/CD, SQL Database, Python
Jan 2021 - Dec 2022
1 year Germany
Senior Data Engineer and Data Governance Manager
Statistisches Bundesamt
- Project conception
- Designing a big data architecture for processing very large data volumes
- Designing and implementing ETLs and data pipelines
- Data governance in the CDP
- Data classification and cataloging (e.g. PII detection)
- Metadata management and data inventory
- Access controls and permissions management (access management)
- Supporting the department in planning and carrying out new projects
- Onboarding and training department staff on the Cloudera Data Platform
- Developing automated reporting
- Technologies used: Cloudera, Spark, Kafka, NiFi, Ranger, Atlas, Python, SQL, Azure, Airflow, CI/CD, Power BI, AWS
Jun 2021 - Nov 2021
6 months Germany
Senior Data Engineer & Data Governance Manager
Statistisches Bundesamt
- Data governance in the CDP
- Data classification and cataloging (e.g. PII detection)
- Metadata management and data inventory
- Access controls and permissions management (access management)
- Ensuring GDPR and data protection compliance
- Monitoring data quality and data integrity
- Conducting audits and lifecycle management (archiving/deletion)
- Planning, organizing and executing the project
- Integrating data from HTTP clients, Azure Blob Storage and Azure Data Lake Gen2 with Azure Data Factory
- Branching and chaining activities in Azure Data Factory (ADF) pipelines using control flow activities
- Implementing data pipelines to extract data from various sources
- Transforming data with ADF
- Designing and implementing ETLs and data pipelines
- Technologies used: Cloudera, Hadoop, Spark, Airflow, Hive, Kafka, NiFi, Python, Azure, CI/CD, Power BI, AWS
Aug 2020 - May 2021
10 months Frankfurt, Germany
Senior IoT & Data Engineer
Goethe-Universität Frankfurt & Wölfel GmbH, Volta GmbH
- Developing an architecture for automatic data collection and processing
- Project coordination & monitoring
- Developing cloud-based data engineering and IoT solutions for real-time data
- Developing Stream Analytics jobs for real-time processing and analysis of IoT device data
- Designing and developing ETL pipelines
- Implementing producers and consumers to send or receive data events
- Automated classification of events with AI
- Developing forecasting data
- Applying CI/CD, testing and version control independently
- Technologies used: Azure, Azure IoT Hub, Azure Event Hub, Azure Synapse, Azure Stream Analytics, Spark, Python, SQL/NoSQL, Power BI, scikit-learn, TensorFlow, Optuna
Jan 2019 - Mar 2020
1 year 3 months Germany
Data Engineer
Trumpf SE & Co KG
- Building an architecture with Databricks, PySpark and Delta Lake for SAP data
- Integrating data quality rules into Delta Lake via Blob Storage with PySpark
- Developing PySpark scripts in Databricks notebooks to validate SAP data
- Implementing data quality rules with PySpark and Delta Lake
- Troubleshooting data flows using Databricks tools and Spark logs
- Creating Databricks workflows for automated data quality checks
- Monitoring data quality pipelines with alerts in Databricks
- Generating data quality reports with Databricks SQL and Power BI
- Ensuring SAP data quality with Delta Lake and governance reports
- Technologies used: Snowflake, Azure, Databricks, PySpark, Delta Lake, Blob Storage, Power BI, CI/CD, DevOps
Jan 2018 - Dec 2019
1 yearData Scientist
GMT Ltd.
- Designing and implementing advanced deep learning models for automated detection and classification of breast cancer in radiological image data
- Performing feature extraction to identify relevant image features using convolutional neural networks (CNNs)
- Optimizing model performance through fine-tuning loss functions and hyperparameter tuning with Optuna
- Technologies used: Python, TensorFlow, PyTorch, CNN architectures, Optuna
Oct 2016 - Oct 2020
4 years 1 month Frankfurt, Germany
Tutor
Goethe-Universität Frankfurt
- Introduction to machine learning
- Computer-based signal processing
- Mechanics and thermodynamics
- Nuclear astrophysics
- Research and lab internship
Jul 2008 - Nov 2011
3 years 5 months Dielheim, Germany
IT Administration
St. Hippolyt - Mühle Ebert GmbH
- IT administration tasks
- Monitoring of bottling lines
Summary
- Research focus: data and signal processing and machine learning.
- Execution of several projects in industry and the public sector in Data Engineering & Data Science & Data Governance
Languages
German
Native
English
Advanced
Education
Jan 2018 - Jun 2021
Goethe-Universität Frankfurt
Dr. rer. nat. · Physics · Frankfurt, Germany
Numerical and Experimental Studies on the Classification of Airborne Objects near Wind Turbines
Oct 2016 - Jul 2018
Goethe-Universität Frankfurt
M. Sc., Physics, Nuclear Physics, Astronomy, Signal Processing · Physics · Frankfurt, Germany
Oct 2012 - Jul 2016
Goethe-Universität Frankfurt
B. Sc., Physics, Nuclear Physics, Astronomy, Signal Processing · Physics · Frankfurt, Germany
Certifications & licenses
CDMP Practitioner (Certified Data Management Professional)
CDP Data Governance with SDX
Databricks Certified Data Engineer Associate
Databricks
Freediving
i.a.c.
Class B Driving License
Microsoft Certified: Azure Data Engineer Associate
Microsoft
SnowPro Advanced: Data Engineer
Snowflake
Sport Boat License
Similar Freelancers
Discover other experts with similar qualifications and experience