Rodrigo Herrán

Data Engineer and Founder

Avatar placeholder
Munich, Germany

Experience

Jan 2025 - Present
1 year 1 month
Munich, Germany

Data Engineer and Founder

SapientVase GmbH

  • Responsible for company strategy, product development, business development, and operational execution
  • Developed a data platform for precision medicine research in the pharma and biotech industry as part of multi-omics integration
  • Used Databricks (Unity Catalog, ETL, ML), ADLS Gen2, Azure Data Factory, Azure DevOps, Python, PySpark, Scala, SQL, R, GX
  • Built a Delta Lakehouse with Medallion Architecture
  • Used MLflow for machine learning
  • Created dashboards with PowerBI, Dash, Bootstrap, Matplotlib, Seaborn, Biopython
  • Developed an OpenAI interface
Apr 2024 - Jun 2024
3 months
Zürich, Switzerland

Data Engineer (Freelance)

Callista ACE AG

  • Developed cloud applications and infrastructure for the client DENNER AG
  • Designed and implemented a data quality testing and validation strategy for an Azure Data Lakehouse with batch and stream processing using the Medallion architecture
  • Developed data pipelines in a Lakehouse Medallion architecture
  • Used Synapse, Data Factory, Azure Functions, Event Hubs, Terraform, C#, and Python
Mar 2023 - Dec 2024
1 year 10 months
Munich, Germany

Data Engineer (Freelance)

Confiniti GmbH

  • Maintained big data pipelines for ORAYLIS GmbH, Telefónica Germany, and VWFS
  • Built real-time streaming and batch ETL workflows
  • Migrated Oracle Exadata on-premises to a cloud data warehouse
  • Developed applications from requirements analysis to production, support, and documentation
  • Used Azure Databricks, Spark (Scala, SQL, Python), Synapse, Kafka, PowerBI, Azure DevOps, ADLS Gen2, and Spark Structured Streaming
  • Created dashboards for workload automation with PowerShell Universal and Microsoft Azure Intune
Sep 2016 - Nov 2022
6 years 3 months
Munich, Germany

DevOps & Data Engineer

NTT DATA DACH

  • Designed, developed, and maintained big data pipelines for Deutsche Börse and BMW
  • Developed a platform for C7 SCS (Securities Clearing Services: EUREX SCS Reporting Engine) using Azure Data Factory, Azure Functions, and Databricks
  • Built the data platform with Hadoop (HDFS/YARN/Spark), App Services (Scala, Python), Kafka, Java, and AMQP
  • Full-stack development of microservices applications for EV remote services using Java, OpenShift/Kubernetes, and Docker
  • Implemented CI/CD pipelines for unit, integration, and load test automation
  • Designed, implemented, and documented application and data pipeline architectures
  • Database design, connectivity, and migration (Oracle, PostgreSQL)
  • Managed deployments (testing, staging, production), monitoring, and performance tuning of Hadoop environments
  • Analyzed business and technical requirements and provided coaching and team coordination
Jan 2015 - Aug 2016
1 year 8 months
Munich, Germany

Web Developer

Schönberger-Group

  • Developed ETL pipelines and web interfaces to automate order and delivery processes, inventory checks, payments, shipping, and customer feedback
  • Full-stack development of web applications in Java, PHP, and Python
  • Database administration and troubleshooting
  • Tested and designed test protocols

Summary

Experienced Data Engineer with a proven track record in designing, developing, and maintaining big data pipelines for real-time streaming and batch ETL workflows.

Skilled in microservices architecture, developing software applications with RESTful APIs, and knowledgeable in full-stack web development, test automation, and data quality assurance.

Adept at working in agile environments (Scrum, Kanban) and experienced in coordinating onshore and nearshore teams to ensure successful project delivery.

Skills

Integration

  • Databricks
  • Azure Synapse
  • Azure Data Factory
  • Azure Functions
  • App Services
  • Pyspark
  • Spark
  • Azure Event Hubs
  • Azure Iot Hub
  • Adls Gen2
  • Microsoft Fabric
  • Sql
  • T-sql
  • Plsql
  • Ssis
  • Ssas
  • Spark Structured Streaming
  • Apache Kafka
  • Kafka Streams
  • Kafka Connect
  • Ksql
  • Data Warehouse Architecture
  • Data Lakehouse Architecture
  • Hadoop/hdfs
  • Hive

Script

  • Python (Flask, Pytest, Numpy, Gx, Seaborn, Sklearn, Pandas, Biopython)
  • Dash
  • Fastapi
  • Ml Flow (Python)
  • Scala
  • R
  • Perl
  • Powershell

Ci/cd And Devops

  • Azure Devops
  • Iac - Terraform
  • Openshift
  • Jenkins
  • Kubernetes/aks
  • Microservices Architecture
  • Payara
  • Docker
  • Ansible
  • Apache Nifi
  • Apache Airflow
  • Java
  • .Net C#
  • Git
  • Maven
  • Gradle
  • Elasticsearch
  • Kibana
  • Gatling
  • Flyway

Monitoring

  • Azure Monitor
  • Prometheus
  • Grafana
  • Nagios
  • Elasticsearch
  • Kibana

Web Design

  • Javascript
  • Jquery
  • Angular
  • D3.js
  • Bootstrap
  • Swagger
  • Restful

Databases

  • Oracle
  • Ms Sql Server
  • Postgresql
  • Mysql
  • Nosql
  • Cosmosdb
  • Mongodb

Languages

German
Advanced
English
Advanced
Spanish
Advanced

Education

Oct 2010 - Apr 2014

Technische Universität Hamburg

Master of Science · Information Technology · Hamburg, Germany

Mar 2003 - Jul 2007

Universität Guadalajara

Bachelor of Science · Computer Science · Guadalajara, Mexico

Certifications & licenses

DP-203 Certified Azure Data Engineer Associate

Confluent Certified Developer For Apache Kafka (CCDAK)

Managerial Economics and Business Analysis (Online Specialization)

University of Illinois at Urbana-Champaign

Need a freelancer? Find your match in seconds.
Try FRATCH GPT
More actions

Similar Freelancers

Discover other experts with similar qualifications and experience

Stephan Sahm
Stephan Sahm

Senior Data/ML Consultant & Technical Lead

View Profile
Serge Kalinin
Serge Kalinin

MLOps (machine learning operations)

View Profile
Anton Klonov
Anton Klonov

Head of Technical Overall Integration NSC / Hadoop Cloud Development

View Profile
Christian Schulz
Christian Schulz

Data-Scientist/AI Engineer

View Profile
Jorge Machado
Jorge Machado

Data Architect

View Profile
Thomas Hoefkens
Thomas Hoefkens

Senior MLOps, DevOps Engineer

View Profile
Eduard Van kleef
Eduard Van kleef

Workshop Leader 'Introduction to AI Development Tools'

View Profile
Guino Ndjenndja
Guino Ndjenndja

Senior Data Engineer

View Profile
Max Ritter
Max Ritter

Cloud (AWS) | AI | DevOps | Data

View Profile
Martin Mauch
Martin Mauch

Freelance Data Architect

View Profile
Himanshu Negi
Himanshu Negi

Principal (Data Scientist/Data Engineer/Gen AI Engineer)

View Profile
Ashkan Zadeh
Ashkan Zadeh

Microsoft Azure Senior Data Engineer / Senior Data Scientist

View Profile
Axel Berron
Axel Berron

Microsoft Fabric & Power BI Developer

View Profile
Vladislav Lasmann
Vladislav Lasmann

Freelance Data Engineer / Architect

View Profile
Philipp Brunenberg
Philipp Brunenberg

Instructor

View Profile
Stefan Corsten
Stefan Corsten

SSIS Development

View Profile
Ronald Foerster
Ronald Foerster

IT Consultant & Continuing Education

View Profile
Martin Musiol
Martin Musiol

Product Owner AI Learning Platform

View Profile
Ildar Allayarov
Ildar Allayarov

Senior Data Engineer

View Profile
Felix Bruckner
Felix Bruckner

Data Consultant & Technical Lead DataVerse

View Profile
Manuel Pasieka
Manuel Pasieka

AI Engineer

View Profile
Pappu Prasad
Pappu Prasad

Senior Cloud Consultant (AWS Services and Consulting)

View Profile
Michael Fecher
Michael Fecher

Freelancer, Solution Architect

View Profile
Alexander Zhirov
Alexander Zhirov

Senior Data Architect & Data Engineer

View Profile
Ivaylo Sieme
Ivaylo Sieme

Cloud Architect & AI Engineer

View Profile
Karl Estermann
Karl Estermann

incl. CI/CD, automation

View Profile
Philipp Grunert
Philipp Grunert

Data Scientist & Data Engineer

View Profile
Yannick Reinke
Yannick Reinke

Power Platform Developer

View Profile
Matthias Isler
Matthias Isler

Fractional CTO (Principal Engineer / Technical Architect)

View Profile
Louis Guitton
Louis Guitton

Freelance Solutions Architect and Machine Learning Engineer

View Profile