Daniel Pape
Professional Development
Experience
Professional Development
Attained AWS Certified Cloud Practitioner certification.
Mastered Rust through self-study, including books, online courses, and open-source contributions.
Developed a serverless web application using AWS (RDS, Lambda, Polly, Amplify) and TypeScript/React/D3, managed infrastructure with CDK.
Continuously stayed updated with industry trends through self-education, webinars, and workshops, exploring Data Mesh and FastAPI.
Data Engineer (Freelance) – Clustering of POI data
Refactored Airflow pipeline and library code for clustering and preprocessing, improved documentation and code quality with defensive programming techniques.
Designed and implemented a new Azure cloud solution using Databricks, integrating data from AWS S3 and Azure Blob Storage, developing library code and Spark jobs for geospatial clustering.
Created a Python wrapper for an open-source Scala graph clustering library to enable Python integration.
Collaborated with developers and testing team to eliminate bugs and increase test coverage for an Azure Functions service that processes vehicle signal streams using Redis.
Contributed to code reviews, PI planning, testing, and documentation.
Data Engineer (Freelance) – Data and scores delivery for CRM
Designed and constructed ETL pipelines for contract and usage data, generating features for machine learning models.
Implemented machine learning pipelines for churn scoring, next-best-action, and customer behavior prediction in AWS (S3, Kinesis, Athena, EMR, Glue).
Collaborated on transitioning Data Scientist-developed models from experimentation to production.
Automated data exports and score transfers into the central event bus.
Established data quality monitoring using Great Expectations.
Assisted with MLOps spike assessment, researching feature store integration and evaluating workflows and repositories.
Data Engineer (Freelance) – Big Data Lake Extension for Realtime Campaign Management
Gathered and analyzed requirements from stakeholders for extracting data from an external API to AWS Big Data Lake and Redshift.
Clarified NLP and API design issues with SaaS platform contacts and stakeholders.
Extended documentation in Confluence.
Prepared logical data model and conceptual ETL pipeline design.
Developed proof of concept for streaming data from Kafka to S3 using Databricks Delta Lake.
Software Developer
Freelance
- Build individual solutions with a focus on Data and Machine Learning Engineering.
Software Developer (Freelance) – Cloud Data Lake Analytical Interface
Used Apache NiFi for proof of concept extraction from source systems to S3 and Kinesis.
Developed Scala and Spark services for ETL of various source systems to AWS.
Implemented Kimball-style fact and dimension table transformations.
Created ETL pipelines using Spark and Scala based on analytics specifications and Tableau Prep Flows.
Developed and scheduled Spark jobs on EMR via Apache Airflow.
Mentored coworkers in Scala and Spark through pair programming.
Built a custom Scala mini-framework for type-safe Spark DataFrame transformations and testing.
Integrated and replaced data sources, developed integration and unit tests, debugging, and execution tests.
Data Engineer
codecentric AG
Worked in a business unit focused on Data Science and Machine Learning, contributing to customer and in-house projects.
Technologies: Scala, Kotlin, Python, SQL, Spark, Kafka, Airflow, AWS, Kubernetes, Docker.
Scala Developer
DIGITEC GmbH
- Implemented features for the upcoming version of the company's flagship desktop software suite as part of a Scrum team.
Industries Experience
See where this freelancer has spent most of their professional time. Longer bars indicate deeper hands-on experience, while shorter ones reflect targeted or project-based work.
Experienced in Information Technology (10 years).
Business Areas Experience
The graph below provides a cumulative view of the freelancer's experience across multiple business areas, calculated from completed and active engagements. It highlights the areas where the freelancer has most frequently contributed to planning, execution, and delivery of business outcomes.
Experienced in Information Technology (10 years), Business Intelligence (9.5 years), Research and Development (7 years), Product Development (1.5 years), and Quality Assurance (0.5 years).
Summary
Software Engineer with 5+ years experience in building data-driven education software solutions. Enabled companies to take advantage of their data by building Machine Learning services to optimize their ad revenue up to building a data lake integrating various data sources to create a company-wide 360-degree view of their most important data in the cloud allowing actionable insights.
Skills
- Scala
- Kotlin
- Python
- Sql
- Spark
- Kafka
- Airflow
- Aws
- Kubernetes
- Docker
Languages
Education
Georg August University of Göttingen
PhD · Mathematics · Göttingen, Germany
University of Wuppertal
Diploma · Mathematics and Computer Science (minor) · Wuppertal, Germany
Certifications & licenses
Building Kafka Solutions
Confluent
AWS Certified Cloud Practitioner
AWS
Amazon Detective Deep Dive
A Cloud Guru
Applied AI With Deep Learning
Coursera
BerkeleyX – CS190.1x: Scalable Machine Learning
EdX
Building Machine Learning Pipelines On AWS
A Cloud Guru
Cluster Analysis In Data Mining
Coursera
Data Streaming Nanodegree
Udacity
Databricks Lakehouse Fundamentals
Databricks Academy
Deploying Applications With AWS CDK
A Cloud Guru
Developing Data Products
Coursera
Exploratory Data Analysis
Coursera
Functional Programming Principles In Scala
Coursera
Getting Started With Google Kubernetes Engine
Coursera
Introduction To Big Data With Apache Spark
EdX
Kotlin For Java Developers
Coursera
Pattern Discovery In Data Mining
Coursera
Practical Event-Driven Security With AWS
A Cloud Guru
R Programming
Coursera
Statistical Inference
Coursera
Terraform Basics
Coursera
Text Mining And Analytics
Coursera
Profile
Frequently asked questions
Do you have questions? Here you can find further information.
Where is Daniel based?
What languages does Daniel speak?
How many years of experience does Daniel have?
What roles would Daniel be best suited for?
What is Daniel's latest experience?
What companies has Daniel worked for in recent years?
Which industries is Daniel most experienced in?
Which business areas is Daniel most experienced in?
Which industries has Daniel worked in recently?
Which business areas has Daniel worked in recently?
What is Daniel's education?
Does Daniel have any certificates?
What is the availability of Daniel?
What is the rate of Daniel?
How to hire Daniel?
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
Similar Freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Professional Development
Nearby freelancers
Professionals working in or nearby Hamburg, Germany