Vili Dhamo
Senior Data Engineer, Data Architect, Software Engineer
Experience
Technical Lead, Data Engineer
Mercedes-Benz Consulting
- Optimized the data architecture (medallion) to better decouple processing stages and improve transparency and reproducibility
- Ensured technical quality of data processing in Databricks by introducing schema enforcement, data quality checks and a structured data architecture
- Orchestrated pipelines with Azure Data Factory
- Professionalized and automated the development and deployment process by integrating Git and GitHub Actions
- Led the Data Engineering team (3 members) in a functional role
- Conducted workshops to optimize and stabilize the data platform and the development process
- Collected and prioritized new requests, maintained the product backlog
- Technologies: Microsoft Azure (Data Lake, Data Factory), Databricks, Apache Spark (PySpark), Python, SQL, Git, Confluence, Power BI, Power Apps, Dataverse, MS SharePoint, Mural
Project Manager, Solution Architect, Data Engineer
Mercedes-Benz Consulting
- Led a development team (7 members) with responsibility for architecture design, data modeling and backend development
- Developed and optimized data processing steps in Databricks
- Created and orchestrated ETL pipelines using Databricks Jobs
- Performance optimization, testing, debugging
- Project management, stakeholder management, support during go-live phase
- Requirements engineering, consulting on solution design
- Applied agile project management methods, including creating and maintaining the product backlog
- Technologies: Microsoft Azure (Data Lake, FunctionApp, WebApp), Databricks, Apache Spark (PySpark), Python, SQL, Git, Jira, Confluence, Power BI, MS SharePoint, Mural
Data Engineering Lead, Data Engineer
Mercedes-Benz Consulting
- Functionally responsible for developing new features for the company's internal AI-based Q&A system
- Onboarded and processed new data formats, optimized system integration and performance with large data volumes
- Coordinated and integrated interfaces to the client's external IT systems, responsible for system connectivity
- Technologies: AWS (EC2, S3, Glue, Lambda, Step Functions, DynamoDB, Neptune, Athena, SageMaker, OpenSearch Service, Cloud9, CLI, ECS, API Gateway, Cognito, CloudFormation, CodeCommit, CloudWatch, SNS), Microsoft Azure, Databricks, Apache Spark (PySpark), Python, SQL, REST APIs, Postman, Jira, Git, Confluence
Project Manager, Data Engineer
Mercedes-Benz Consulting
- Designed and developed ETL pipelines in Databricks to process and provide production data for process mining analysis tools
- Developed configuration logic for the ETL pipelines to apply to different production plants and prepare data for various aggregation levels
- Agile project management, customer communication, requirements engineering
- Documented the data pipelines and their configurations
- Technologies: Microsoft Azure, Databricks, SQL, Python, Apache Spark (PySpark, Structured Streaming), YAML, Power BI, PAFnow, Git, OneNote
Product Owner, Solution Architect, Data Engineer
Mercedes-Benz Consulting
- Functionally responsible for data engineering, including onboarding, processing and unifying content from documents, relational databases and audio/video
- Led the data engineering team (up to 5 members) in a functional role
- Managed external service providers for product development, improving system stability and quality
- Designed and developed ETL pipelines with AWS Lambda, Glue, ECS and Step Functions
- Designed and developed a graph database with Amazon Neptune for storing and querying data and relationships using Cypher
- Developed JSON, XML and PDF parsers to extract relevant content
- Integrated a speech-to-text LLM into the ETL pipelines to extract content from audio and video files
- Developed unit tests (PyTest, unittest) and automated testing
- Designed the architecture and interfaces between product modules and external systems
- Defined the product, created and prioritized the product backlog, tracked development progress with Jira
- Communicated between stakeholders and the development team, documented in Confluence
- Technologies: AWS (EC2, S3, Glue, Lambda, Step Functions, DynamoDB, Neptune, Athena, SageMaker, OpenSearch Service, Cloud9, CLI, ECS, API Gateway, Cognito, CloudFormation, CodeCommit, CloudWatch, SNS), Python, Cypher, REST APIs, Postman, Jira, Git, Confluence
Project Lead, Solution Architect, Data Engineer
Mercedes-Benz Consulting
- Technical lead of the project team, design of the target architecture (Medallion)
- Creation of the migration plan and orchestration of migrating on-premises MS SQL databases to Azure Data Lake
- Analysis of existing Pentaho data pipelines and translating them into Databricks ETL pipelines
- Adapting Power BI dashboards and connecting them to Azure Data Lake
- Documenting the migration steps, target architecture, and data pipelines in Confluence and handing over to the maintenance team
- Technologies: Microsoft Azure (ADLS Gen2, Data Factory), Databricks, Power BI, Pentaho, Git, Confluence, Apache Spark (PySpark), SQL, Python, Microsoft SQL Server
Project Lead, Power BI Dashboard Developer
Mercedes-Benz Consulting
- Agile project management with KanBo, customer communication
- Requirements engineering and consulting on solution design
- Building the data model and defining measures (DAX) to calculate KPIs
- Developing the Power BI dashboard and connecting source data from MS SharePoint
- Creating a playbook and deploying it in the Power BI Service
- Documenting the data model and development in Git
- Technologies: Power BI, DAX, Power BI Service, MS SharePoint, MS Office, KanBo, Git
Methodology Expert, Data Engineer
Mercedes-Benz Consulting
- Exploratory analyses and ML-driven data analyses including correlation analysis and feature engineering
- Development of a Python algorithm to identify and handle missing or inconsistent data
- Design and development of a forecasting model in Databricks to predict the sales trend of digital services, evaluating and optimizing forecast accuracy
- Development of a method to simulate what-if scenarios to support data-driven decision-making
- Technologies: Microsoft Azure, Databricks, SQL, Python, Apache Spark (PySpark), Git, Mural, Power BI
Methodology Expert, Software Developer
Lufthansa Systems
- Development of a platform-independent C++ core library for calculating the Earth's magnetic field and central geodetic problems
- Providing different solutions based on precision and performance requirements
- Development of a web-based testing application in JavaScript and CSS
- Implementation of wrappers in Java, C#, and C
- Bug analysis and fixing
- Implementation and optimization of CI/CD processes in TeamCity
- Development of unit tests and test automation
- Creating and maintaining technical and functional documentation with Doxygen
- Technologies: C++, JavaScript, CSS, C#, C, Java, MS Visual Studio, .NET (Framework/Core/Standard), LiteDB, Git, Jira, Bitbucket, TeamCity, SourceTree, CMake, NuGet, Doxygen
Methodology Expert, Software Developer
Lufthansa Systems
- Design and implementation of a C++ library for visualizing aeronautical routes
- Using evolutionary algorithms and heuristics based on Kohonen networks
- Development of a web-based testing application in C# and .NET
- Implementation of wrappers in Java, C# (.NET Framework, .NET Standard), and C
- Bug analysis and fixing
- Implementation and optimization of CI/CD processes in TeamCity
- Development of unit tests (using Catch) and test automation
- Creating and maintaining technical and functional documentation with Doxygen
- Technologies: C++, C#, C, Java, MS Visual Studio, .NET (Framework/Core/Standard), Git, Jira, Bitbucket, TeamCity, SourceTree, CMake, NuGet, Doxygen
Customer Support Manager, Business Analyst
Lufthansa Systems
Functional support of a system to support reactive and proactive pricing for a Tier 1 airline (at least 25 million passengers per year)
Specification of customer requirements and preparation of proposals for change requests
Creation of the functional specification for new product features
Technical project management and functional leadership of the development team (6 members)
Monitoring project progress and cost tracking
Liaison between customers, development, maintenance, and operations teams
Incident analysis, coordination, prioritization, and monitoring of issue resolution
Conducting system and integration tests
Delivering presentations and training to the customer's IT department
Technologies: SQL, Jira, Confluence, MS Office
Methodology Expert, Software Developer
Lufthansa Systems
Time series analysis on bookings, cancellations, no-shows, etc. to identify events, seasonality, trends, anomalies, and noise
Development of decomposition and smoothing methods to handle anomalies
Modeling, implementation, and calibration of statistical and OR methods in C++ to improve demand forecasting
Development of a new generalized linear model (GLM) to improve cancellation forecasts and integration into the existing system
Comparative analysis of different modeling approaches (time series, regression models)
Generalization and refactoring of existing C++ components to improve scalability
Development of components for automated monitoring and ensuring data integrity
Measurement, analysis, and interpretation of forecast quality on large datasets
Bug identification and resolution, as well as implementation and validation of tests
Creation and expansion of functional and technical documentation
Technologies: C++, PL/SQL, Java, MS Visual Studio, Jenkins, MKS, Oracle DB, MS Office, Confluence
Automotive Function Developer
Berner & Mattner Systemtechnik
Research Associate
Technische Universität Berlin
Working Student
Lufthansa Systems
Industries Experience
See where this freelancer has spent most of their professional time. Longer bars indicate deeper hands-on experience, while shorter ones reflect targeted or project-based work.
Experienced in Aerospace and Defense (11.5 years), Information Technology (7 years), Education (5 years), Automotive (4 years), and Professional Services (4 years).
Business Areas Experience
The graph below provides a cumulative view of the freelancer's experience across multiple business areas, calculated from completed and active engagements. It highlights the areas where the freelancer has most frequently contributed to planning, execution, and delivery of business outcomes.
Experienced in Information Technology (13.5 years), Quality Assurance (9 years), Product Development (8 years), Project Management (5 years), Research and Development (5 years), and Business Intelligence (4.5 years).
Summary
- Many years of practical experience in demanding digitization projects with a focus on data analytics (from descriptive to prescriptive) and artificial intelligence (NLP, generative AI) using leading cloud technologies (Azure and AWS) and Databricks
- Technical leadership of development teams, responsible for software architecture (layered architecture, client-server architecture), data modeling (dimensional, object-oriented and graph models), and building and orchestrating ETL pipelines
- Designing and optimizing statistical and operations research methods (regression and time series analysis, multivariate procedures, linear/nonlinear/dynamic optimization, simulation) for data-driven decision support
- Several years of software development experience (with Python and C++) in international, distributed and interdisciplinary teams
- Experience in key roles such as Product Owner, Project Manager, Data Engineer, Software Engineer and Business Analyst
Skills
- 16 Years Of Experience Developing Complex Software Solutions With Solid Methodological Expertise
- Several Years Of Experience In Software Architecture, Data Modeling And Building Etl Pipelines On Cloud Platforms (Azure, Aws) And Databricks
- Developing And Implementing Forecasting Models And Optimization Methods (Python, C++, Matlab) As Well As Intelligent Q&a Systems Using Nlp And Generative Ai
- Strong Knowledge Of Agile Approaches, Software Development Processes And Agile Project Management
- Programming: Python, Pyspark, C/c++, Sql, C#, C++/cli, Java, Pl/sql, Dax, Cypher
- Databases: Oracle, Microsoft Sql Server, Amazon Dynamodb, Amazon Neptune, Mongodb, Litedb
- Cloud / Data / Ai Platforms: Microsoft Azure (Delta Lake, Data Factory, Functionapp), Aws (S3, Glue, Lambda, Step Functions, Dynamodb, Neptune, Athena, Sagemaker, Opensearch Service, Ec2, Cli, Ecs, Api Gateway, Cloudformation, Sns), Databricks (Data Intelligence Platform, Uc, Acls, Lakeflow, Dlt, Sdp, Workflows, Jobs, Pipelines, Batch, Structured Streaming, Dab, Dataops, Ci/cd, Sdk, Cli)
- Tools / Frameworks: Apache Spark, Apache Kafka, Docker, Power Bi, .Net (Framework / Core / Standard), Git, Svn, Bitbucket, Teamcity, Jenkins, Cmake, Ms Visual Studio, Nuget, Rest Apis, Postman, Salesforce Sales & Service Cloud, Pentaho, Matlab, Ms Office, Jira, Confluence, Sharepoint, Mural, Doxygen
- Soft Skills: Analytical, Structured And Solution-oriented Work Style
- Soft Skills: Strong Ability To Abstract
- Soft Skills: Leadership, Strong Coordination And Team Orientation
Languages
Education
TU Berlin
PhD in Mathematics · Mathematics · Berlin, Germany
TU Berlin
Diploma in Mathematics · Mathematics · Berlin, Germany
Certifications & licenses
Databricks Certified Data Engineer Associate
Databricks Certified Data Engineer Professional
Professional Scrum Product Owner I
Profile
Frequently asked questions
Do you have questions? Here you can find further information.
Where is Vili based?
What languages does Vili speak?
How many years of experience does Vili have?
What roles would Vili be best suited for?
What is Vili's latest experience?
What companies has Vili worked for in recent years?
Which industries is Vili most experienced in?
Which business areas is Vili most experienced in?
Which industries has Vili worked in recently?
Which business areas has Vili worked in recently?
What is Vili's education?
Does Vili have any certificates?
What is the availability of Vili?
What is the rate of Vili?
How to hire Vili?
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
Similar Freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Technical Lead, Data Engineer
Nearby freelancers
Professionals working in or nearby Neuenhagen, Germany