Carlos G.
Data Engineer Sr Consultant
Experience
Aug 2023 - Present
2 years 5 monthsUnited States
Data Engineer Sr Consultant
EPAM Neoris
- Reduced manual execution time by 50% in 7 months by automating a crucial part of the process, resulting in significant efficiency gains.
- Developed APIs on the GCP platform to improve and automate processes, leading to faster and more reliable data exchange.
- Streamlined data processing using AWS Glue for data pipelines, improving data accuracy and reducing processing times.
- Leveraged an advanced toolset including Docker, BigQuery, Glue, and Athena to build scalable and robust data solutions.
- Used Agile methodologies with Jira to ensure efficient project management and timely delivery.
Sep 2022 - Aug 2023
1 yearData Engineer
Dichter & Neira
- Reduced budget spending by 50% by changing code and architecture on Azure, resulting in substantial savings.
- Created pipelines with Azure Data Factory to process data and upload files from file servers, SQL Server on-premises, and Azure Containers.
- Developed data processing on Databricks using Python and SQL, enhancing data security and processing speed.
- Coordinated developments with Scrum, ensuring efficient team collaboration and timely delivery of project milestones.
Oct 2021 - Sep 2022
1 yearData Engineer III
MO Technology
- Managed a cross-functional team that developed and deployed a real-time API to generate scores within 4 months.
- Created and optimized ETLs using PySpark and Python, resulting in a 30% increase in data processing efficiency.
- Developed infrastructure using Terraform to automate the creation of cloud functions, BigQuery tables, and data transfers.
- Enhanced data storage utilizing AWS S3 and implemented Lambda functions for seamless and timely updates.
- Leveraged Snowflake for advanced querying, leading to a 20% improvement in data retrieval times.
Jan 2021 - Oct 2021
10 monthsBogotá, Colombia
Data Engineer
Bluetab Solutions
- Created and maintained ELTs using Scala for repositories with HDFS (Hadoop) technology.
- Migrated legacy .NET developments to Python.
- Conducted testing using Jenkins and collaborated on Git repositories.
May 2018 - Dec 2020
2 years 8 monthsBogotá, Colombia
Senior Datamining Analyst
Banco Falabella
- Successfully managed internal projects aimed at improving existing processes and creating new ones, leading to enhanced efficiency and innovation within the organization.
- Designed and implemented complex procedures and architecture for data warehousing and data lake, providing a robust framework for scalable data storage and retrieval.
- Collaborated with cross-functional teams to create a comprehensive data lake incorporating multiple data sources, enhancing data integration and accessibility.
- Implemented a datamart for the HR department and performed data extractions from AWS, resulting in streamlined HR data management.
- Created queries on GCP and developed new virtual databases to meet evolving business requirements, ensuring efficient data management and analysis.
- Developed data models to integrate multiple data sources using SSIS and Pentaho, facilitating seamless data integration and analytics.
- Demonstrated proficiency in DAX for Power BI, enabling the creation of complex data models and insightful visualizations.
- Designed and created dashboards for various areas within the bank that tracked numerous KPIs using Tableau and Power BI, empowering stakeholders with real-time insights for better decision-making.
- Handled problem monitoring, prioritizing, and addressed issues based on urgency and impact.
- Utilized SQL, Python, and PySpark to consistently deliver high-quality code and solutions.
Jun 2017 - Apr 2018
11 monthsBogotá, Colombia
BI Analyst
Banco Falabella
- Developed data models to integrate multiple data sources using SSIS and Pentaho.
- Created complex stored procedures and SSIS ETL processes.
- Designed and maintained dashboards for various bank areas using Tableau and Power BI.
Jan 2015 - May 2017
2 years 5 monthsBogotá, Colombia
BI Analyst - Outsourcing for Banco Falabella
Periferia IT
- Developed and managed SSIS ETLs, ingesting large amounts of information from multiple financial and operational data sources.
- Created ETLs using SSIS and Pentaho and maintained .NET applications.
- Created basic stored procedures on SQL Server and Oracle.
Summary
Highly accomplished Systems Engineer and Senior Data Engineer Consultant with over 7 years of experience designing scalable data architectures, ETL/ELT pipelines, and BI solutions. Expertise in multi-cloud environments (AWS, GCP, Azure) and a proven record of achieving significant efficiency gains, including reducing manual execution time by 50% through automation. Proficient in Python, SQL, and PySpark, focused on cost optimization and delivering robust, high-quality data solutions
Languages
Spanish
NativeEnglish
AdvancedEducation
Oct 2020 - Jun 2021
IEBS School
Master in BI and Data Science · BI and Data Science
Oct 2016 - Jun 2019
Ean University
Systems Engineer · Systems Engineering · Colombia
Oct 2010 - Jun 2014
Uniminuto
Electronic Technician · Electronics · Colombia
Certifications & licenses
Databricks Associate, Data Engineering
Udemy
GCP Cloud Digital Leader Certification
GCP
Master Data Engineering Using GCP
Udemy
GCP Data Engineer
Udemy
Azure Data Fundamentals
Microsoft
Introduction to Python
Data Camp
PySpark
Udemy
Scala
Udemy
Deep Learning for Business
Coursera
Tableau
Modux
Statistics Course
Uniminuto University
Windows Server, Systems and Technology Course
Compuclub
Need a freelancer? Find your match in seconds.
Try FRATCH GPT More actions
Similar Freelancers
Discover other experts with similar qualifications and experience
- English
- Deutsch
2025 © FRATCH.IO GmbH. All rights reserved.