Designed and monitored pipelines for the marketing intelligence unit using AWS Glue, Python, Spark, SAP Marketing, and REST API.
Maintained legacy ETL and created new data pipelines using AWS AppFlow, Step Functions, Athena, and Snowflake.
Deployed infrastructure as code with Terraform.
Monitored pipeline metrics and ensured functionality.
Utilized DevOps tools such as AWS CodeCommit.
Jun 2023 - Dec 2023
7 months
Data Flow Architect
Sanofi
Gathered functional requirements from different business units and designed data flows and documents using Jira.
Defined data flows with methodologies, tools, techniques, and deliverables.
Captured business requirements and created necessary data deliverables, including logical and physical data models.
Ensured implementation of Data Excellence guidelines and monitored metadata and KPIs.
Developed indicators for supply chain management, including delivery on time/in-full and shipment monitoring.
Applied tools like Redshift, Snowflake, PostgreSQL, Python, SQL debugging, performance improvement techniques, DevOps, GitLab, and GitHub.
Jan 2021 - Jun 2023
1 year 6 months
Senior Data Engineer
Pfizer - PGS Operations Insights
Provided insights into the supply chain by rebuilding Python pipelines and introducing CI/CD tools with a DataOps focus.
Migrated the application database from on-premises Linux to Kubernetes on AWS, reducing load times by 50% and adding exception handling, monitoring, and logging.
Migrated SQL and job scripts from Redshift to Snowflake, reducing database size, backup times, and network costs.
Mentored colleagues on best practices in big data and infrastructure development.
Utilized tools such as Redshift, Snowflake, PostgreSQL, Python, DevOps, Kubernetes, and GitHub for performance improvement and development.
Jan 2020 - Dec 2021
1 year
Data Lead and Architect
Yara International
Led a team of 8 to audit, document, and improve existing data infrastructure.
Proposed and implemented a plan to enhance efficiency and reduce costs.
Introduced a ticketing system for accountability in request/issue management.
Streamlined interdepartmental relationships and helped define enterprise-wide KPIs.
Automated and debugged AWS Glue pipelines, reducing day-to-day operations and adding monitoring and logging.
Cleaned up redundant and obsolete pipelines.
Worked with large database performance troubleshooting, Redshift, Aurora, Python, containers, and CI/CD DataOps.
Jan 2019 - Dec 2020
2 years
Azure Data Engineer
Caterpillar
Built a new version of a legacy system for storing, retrieving, and updating product data.
Tuned database design and processes for migrating data from a legacy system to the Azure Cloud.
Implemented Azure SQL change tracking and incremental load.
Established DevOps and DataOps as standard database deployment procedures.
Optimized application performance by rewriting SQL queries and resolving endemic data issues to save cloud costs.
Specialized in ETL, data pipelines, big data applications, SQL DBA tasks, and database modeling on Microsoft Azure SQL.
Jan 2016 - Dec 2020
3 years
DBA, Backend Developer
Merge (Beam Interactive)
Developed the SQL and JSON backend for CustomEyes Configurator, a sales automation tool that won an award in 2020.
Created a backend allowing both disconnected and connected mode data synchronization using T-SQL stored procedures and system-versioned tables.
Designed, optimized, and monitored Azure SQL data models.
Introduced DataOps procedures and standards.
Specialized in SQL query performance tuning, database analysis and modeling, JSON, and API integration.
Jan 2016 - Dec 2019
2 years
SQL Database Expert
Equature (DSS Corporation)
Overhauled a dynamically generated database to improve speed and accessibility for ingestion systems and content delivery platforms.
Streamlined solutions to segregate capture data from static data.
Optimized hardware, operating system, and database layers to achieve sub-second response times.
Conducted SQL Server DBA tasks and query optimization.
Utilized tools like Microsoft SQL Server, Windows Server, scripting, and C#.
Jan 2015 - Dec 2016
1 year
Data Engineer, Data Analyst
Coty
Migrated accounting and financial reports from SAP BW to MicroStrategy.
Conducted data modeling, semantic layer creation, and dashboard/document development.
Developed advanced KPIs for accounts payable, accounts receivable, and supply chain management.
Coordinated with external database designers across multiple time zones.
Communicated with stakeholders to translate requirements into actionable insights.
Jan 2014 - Dec 2015
2 years
Data Architect, Engineer, Analyst
AGQ Labs
Gathered requirements, analyzed, and developed data analysis projects for logistics, production, and financial departments.
Maintained the existing BI stack on MS SQL Server and conducted DBA tasks and optimization.