Data architect to design create, monitor pipelines for the marketing intelligence unit. AWS, Glue, Python, Spark, SAP Marketing, Rest API. Maintain legacy ETL and new data pipelines. AWS AppFlow, Step Functions, Athena, Snowflake. Deploy infrastructure as code with Terraform
Gathered the functional requirements from different business units, designed data flows and documents (Jira). Definition of data flows including methodologies, tools, techniques and deliverables.
Functional design with stakeholders, capturing business requirements and creating the necessary data deliverables. Logical and physical data models and other data governance. Ensured proper implementation of Data Excellence guidelines and monitoring metadata and KPI's.
Developed several indicators for Supply Chain management, including delivery on time/in-full and shipment monitoring.
Being part of the team providing insights in the supply chain, rebuilt the Python pipeline introducing CI/CD tools and mindset with focus on DataOps. Migrated the application database from on-premises Linux to Kubernetes on AWS, reducing load times by 50%, adding exception handling, monitoring and logging. Migrated all SQL and job scripts from Redshift to Snowflake, reducing database size, reducing backup times and overall network costs. Mentored colleagues on best practices in big data and infrastructure.
Leading a team of 8, audited, reviewed and documented their existing data infrastructure. Proposed and bootstrapped a plan to increase efficiency and reduce costs. Introduced a ticketing system for requests/issues accountability. Streamlined relationships with other departments in the company. Helped stakeholders in defining enterprise wide KPIs. Automated and debugged AWS Glue pipelines, reducing day to day operations, added monitoring and logging. Cleaned up redundant and obsolete pipelines.
Built new version of a legacy system used to store, retrieve, and update data about products, bills of materials, and services. Tuned database design and processes needed to move data from the legacy system to the Azure Cloud. Azure SQL change tracking, incremental load. Added DevOps and DataOps as the standard procedure for database deployment. Application performance optimization, rewriting SQL queries and proposing a plan to resolve endemic data problems and save cloud costs.
Wrote the SQL and JSON backend for CustomEyes Configurator, a sales automation tool that won an award in 2020. Using T-SQL stored procedures, and system versioned tables, the backend allowed disconnected and connected mode data sync. Azure SQL data model design, optimization and monitoring. Introduces DataOps procedures and standards.
Overhauled the dynamically generated database to improve speed and accessibility to both the ingestion system and content delivery platform. Streamlined solution to segregate capture data from static data. Optimized hardware, Op. Sys. and database layers to obtain sub-second response. SQL Server DBA tasks and queries optimization.
Migration of the accounting/financial reports from SAP BW to MicroStrategy: data modelling, semantic layer and document/dashboards creation. Accounts Payable, Accounts Receivable, Supply Chain advanced KPIs. Coordinating external database designers in different time zones. Translated stakeholder requirements into reliable and actionable insights.
Requirements gathering, analysis and development of several data analysis projects to support the management in Logistics, Production, Financials departments: data modelling, ETL, training. Maintenance of the existing BI stack on MS SQ Server. DBA tasks and optimization.
From concept to writing, proofreading, and releasing. Creation of additional material: videos, examples. Coordinating with PACKT editor team in Asia, managed to release the book ahead of schedule. Data warehouse, data modelling, SQL Server, advanced analytics in MicroStrategy.
Robot Automation, integration of multiple diagnostic appliances to Xiril Workstation (Thermoshaker, barcode scanner, …). Conceived and developed a database to provide a unified sample reporting, based on MS Access and XML/XSLT. Development of a new application to manage and service an array reader: motor driver in C++, integrations in C#.
Design and create an MVP for hospital data analysis application and infrastructure, based on MicroStrategy and SharePoint with SSO and Privacy laws compliance. Departmental pipelines integrations with the Hospital Information System, HL7. Micro services architecture. Oracle, PL/SQL, C#. Bitbucket source code repository.