Amandeep S.

Data Engineer/Analyst

Chandigarh, India

Experience

May 2023 - Present
2 years 7 months

Data Engineer/Analyst

Advance Delivery Consulting

  • Phase 1 of the migration project involved archiving and purging data from HAMBS database (a SQL Server database) based on the Membership and Claims cut off data. This was required to comply with Australian GDPR principles.
  • Created archival and purge SQL scripts.
  • Phase 2 was the migration of data from HAMBS database to CIVICA database (both SQL Server databases).
  • Performed data analysis on the HAMBS SQL Server database tables for data discovery and to identify potential data quality issues prior to migration.
  • Determined the data lineage between CIVICA and HAMBS tables and worked with business analysts to create mapping sheets.
  • Created and executed SSIS ETL packages for migrating data from HAMBS to CIVICA tables.
  • Optimized performance of SQL queries.
  • Supported and fixed Jira tickets logged by business post data migration.
Jan 2022 - May 2023
1 year 5 months
United Kingdom

Onshore ETL developer

Infosys Technologies

  • Liaised with business analysts and designers to understand business requirements and build ETL data-driven pipelines in Azure Data Factory and Python.
  • Created mapping dataflows in ADF.
  • Created triggers to schedule the pipelines.
  • Integrated and transformed data from different sources and loaded it into Azure SQL database.
  • Optimized pipeline execution performance.
  • Created applications for code promotions to higher environments.
  • Supported and resolved production incidents and defects.
  • Propagated code to higher environments.
  • Conducted POC for migration of existing application to Azure Cloud by creating data pipelines using Azure Data Factory.
  • Created self-hosted integration runtime service to copy/move data between Azure cloud and on-premise databases.
  • Implemented CICD pipelines in Azure DevOps.
Apr 2020 - Dec 2021
1 year 9 months
Netherlands

Offshore – Informatica BDM lead developer

Infosys Technologies

  • Created data model in SAP PowerDesigner in accordance with business requirements.
  • Developed ETL mappings, workflows and application on Informatica BDM.
  • Deployed data model DDLs on Hive.
  • Created data audit framework scripts for deployment on higher environments and for creation of batch schedules.
  • Performed unit testing and prepared unit test documentation for ETLs; collaborated with testers on ELT FAT fixes.
  • Conducted POC to explore different table file formats and compression formats on Hive to optimize performance.
  • Converted older ETL mappings running on native Informatica engine to be compatible with Hadoop Spark engine for performance improvement.
  • Tuned performance and optimized ETL processes.
Feb 2019 - Mar 2020
1 year 2 months
Australia

Offshore – SQL and SSIS developer, Data Analyst

Infosys Technologies

  • Phase 1 of the migration project involved archiving and purging data from HAMBS database (a SQL Server database) based on the Membership and Claims cut off data. This was required to comply with Australian GDPR principles.
  • Created archival and purge SQL scripts.
  • Phase 2 was the migration of data from HAMBS database to CIVICA database (both SQL Server databases).
  • Performed data analysis on the HAMBS SQL Server database tables for data discovery and to identify potential data quality issues prior to migration.
  • Determined the data lineage between CIVICA and HAMBS tables and worked with business analysts to create mapping sheets.
  • Created and executed SSIS ETL packages for migrating data from HAMBS to CIVICA tables.
  • Optimized performance of SQL queries.
  • Supported and fixed issues logged by application users post migration.
Nov 2017 - Jan 2019
1 year 3 months
United Kingdom

Informatica offshore lead

Infosys Technologies

  • Developed ETL mappings, sessions and workflows in Informatica PowerCenter for CIDA data loads to populate the data warehouse implemented on Oracle database.
  • Collaborated with data architects on design aspects.
  • Tuned performance and optimized ETL processes.
  • Performed unit testing and prepared test cases and test data.
  • Incorporated new data sources and business logic into existing Informatica mappings.
  • Resolved defects raised in Quality Center.
  • Handled business queries and data analysis.
  • Led a team of five Informatica developers offshore.
  • Conducted POC on Informatica BDM as part of CBL’s strategy for migrating to Informatica 10.1/BDM.
Mar 2017 - Nov 2017
9 months
United States

Informatica and SAP HANA developer

Infosys Technologies

  • Worked on change requests related to Informatica ETL for populating sales, order and inventory reports.
  • Addressed business queries and incidents opened by end users.
  • Migrated existing reports from Informatica to SAP HANA by rewriting code and implementing existing logic in SAP HANA.
  • Created ETL mappings and workflows, and created equivalent information models in SAP HANA.
  • Scheduled Informatica jobs for batch loads.
  • Tuned performance and implemented code push down to source and target databases in Teradata.
  • Created and maintained aggregated tables in Teradata to support final reports.
Apr 2015 - Feb 2017
1 year 11 months
United Kingdom

SQL developer

Infosys Technologies

  • Managed production incidents and change requests related to Nationwide’s SQL Server-based CAW reporting platform.
  • Monitored and supported daily batch loads.
  • Analyzed data and responded to business queries.
  • Created SQL stored procedures to populate work and final tables.
  • Supported deployment activities.
  • Analyzed logged data defects in Quality Centre.
  • Scheduled daily batch loads.
  • Created DDL for tables in SQL Server.

Summary

Over 15 years of work experience in data engineering and ETL, with outstanding hands-on experience in Informatica BDM, Azure Data Factory and SSIS. Involved in various aspects of data warehousing and data lake development, including requirement gathering, designing, development, testing, deployments, maintenance etc. Sound knowledge and experience of complete life cycle of Data Warehousing and data lake projects. End to End data engineering and data architecture management. Building data-driven ETL pipelines and dataflows on Azure Cloud. Good understanding of Azure DevOps and CICD pipelines. Exposure of working in Agile projects and big data environment. Solid and extensive experience of working with SQL and writing SQL queries.

Languages

Punjabi
Native
English
Advanced
Hindi
Advanced

Education

Oct 2004 - Jun 2008

Panjab University

Bachelor of Engineering, Computer Science and Engineering · Computer Science and Engineering · Chandigarh, India

Certifications & licenses

Infosys Certified Agile developer

Infosys

Microsoft Certified: Azure Data Engineer Associate (DP-203)

Microsoft

Microsoft Certified: Power BI Data Analyst Associate (PL-300)

Microsoft

Need a freelancer? Find your match in seconds.
Try FRATCH GPT
More actions