Services Solution Architect

Global marketing analytics for Hitachi Energy as part of a global data modernization initiative aiming to enhance data retention, historical data availability and provide Eloqua's 2-year retention for remote interaction reporting and analytics.

Analyzed Eloqua's default retention policy and identified risk of data loss for records older than two years.

Designed and implemented historical data preservation strategy by creating transformed tables in the target data platform to archive older data while ensuring data quality dashboards.

Collaborated with the Power BI team to re-point dashboards from raw Eloqua imports to the newly created archival layer.

Leveraged Jira to track and manage data engineering tasks, bugs, and feature requests across Agile sprints; coordinated backlog prioritization and task assignment to align data pipeline development with business needs.

Power BI dashboard optimization:

Worked closely with business stakeholders to assess and understand reporting needs for reverse customer data.

Designed and implemented incremental refresh in Power BI to ensure daily updates without full data reloads.

Collaborated with Azure data engineers to optimize data processing and publication pipelines.

Stakeholder communication & data modeling:

Acted as liaison between Group Data Office and Technology Office to align data modelling standards.

Gathered requirements from data engineering team and participated in weekly status meetings to provide implementation updates and resolve blockers across teams in Germany, Poland, and India.

Documentation & quality assurance:

Prepared end-to-end technical design documentation, data flow diagrams, and Power BI audit guides for future reference.

Participated in UAT sessions with business users to validate data outputs and report accuracy.

Project 1: AWS Athena replaces PostgreSQL for Autodesk to support complex data ingestion, processing, and analytics at scale.

Led the development team in designing AWS cloud-based solutions aligned with AWS Competencies and general cloud-managed services.

Implemented Agile methodology for efficient technical operations oversight.

Developed Customer Data Platform (CDP) capable of complex data ingestion and analytics.

Created data analysis web pages on a portal with comprehensive technical information.

Generated user stories and conducted requirements analysis; evaluated internal systems and formulated training initiatives.

Project 2: Automated policy renewal using AWS services (EC2, S3, RDS), CI/CD pipelines, Kubernetes, Docker.

Created and maintained fully automated CI/CD pipelines for code deployment using Octopus Deploy and PowerShell.

Managed and monitored AWS infrastructure including backups, patches, and scaling; achieved $3,000 monthly cost reduction by eliminating unnecessary servers and consolidating databases.

Built Kubernetes clusters and deployed Docker containers to transform monolithic apps into microservices, enhancing developer workflow and scalability.

Reduced deployment time for critical agile project infrastructure from one month to a few days.

Managed GitHub repositories and permissions including branching and tagging.

Predictive Model CSAA for AAA with Hadoop, Scala, HDFS, MapReduce, Hive, Sqoop, Oozie.

Developed claim fraud and subrogation predictive models using machine learning algorithms.

Employed Oozie to orchestrate workflows involving REST API calls and R layer communication.

Worked with two datasets using HiveQL and Pig Latin; utilized Apache NiFi to automate and track data flow.

Wrote Python MapReduce code for security processes; synchronized structured and unstructured data with Pig and Hive.

Imported data from RDBMS to HDFS using Sqoop; created external tables and performed Hive subqueries; implemented dynamic partitioning and bucketing.

Scheduled and managed Oozie jobs, identified errors, and handled rescheduling.

Managed data via Hive Web Interface on Cloudera Hadoop; deployed applications on Talend Cloud AWS and Azure.

Intellect Payment Service Hub (PSH) with Core Java, JSP, Servlet, JavaScript, WebSphere.

Centralized payment flow processing for customers, implementing automated controls adhering to payment policies.

Collaborated with internal and external clients to capture user requirements; analyzed and implemented code across development.

Modified database tables at procedural, modular, and database levels.