Services Solution Architect

• Analyzed Eloqua's default retention policy and identified risk of data loss for records older than two years.
• Designed and implemented historical data preservation strategy by creating transformed tables in the data warehouse to archive older data while ensuring data quality.
• Collaborated with the Power BI team to re-point dashboards from raw Eloqua imports to the newly created data tables.
• Leveraged Jira to track and manage data engineering tasks, bugs, and feature requests across Agile sprints.
• Coordinated backlog prioritization and task assignment in Jira to align data pipeline development with business needs.
• Worked closely with business stakeholders to assess and understand reporting needs for the Reverse Data Warehouse.
• Designed and implemented Incremental Refresh in Power BI to ensure the dashboard updates daily without full data reloads.
• Collaborated with the Group Data Office and Technology Office to align data modelling and engineering standards.
• Facilitated stakeholder communication and presented status updates across Germany, Poland, and India in weekly meetings.
• Prepared end-to-end documentation covering technical design, data flow diagrams, and Power BI audit for future reference.
• Participated in UAT sessions with business users to validate data and reports.

Project #1: AWS Athena replaces PostgreSQL

• Led the development team in designing AWS cloud-based solutions.
• Developed solutions aligned with AWS Competencies and managed cloud services.
• Implemented a Customer Data Platform supporting complex data ingestion, processing, and analytics at scale.
• Applied Agile methodology to oversee technical operations.
• Created data analysis web pages with comprehensive technical information.
• Generated user stories and conducted requirements analysis.
• Evaluated internal systems and formulated training initiatives to address ongoing issues.

Project #2: Automated Policy Renew

• Created and maintained fully automated CI/CD pipelines for code deployment using Octopus Deploy and PowerShell.
• Managed and monitored AWS infrastructure (EC2, S3, RDS), including backups, patches, and scaling.
• Achieved a $3,000 monthly cost reduction by eliminating unnecessary servers and consolidating databases.
• Built Kubernetes clusters and deployed Docker containers to break up monolithic apps into microservices.
• Reduced deployment time for critical infrastructure from one month to a few days.
• Managed GitHub repositories, branching, and tagging.

• Worked with two datasets employing HiveQL and Pig Latin.
• Utilized Apache NiFi to move and automate data flows in real time.
• Wrote Python MapReduce code to address security issues.
• Synchronized unstructured and structured data using Pig and Hive.
• Imported data from RDBMS to HDFS using Sqoop, created external tables, and performed subqueries.
• Implemented dynamic partitioning and bucketing in HiveQL.
• Scheduled workflows using Oozie, managed job rescheduling and error handling.
• Managed data using Hive Web Interface via Cloudera Hadoop distribution UI.
• Deployed Big Data Hadoop application on Talend Cloud AWS and Microsoft Azure.
• Contributed to designing and developing enhancement features.

• Collaborated with internal and external clients to capture user requirements.
• Analyzed project requirements and consistently implemented code.
• Implemented changes in database tables at procedural, modular, and database levels.