Eric N. - Data Engineer

Go to Website

Berlin, Germany

Experience

Jul 2018 - Present

7 years 2 months

Berlin, Germany

Data Engineer

Creditsafe Deutschland GmbH

Design, develop and maintain an enterprise-wide BI platform using Data Vault 2.0 techniques for data modeling.
Design and build a template-based data pipeline using Python and SQL, following the data architect's specifications.
Implement processes to import, match, reconcile, and consolidate supplier data.
Assist in designing, building, and rolling out data extraction models.
Actively contribute as part of an agile team to develop, test, and maintain high-quality systems that meet business needs.
Collaborate with stakeholders and translate their needs and expectations into action items and deliverables.
Use Python, SQL, or specialized big data frameworks.
Tools and Methods: Data Vault 2.0 Modeling, AWS S3, Redshift, Apache Airflow, Apache Hive, Pentaho Data Integration, DataGrip, PyCharm, DBT, SQL, Python.

Oct 2016 - Jun 2018

1 year 9 months

Berlin, Germany

Oracle Database Developer

Creditsafe Deutschland GmbH

Effective member of a multinational team spread across the globe.
Redesigned and implemented the process to match, reconcile, and consolidate unregistered companies.
Coordinated with the front-end development team to provide the required stored procedures and packages, as well as the needed data insights.
Created extracts.
Performed performance tests and rewrote production code/SQL statements and procedures that were poorly performing and identified by DBAs.
Analyzed and converted business requirements into technical requirements, followed by designing and implementing solutions.
Responsible for maintaining high-quality reference data in Oracle by performing operations such as cleaning, transforming, and ensuring integrity in a relational environment.
Tools and Methods: SQL, Oracle PL/SQL, DataGrip, SQL, Database Performance Analyzer, PyCharm.

Mar 2014 - Sep 2016

2 years 7 months

Berlin, Germany

Senior Database Administrator

Idealo Internet GmbH

Administered relational (MySQL, Postgres, Oracle) and NoSQL (MongoDB) databases up to 3 TB in size; evaluated and introduced new Postgres technologies; used tool-based database monitoring and performed health checks.
Continuously developed server operation concepts, tested backup/recovery strategies, performance tuning, high availability, and optimization in a high-complexity data environment, including database, instance, and OS tuning.
Upgraded all Postgres databases to the current version 9.4.
Migrated databases to new hardware and operating systems.
Prepared for migration of databases from Oracle to PostgreSQL.
Provided technical leadership and consulting to developer teams regarding relational databases.
Tools and Methods: Oracle EE, Oracle Cloud Control, RMAN, SQL, DataGuard, Puppet, Oracle LogMiner, Ora2pg, Repmgr, PgBouncer, PostgreSQL 9.4/9.5, Grafana, Pgpool-II, Percona Tools, Xtrabackup, MongoDB tools, PowerBuilder.

May 2010 - Feb 2014

3 years 10 months

Berlin, Germany

Senior Database Administrator

Affinitas GmbH

Administered databases up to 250 GB; evaluated and introduced new Postgres technologies; used tool-based database monitoring and performed database health checks.
Continuously developed server operation concepts, tested backup/recovery strategies, performance tuning, high availability, and optimization in a complex data environment, including database, instance, and OS tuning.
Implemented multiple test systems and gradually upgraded all databases to the current version 9.2.
Migrated databases to new hardware and operating systems.
Migrated databases from MySQL to PostgreSQL.
Designed and developed an automated deployment process.
Developed and maintained the mail system; onboarded and trained new team members.
Held technical responsibility in the DBA domain.
Tools and Methods: Barman, mysql2pgsql, PostgreSQL 8.4-9.2, mysqldump, Pgpool II, pg_basebackup, pg_statsinfo, Londiste, Slony I, Shell, PL/pgSQL.

Aug 2008 - Aug 2009

1 year 1 month

Ettlingen, Germany

Oracle Technical Consultant

Promatis Software GmbH

Designed and implemented Oracle-based applications with focus on delivering call center services (inbound and outbound).
Tasks included ongoing maintenance and enhancement of the Oracle-based call center application.
Main focus was analyzing and implementing campaign-specific system customizations.
Typical requirements include: gathering, recording, and reporting specific information needs; recording calls as voice files.
Installed, configured, and administered test environments including the full infrastructure.
Specifically: installed, configured, and administered Oracle Universal Content Management systems (Content Server, UCM BPEL integration, patches, etc.).
Installed and configured Oracle Enterprise Linux 5 Update 1 and Oracle Application Server 10.1.2.
Installed Oracle SOA Suite 10.1.3 with components ADF, ESB, Business Rules, and Web Services Manager, and configured for HTTPS.
Tuned OC4J parameters.
Applied various patch sets.
Created maintenance scripts.
Authenticated SOA Suite admin accounts against Oracle Internet Directory (OID).
Deployed custom applications.
Provided in-house databases as development infrastructure for multiple products, test, and pre-production environments.
Installed, configured, and integrated databases.
Implemented multiple test systems and gradually migrated all databases from Oracle 9i to Oracle 10g.
Migrated databases to new hardware and operating systems.
Performed performance tuning and troubleshooting.
Tools and Methods: Oracle Database 10g, Toad, SQL, PL/SQL, shell scripts, Python on Linux and Unix, VMware Workstation, Oracle Workflows, Oracle Content Server, Oracle SOA Suite, Veritas Backup Exec / Oracle Agent for Veritas Backup, ArcServe Backup / Oracle Agent for ArcServe Backup, Retrospect Backup, RMAN, SQL*Plus, PL/SQL Developer, Oracle Enterprise Manager & Agents, Oracle DBA Studio.