Ben (R.) Spouse
Data Engineer
Erfahrungen
Sept. 2023 - Bis heute
1 Jahr 10 Monaten Bremerhaven, Deutschland
Data Engineer
Deutsche See
- In my role, I was responsible for the EDI import and mapping of the data from the Order data system which involved importing flat ascii files into Oracle 12c using ODI.
- A small number of Linux scripts were used to manipulate, the files and prepare them for import as well as retrieve from an sftp server.
- I then developed the mappings in the Data integrator to split the and process the flows for the different interfaces. This also involved complex logic to normalize the data into the tables in the staging layer.
- Developed data extraction from Flat Ascii files into Raw Data tables in the DB.
- Developed Splitting and mapping of data in ODI ETL tool for Staging layer in DWH.
- Developed complex DWH mappings for Order data processing.
- DWH development in Oracle with Orace Data Integration ETL tool.
- Migration from Linux based Data integration to Fully Autonomous Oracle DB.
- Extraction of data from Ascii fixed delimited files into Raw Data.
- Development of flows and mapping of data into Staging environment.
Apr. 2023 - Juli 2023
4 Monaten Frankfurt, Deutschland
Data Engineer
Deutsche Bahn
- In my role, I was responsible for the development of a new Smart HR solution. This involved extracting data in blob form from an Azure Container using Python and transforming it into data frames. Subsequently, the data was imported into the Oracle Staging layer for further processing.
- I then developed the data further through the DWH utilizing the existing SAP BODS ETL tool and completed the migration of the process for the valid employee data.
- Developed a new Smart HR solution by extracting data in blob form from Azure Container using Python.
- Transformed the extracted data into data frames for further processing.
- Imported the transformed data into the Oracle Staging layer.
- Utilized the SAP BODS ETL tool for additional data transformation and integration.
- DWH development in Oracle with Python and SAP BODS ETL tool.
- Data extraction from Azure Container with Python into Data frames for Staging.
- SAP BODS ETL tool development of data from Staging into Core and Mart.
März 2023 - Bis heute
2 Jahren 4 Monaten Leipzig, Deutschland
Data Engineer/ ETL Developer
Deutsche Bahn
- As a member of the VDM ETL team I was working on Deutsche Bahn’s 3DV Project which involved creating and updating multiple complex ETL jobs for mapping the Tarif data into SQLite files for the Input Pool.
- The source data on PostgreSQL DB was extracted and transformed through a H2 DB and using Talend ETL tool mapped into SQLite DB for DB’s MT and Ticket machines.
- I was working closely with the requirements Engineers and Data Managers to perform successful development of the tickets in an Agile working environment.
- Developed data extraction from PostgreSQL with Talend ETL tool.
- Developed SQL/PL SQL scripts and Views as required for ETL process.
- Used the GIT repository together with the existing CI/CD process in connection with testing and production deployment.
- Development of DB Tarif Data with Talend ETL tool.
- SQL Development in PostgreSQL DB in connection with DB’S IPP DWH.
- Extraction /Transformation and loading of data with complex ETL jobs.
- Migration from Talend 7.3 to Talend Enterprise Cloud edition 8.
Aug. 2021 - März 2023
1 Jahr 8 Monaten Hagen, Deutschland
Talend Snowflake Developer
Douglas GmbH
- As a member of the Data Analytics team at Douglas. My main role was the development and implementation of Talend jobs using cutting-edge Snowflake components for ELT. My primary responsibility revolved around efficiently transferring large volumes of data from the Staging area to both the Data Lake and Core DWH layers of the Snowflake Data Warehouse.
- During my tenure, I actively engaged in various Data Engineering tasks, including deduplication and historization, to ensure the integrity and reliability of data. I was involved in configuring the Azure Data Factory to prepare the data for Snowflake integration. Additionally, I leveraged my expertise in Talend SAP BAPI connectors to an SAP HANA interface. I applied intricate business logic to extract data from RFCs, ensuring successful mapping into Snowflake.
- Developed and implemented Talend jobs using Snowflake components for efficient ELT data processing.
- Transferred large volumes of data from the Staging area to the Data Lake and Core layers of Snowflake Data Warehouse.
- Performed Data Engineering tasks, including deduplication and historization, to ensure data integrity and reliability using Data vault 2.0.
- Leveraged Talend connectors and applied complex business logic to extract data from upstream interfaces.
- DWH development in Snowflake using Talend ELT with Data vault 2.0.
- Performed Data Engineering tasks including complex views for Data Mart.
- Deduplication and historization, to ensure data integrity for master data.
- SAP RFC Interface with Talend BAPI Connector and Data extraction/Mapping.
Nov. 2020 - Juli 2021
9 Monaten Stuttgart, Deutschland
Talend ETL/Tableau Reporting Developer
Daimler TSS
- Development of ETL jobs for DWH with Talend ESB for Migration from HP ALM to STARC. Also created ETL tables in preparation for development of data for data engineering from STARC using Rest API components in Talend to extract the JSON data. Development of Jobs for transforming and parsing the data into PostgreSQL DB. Responsible for weekly changes meeting with Business and Jira board. Development of Talend Jobs and Data Engineering. Tableau report and data visualization on the data in PostgreSQL DB and other Daimler Data sources. Collaborated with the team responsible for testing the Prototypes for Daimler’s automobile branch.
- DWH development of data tables for migration.
- Talend ETL job development for Data Engineering.
- Rest API with Talend ESB for extraction of data from STARC.
- Tableau development for data visualization and reporting.
- Operation Azure Cloud Repository for Talend Project.
Juni 2020 - Sept. 2020
4 Monaten Vereinigte Staaten
QA/ Data Modeling Consultant
Prospect 33
- Responsible for QA of application and Operations after Go-Live. Ben provided test design and test cases to cover all the scenarios to ensure the website stability. In addition, Ben was involved with the Data modeling team using the Ridge Regression libraries from Python SKLearn for a COVID-19 predictive modeling tool, which predicts the Covid infected cases, and RT values for specific counties in the USA working with the day-to-day improvements of the model and when incidents arose from the website updates that affected the model.
- Ben joined the team to support the QA and final development of the model for the Python website using the dash libraries for the frontend. Ben was also responsible for the day-to-day issue logging and management using GitLab. Daily dev team meetings with Zoom and communication using Slack with New York based US firm.
- Ben also was responsible for the issue tracking with Gitlab and managing the QA side of the weekly releases and provided consultancy and support with the dev team. For example, reviewing the automation options with AWS Lambda and Katalan studio as well as creating pytest python unit test tools.
- Testing/Development Data Model with Python SKLearn libraries.
- Consultation and troubleshooting of day-to-day issues.
- Responsible for QA and testing of Frontend.
März 2020 - Mai 2020
3 Monaten Frankfurt, Deutschland
DevOps Talend ETL Developer
Helaba Invest
- Development of ETL Jobs with Asset management Data Engineering. 7-week Proof of Concept for migration of complex ETL system to Talend. Presentation of Talend ETL tool to Helaba development teams.
- Java scripting was needed together with a large range of Talend components, including ESB with a JMS queue and performance optimization.
- Circa 10% of DMS DWH, system was developed in Talend to demonstrate the flexibility and scope as an ETL tool. The Project was under high time pressure with two other tools also being presented in parallel as competition.
- Development of SQL for complex lookups needed for Oracle DWH.
- Talend ESB (JMS based architecture) for data mapping.
Mai 2018 - Jan. 2020
1 Jahr 9 Monaten Köln, Deutschland
DevOps Consultant/Talend ETL Developer
Unitymedia
- DevOps ETL Development with Talend/PostgreSQL and File transfers of the Boundary systems of Unity media using Java based ETL Tools. Interfaces included Oracle, PostgreSQL, and DB2 Databases. Development on OSS/BSS System and analysis of existing interfaces and making improvements to the existing jobs and optimizing the framework. Development of Talend with Rest services and SOAP calls and ETL jobs for Vodafone’s Data Lake interface. The processes were automated with Airflow. There was also bug fixing and troubleshooting on the live environment. The Jobs were also including file transfer FTP components from both Linux and windows shares. Also, with File to DB transfers and vice versa.
- File transfer job development for ETL Big Data tool Talend.
- Development of Talend Jobs for Data Engineering.
- Troubleshooting and bug fixing of Production Data transfer jobs.
- Automation of ETL processing with Airflow.
- Application management and optimization of existing application.
- DWH Job creation and Maintenance Talend, Oracle/DB2/PostgreSQL.
Okt. 2016 - Apr. 2018
1 Jahr 7 Monaten München, Deutschland
ETL BI Operations DWH Consultant
Consors Finanz
- Ben worked with the Project team with documentation tasks for the Big Data loads into the DWH system for the entire CFG.
- Ben also worked in the Operations team, working in an agile process environment. Doing bug fixes on Production Incidents and Monitoring engines and covering issues within the project. This included writing workarounds for the incidents on the production DB and doing some 3rd level support using Talend ETL tool, which included supporting all the interfaces for the migration from a legacy system to SAP ECC system.
- The migration support was between 10.2017 – 04.2018.
- After Commerz Finanz split with Commerz Bank and moved to BNP Paribas, the rebranding project Gemini was completed, and the name was changed to Consors Finanz. Ben split his responsibilities between supporting the file transfer operations and the development of new changes on the job scheduler SOS tool with Java based parameter configuration. His tasks also included the monthly compliance deliveries of data and problem management.
- BI Operations for Consors Finanz Talend ETL system.
- Responsible for fixing production incidents and support issues daily.
- Used Oracle 11g, SQL, Citrix, UNIX scripts, Talend, Job scheduler.
- Migration from legacy system to SAP ECC with Talend.
- Development and configuration file transfer tool SOS Job scheduler.
- Project work in Agile environment, Problem/incident management.
Okt. 2012 - Sept. 2016
4 Jahren München, Deutschland
Billing application Operations DevOps
Telefonica o2
- Ben joined BASFs Operations group in a remarkably busy time for Telefonica o2s Partner billing team before Christmas with a large OCS migration for Fonic, Lidl and all the Multibrands on the OSS/BSS system. As a result of his previous Billing experience with o2, he was able to start fixing incidents and installing workarounds and changes very quickly.
- Working on the terminal and batch servers Ben has been doing SQL and scripting to fix every day issues on the system as well as raising tickets Remedy for the system and analyzing problems and providing Operations support for all the partner brands of o2.
- Ben worked with the Project team for the Fonic Secure 8 release, doing deployments for Fonics Selfcare WEB system using Jenkins tool. Moreover, installing Hotfixes and releases on the Database.
- Ben also worked in the Operations team, working in a DevOps process environment. Doing bug fixes on Production Incidents and Monitoring engines and covering issues within the project. This included writing workarounds for the incidents on the production DB and doing some 3rd level support using PL/SQL and writing scripts.
- Since middle 2015, Ben has been doing team lead and mentoring tasks. He is responsible for the Kanban meetings, for organizing problem tickets, and as a point of contact to the interfaces and other teams. Together with handling the more complex issues with the system as before on the technical side.
- Billing Operations for o2s entire partner brands system.
- Responsible for fixing production incidents and support issues daily.
- Used Oracle 11g, PL-SQL (scripting), SQL, Citrix, UNIX scripts.
- Responsible for monitoring engines, fixing bugs, writing scripts.
- Project work in Agile environment, organized reports for Stabi meetings.
- Carried out web and content deployments using Jenkins on environments.
Feb. 2012 - Okt. 2012
9 Monaten Düsseldorf, Deutschland
Test Automation Agile
Vodafone
- Ben started with very short notice on a fast-moving project with Vodafone’s Egarage web system, working with Infosys’s top consultants, he was required to learn the projects core stack very quickly and start executing the automation suites in FitNesse using Java Eclipse almost immediately as the project was under a lot of pressure at the time. Bens Unix and SQL Database skills were put into good use, as he was able to take over the test cases that integrated with the servers and the Database very quickly and show results from the beginning. Ben was also involved in testing the Apache servers and the shop servers analyzing the logs and raising defects in HP Quality center, updating the tests in FitNesse so that the automation runs could be improved. Once the initial phase was through and the automation tests were stable, the offshore team was able to take over with the test execution.
- Carried out Non-Functional tests on Vodafone’s Egarage project.
- Java/Eclipse FitNesse automation suite test execution.
- Carried out test analysis/updates on FitNesse automation tests.
- Tested using Oracle tools, SQL Developer, SQL, UNIX scripts.
- Updated and executed Batch shell scripts on Linux backend servers.
- Ran system and integration tests with Vodafone shop web systems.
Jan. 2008 - Dez. 2011
4 Jahren Bern, Schweiz
Senior Test Analyst /Test Manager
Swisscom
- Ben worked with the Billing team on the Oracle 11g/Linux/Java system that handled the Invoice and CDR traffic in xml format, mapping into the Database, and then processed through to the layout engine, and then to pdfs and prinstreet output.
- Analysis of Change requests and new work packages for the Project.
- Creation of Use cases and test cases into HP Quality center.
- Creation of Test plan document and mentoring of more junior team members.
- Retrieval/Creation of test data to cover test scenarios.
- Execution of test cases and running the data through the system.
- Verification of DB mapping and outputs for the different handlers.
- Reporting, retesting and processing defects in HP Quality center.
- Installations and management of Java Linux and Oracle DB environments.
- He was also responsible for running the regression automation pearl scripts together with liaising with management to give them quick updates on how the system was after the changes. His work with the automation scripts included having to make bug fixes and updates to the code but not creation of new scripts. On the database, Ben used Toad to work with the data and created his own SQL and PL/SQL scripts.
- The Project was using a 2-week release period with the developers and testers working very closely. This being very close to the Agile method used by many projects today. Ben had a good working relationship with some of the business members and was able to help with clarification of business wishes when defects and changes were needed. The team was working very well together, rapidly installing new changes and testing new releases when they happened. This required particularly good communication and flexibility with the tests and test scripts.
- Component test analyst for Swisscom Docforms bill layout system.
- Responsible for full test lifecycle (until E2E) using HP Quality Center.
- Consulted in an Agile environment working closely with Developers.
- Tested using Oracle tools, Toad, PL-SQL, UNIX scripts and Pearl.
- Created and executed detailed Functional tests within system.
- Ran system and integration tests with upstream and downstream systems.
Mai 2006 - Okt. 2007
1 Jahr 6 Monaten München, Deutschland
Senior Test /DWH Consultant
o2 Germany
- Joining CT test team 2 weeks before release 16 testing start, Ben had an intensive knowledge transfer onto the GDF (General Data Facility) DWH application to control the data in o2’s system stack.
- Creating test plan documentation based on requirements and change requests.
- Creating component test cases based on the use cases in Rational Requisite Pro.
- Creating component test environment and test scripts required for simulating production conditions.
- Creating test data, including input files for all data feeds to GDF.
- Executing test cases, reporting defects, and liaising with development on issues/discrepancies to documentation.
- Regression testing defects and documenting test results.
- Training and mentoring other team members.
- The testing and test preparation involved heavy use of Oracle using TOAD and SQL Plus to execute PL-SQL scripts and analyze data. Ben also had to update Perl scripts and PL-SQL scripts to upgrade existing test tools and create new.
- Ben also had data feed simulations for binary file transfer using FTP and multiple UNIX environments.
- In the test environment, several schemas were created to link to the component test Schema using DB links which Ben had to set up to simulate separate applications within o2’s stack connecting to GDF.Over a period of 6 months GDF improved in quality from 30/70% ratio of defects found after CT phase in release 15 to an impressive 95/5% ratio in release 18.
- Datawarehouse Test for o2’s middleware Oracle database.
- Consulted with development for enhancements and design of application.
- Responsible for full test lifecycle (until E2E) using o2’s Rational test tools.
- Component tested using Oracle tools, PL-SQL and UNIX.
- Created test schemas and scripts for simulating a live environment.
- Completed integrated tests with connecting o2 middleware applications.
März 2003 - Mai 2006
3 Jahren 3 Monaten Salzburg, Österreich
Senior Tester/Test Team Lead
Sony NetServices
- Ben worked in the QA team-testing applications on mobile phone devices and on front-end web pages, which was an online music streaming service for Vodafone.
- Ben was involved in the complete testing phase, from planning, test case creation from Use cases in the requirements documentation, through to the final release to the customer. Ben was responsible for creating test steps and automated them using Mercury Quick TestPro (VB script). During execution phase, he also analyzed defects and produced reports for QA.
- The testing required extensive use of GPRS and Bluetooth connectivity on the phones as well as gaining a deep understanding of setting up GPRS access points to connect to WAP sites and Internet applications. Testing the devices in the field with the SIM cards and checking the backend systems for correct reading off the mobile cells.
- Ben’s billing and test experience singled him out as a valuable and communicative team member. He was the only team member out of 4 to be extended a further 4 weeks to complete the report testing for Sony’s billing system. He was then extended 3 more times (Each time 3 months) to work on Release 1.2 and now the Pamina release, which he worked on until end of (April 2005).
- Since May 2005, Ben has been involved as a senior test analyst in the test preparation and test execution of the new product for Vodafone called Radio DJ: A more advanced version of Sony’s Streaman using 3G. This is being launched on the latest UMTS smart phones. The 4 Symbian phones being: the Nokia 6630, 6680, N70 and N91. It is important to note that as a Senior tester, Ben was responsible for creating all the test cases for the Front-end Mobile application in Mercury Test director, analyzing the specification documentation and CR’s and taking the test planning right through to the test lab in the test tool.
- System Test specialist for Vodafone radio DJ project.
- Component tested multiple mobile devices and backend systems.
- Completed field tests and tested backend database system Linux/Oracle.
- Provided test data through Oracle database using Toad.
- Planned, wrote, and executed all tests using HP Quality Center.
- Senior tester for Sony’s major release of Radio DJ for Vodafone.
März 1998 - Jan. 2002
3 Jahren 11 Monaten München, Deutschland
Kenan Billing Business Analyst
o2 Germany
- Ben worked in the OSS/BSS team doing Business Analysis as well as Data build support with the Kenan Arbor Data model. He worked with a team meeting frequent releases and tight time schedules. He carried out extensive tests on the new Arbor OM interface creating test accounts, which were replicated onto the BP database. He also helped the members of other test teams with Call Data Records and Arbor Process Control. As well as performing valuable training of new members to the team. His areas of testing mainly concentrated on the Bill runs for Residential and Business voice including fixed to mobile as well as setting up and testing the various contract discounts.
- He is familiar with the Rating model and his work includes doing his own data builds on the test environment to establish with the customer ahead of time what was and was not feasible options. His SQL skills from his background as a developer where used frequently and he has a good understanding of the LDS between the tables of the areas that he worked with.
- Ben then took a permanent contract after one year with VIAG Interkom to develop his career and build his experience within a fast-growing telco environment. He did this to secure a valuable position and receive invaluable training on the Mobile transferred account procedure (TAP). Representing VIAG in several international conferences with the GSM association in Vienna, Athens and London. He also met with Kenan on many occasions whilst on the TAP 3 project in which 60% of his workload was testing.
- Analyzed existing billing system in respect to new product launches.
- Liaised with internal departments on product design.
- Represented VIAG Europe-wide in the “GSM roaming TAP3” project.
- Provided technical support for the system databuild team.
- Completed Component and System testing phases through to UI level.
Dez. 1997 - März 1998
4 Monaten Barcelona, Spanien
Test Consultant
Pricewaterhouse & Coopers
- Working on the Retevision Telco startup Project. Phase 1.0 successful delivery, on schedule, of Indirect Access subscriber service in only 2 months. Because of the short development and testing time available, the project required Ben to work long hours with high levels of commitment.
- Bens Telfort experience with the BMP was used when he was asked to help with the Unit testing of the EHPT BMP 3.0, for account mediation and processing of call data from the Lucent switches.
- He was required to write the Test cases for the bill runs on the system test environment and was also responsible for making sure the test environment was set up correctly and delivered on time. This required working over a lot of the Christmas period. Ben then carried out the test runs of the site specific Vantive to BP link, which consisted of two scripts which, transferred the account data across. He was then solely responsible for creating and documenting the CDR’s using Access and Excel. After Phase 1.0 he worked with the Integration test team on the End to End testing.
- System test specialist for the billing system’s redesign for service launch.
- Provided consultancy for the EHPT and BMP network systems.
- Provided system test documentation and quality control.
Sprachen
Englisch
Muttersprache
Deutsch
Verhandlungssicher
Ausbildung
Sept. 1985 - Juni 1990
Ardingly College
Vereinigtes Königreich
Ähnliche Freelancer
Entdecken Sie andere Experten mit ähnlichen Qualifikationen und Erfahrungen.