Karl Estermann
incl. CI/CD, automation
Experience
incl. CI/CD, automation
AALS Software AG
- Designed and delivered a practical real-time course on Flink and Hadoop with MapReduce, HDFS, Spark, Flink, Hive, HBase, MongoDB, Cassandra, and Kafka
- Gained extensive DevOps and CI/CD experience
- Created ETL/ELT pipelines with Apache tools and Pentaho
- Led projects in municipal software, financial services, and big data with Kafka
- Developed AI/NLP models and chatbots with RASA, Chatter, and Dialogflow
- Built and managed a TypeDB knowledge database
- Worked with OpenStack, Kubernetes, and Podman
Hiring Requirement
AALS Software AG
- Introduced a data-driven hiring process for experienced engineers and talent
- Improved the company’s overall skill set and addressed skill gaps
- Continuously measured the "temperature" of the hiring pipeline
- Identified and eliminated bottlenecks in the hiring process to optimize workflows
- Experimented with different job descriptions across various channels
- Set maximum deadlines for candidates at each stage of the process
- Tracked hires per week to maintain a steady pace
- Implemented a career development system to objectively evaluate candidates
- Ensured a consistent number of hires per week
- Continuously improved the speed and efficiency of the pipeline
Hiring Requirement
AALS Software AG
- Defined needs for a founding engineer with Ethereum and smart contract knowledge
- Specified requirements in computer science fundamentals, Solidity, Golang, and other languages
- Introduced an AI-based semantic search platform to improve search accuracy
- Captured contextual meaning of job postings and resumes
- Generated embedding vectors with HuggingFace Transformers
- Matched job descriptions with resume database using multidimensional float vectors
Data IoT Engineer
AALS Software AG
- Analyzed and optimized data storage, processing, and streaming for IoT use cases (IQ control, service info, manufacturing data, axis monitoring)
- Evaluated OPC UA, Redis, and InfluxDB
- Advised on suitable databases for efficiency improvements
- Implemented Kafka IoT streaming
- Used Azure Data Factory for analytics
Data Engineer
AALS Software AG
- Conducted expectation analysis
- Analyzed and improved performance using statistical tests
- Created a target architecture for business intelligence
- Developed transparent processes for business units
- Categorized published texts and provided via chatbot
- Created dynamic profiles for inbound leads
- Built DWH, data lake, and data lakehouse with Pentaho
- Developed a chatbot for document and PDF summarization with Streamlit
- Integrated security and ethics into LLMs
- Used Kafka as a communication system in schools and communities
- Employed Spark, Databricks, web scraping, GCP, Accumulo, nGraph, and HuggingFace
Data Scientist
Winiker-Immobilien
- Evaluation and prediction of rental prospects using classic clustering
- Development of prediction models with Random Forest on tenant data
- Reporting with Power BI, visualization with Bokeh and Dash
- Building and leading BI solutions in Power BI and Tableau
- Migration of the application to the Google Cloud Platform and setup of a Delta Lakehouse
- Scaling and management of unstructured data with Kubernetes
Data Engineer
AALS Software AG
- Development of a custom ChatGPT chatbot using ChatGPT and LlamaIndex
- Extension of the LLM model to derive knowledge from internal document sources
- Deployment as a conversational bot for customer support and spam classification
- Creation of a document chatbot with GPT-3 and Langchain
- Use of GPT-3 for text completion, translation, and summarization
- Implementation of a Python-based web application KnowledgeGPT with Streamlit
- Enabling document uploads and answering user questions
Project Leader
AALS Software AG
- Development of a school administration software with Delphi and Microfocus COBOL, Hana (formerly SybaseDB ASE)
- Implementation of a billing and payroll system with T-SQL stored procedures
- Loading the entire database into memory for performance
- Oversight as Delphi developer, architect, and project leader
- Use of Linux, HANA, and Sybase ASE
Project Leader
AALS Software AG
- Development of a municipal administration software with Microfocus COBOL and SybaseDB ASE on SUSE Linux
- Gradual migration from Mainframe z/OS to Azure with interoperability between applications and databases
- Leading the migration project for public administration
- Using various integration solutions between Azure and mainframe
Summary
Committed and success-oriented leader with assertiveness and strong analytical skills.
Skills
Many Years Of Experience As A Data Engineer And Data Scientist
More Than 5 Years Of Experience With Spark And Databricks (Aws, Azure, Standalone)
Knowledge In Building Lake Warehouses, Cloud Data Management, Etc.
Many Years Of Experience Building Models, Ml Ops, Data Preparation (Python, Scala), S4/hana And Its Predecessor Asa.
Experience Using And Designing Databricks Templates (Focus On Python)
Hdfs
Etl
Devops
Cloud
Apache Hbase
Pentaho
Elt
Mongodb
Kubernetes
Kafka
Verbal Communication: I Have The Ability To Express Myself Clearly And Concisely In Spoken Language And Adapt Messages According To The Audience And Purpose. This Includes Active Listening, Guiding Conversations, Politeness, And Clarity.
Nonverbal Communication: I Can Convey Meaning And Emotions Beyond Words Through Facial Expressions, Body Language, Gestures, Eye Contact, Touch, And Spatial Awareness. I Can Build Interpersonal Relationships, Trust, And Understanding.
Emotional Intelligence: I Am Able To Understand And Manage My Own Emotions And Recognize And Respond Appropriately To The Emotions Of Others. Includes Self-awareness, Self-regulation, Motivation, Empathy, And Social Skills.
Problem-solving: I Can Identify Challenges, Find Solutions, Evaluate Alternatives, Take Action, And Reflect On The Outcomes. It Supports Collaboration, Negotiation, And Critical Thinking.
Large Companies, Public Administration, Insurance
Apache Fundamentals: Real-time Streaming For Big Data; Spark And Python For Big Data And Data Science With Pyspark
Big Data Technology - Spark And Scala, Including Spark 2.0 Dataframes
Hdfs (0.2 Years)
Etl (0.2 Years)
Devops (0.2 Years)
Cloud (0.2 Years)
Apache Hbase (0.2 Years)
Pentaho (0.2 Years)
Elt (0.2 Years)
Mongodb (0.2 Years)
Kubernetes (0.2 Years)
Kafka (2.0 Years)
Ci/cd (0.2 Years)
Mapreduce (0.2 Years)
Hadoop (0.2 Years)
Nlp (0.2 Years)
Apache Spark (1.2 Years)
Bigdata (0.2 Years)
Cassandra (0.2 Years)
Openstack (0.2 Years)
Bard (0.9 Years)
Kedro (0.9 Years)
Ngraph. Gcp Platform (0.9 Years)
Accumulo (0.9 Years)
Web-scraping (0.9 Years)
Huggingface (2.4 Years)
Databricks (0.9 Years)
Mistaral 7b (1.4 Years)
Falcon 7b (1.4 Years)
Typedb (1.4 Years)
Vectordb (1.4 Years)
Knowledgegpt (1.4 Years)
Chatbot Gpt-3x (1.4 Years)
Openai (1.4 Years)
Python (2.3 Years)
Rust (1.4 Years)
Streamlit (1.4 Years)
Databricks Data-stax (0.8 Years)
Openstack Basics (0.8 Years)
Opencv And Openai (0.8 Years)
Py- Torch (0.8 Years)
Tensorflow (0.8 Years)
Keras (0.8 Years)
Pandas (0.8 Years)
Numpy (0.8 Years)
Tableau (0.8 Years)
Microsoft Power Bi (0.8 Years)
Data Factory (0.8 Years)
Linux (6.0 Years)
Hana (6.0 Years)
Ase Sybase (6.0 Years)
Linux Os (6.0 Years)
Delphi And Microfocus -Cobol (21.8 Years)
Kafka Docker (0.1 Years)
Cassandra Data-stax (0.1 Years)
Python Sript (0.1 Years)
Graph And Spark (0.1 Years)
Ansible (0.1 Years)
Grafana (0.1 Years)
Prometheus (0.1 Years)
Azure Data Factory (0.1 Years)
Languages
Education
Schweizerisches Institut für Betriebsökonomie
Bachelor degree · Zürich, Switzerland
HKG Juventus
Bachelor degree · Business economist · Hong Kong
Certifications & licenses
Evening Technical College
Technical University, Switzerland
Similar Freelancers
Discover other experts with similar qualifications and experience