Ziyang F.

Software Engineer · DataWorks

Avatar placeholder
Hangzhou, China

Experience

Sep 2022 - Present
3 years 4 months
Hangzhou, China

Software Engineer · DataWorks

Alibaba Cloud

  • Developed over 20 inspectors (e.g., high-cost SQL, table and field existence, prohibition of simple processing) for pre-event phase, intercepting user operations, submissions, and releases, with daily check-tasks reaching tens of thousands.
  • Built a highly available failover mechanism, enabling regular heartbeat reporting, master election upon disconnection, and secondary distribution of failed tasks.
  • Designed five domains (R&D, storage, computing, quality, security) for governance items, developed over 60 governance items (e.g., missing upstream dependencies, data skew, consistent continuous import), and performed T+1 day lineage tracking, data processing, benefit calculation, health scoring, and report backflow, generating millions of governance items daily.
  • Developed automated tools for governance items, such as one-click upstream dependency completion and data skew optimization (MapJoin, SkewJoin).
  • Designed and developed a short URL generator, using auto-increment unique ID, base-62 conversion, storage mapping, and LRU algorithm for cache updates.
  • Deeply optimized governance report query scenarios, implemented a multi-data source access mechanism combining OLAP (MySQL index optimization) and OLTP (Hologres column family optimization), ensured data consistency through Flink CDC link synchronization, and deployed monitoring and downgrade strategies.
Dec 2020 - Apr 2021
5 months
Shenzhen, China

Software Engineer Intern · LightSpeed & Quantum Studios

Tencent Games

  • Implemented an asynchronous and high-performance C/C++ service framework based on the Router-Dealer prototype using ZeroMQ, providing asynchronous and concurrent support for game AI model training.
Jun 2019 - Sep 2019
4 months
Beijing, China

Software Engineer Intern · Huawei Cloud

Huawei Technologies Co., Ltd.

  • Implemented middleware in C for monitoring gateway traffic and load balancing clusters, referencing rate-limiting algorithms (leaky bucket, token bucket).

Languages

English
Advanced
Chinese
Advanced
Japanese
Elementary

Education

Sep 2020 - Sep 2022

Waseda University

Master of Engineering in Information Systems · Information Systems · Japan

Sep 2016 - Jun 2020

Dalian University of Technology

Bachelor of Science in Computer Science · Computer Science · Dalian, China · 3.8/4.0

Need a freelancer? Find your match in seconds.
Try FRATCH GPT
More actions

Similar Freelancers

Discover other experts with similar qualifications and experience

Serge K.
Serge K.

Senior DevOps (external)

View Profile
Eduard V.
Eduard V.

Tech Lead Customer Base Documentation Automation

View Profile
Tarek S.
Tarek S.

Cloud Analytics Developer

View Profile
Siddharth N.
Siddharth N.

Principal Consultant

View Profile
Alexander Z.
Alexander Z.

Senior Data Architect & Data Engineer

View Profile
Vladislav L.
Vladislav L.

Freelance Data Engineer / Architect

View Profile
Antoine L.
Antoine L.

Cloud, data and Dev(Sec)Ops Architect/Engineer

View Profile
Ildar A.
Ildar A.

Senior Data Engineer

View Profile
Amit P.
Amit P.

Senior AWS Data Engineer

View Profile
Konstantin G.
Konstantin G.

Requirements engineer, Python Developer

View Profile
Christian R.
Christian R.

Data Engineer

View Profile
Basem E.
Basem E.

Head of Cloud & AI

View Profile
Pappu P.
Pappu P.

Senior Cloud Consultant (AWS Services and Consulting)

View Profile
Biju K.
Biju K.

Freelance AI Strategist & Governance Expert

View Profile
Ursula M.
Ursula M.

Data Scientist & AI Engineer & AI Architect

View Profile
Jorge M.
Jorge M.

Data Architect

View Profile
Vladimir N.
Vladimir N.

Psychometric Specialist

View Profile
Amandeep S.
Amandeep S.

Data Engineer/Analyst

View Profile
Philipp G.
Philipp G.

Building a Modern Compensation System

View Profile
Marco C.
Marco C.

Global Process Owner Business Intelligence

View Profile
Davide M.
Davide M.

Senior Data Architect/Engineer

View Profile
Michael F.
Michael F.

Freelancer, Solution Architect

View Profile
Umar M.
Umar M.

Senior AI Architect & Engineer

View Profile
Tinashe E.
Tinashe E.

Automation & Robotics Lecturer

View Profile
Manuel P.
Manuel P.

AI Solution Architect

View Profile
Julien L.
Julien L.

MLOps Engineer

View Profile
Jayana S.
Jayana S.

AI Data Engineer Intern

View Profile
Stephan S.
Stephan S.

Senior Data/ML Consultant & Technical Lead

View Profile
Mario R.
Mario R.

Owner / Founder, IT Consultant, Unix/Linux, Oracle, Infrastructure & more

View Profile
Martijn I.
Martijn I.

Founder and CEO

View Profile