Ziyang F.
Software Engineer · DataWorks
Experience
Sep 2022 - Present
3 years 3 monthsHangzhou, China
Software Engineer · DataWorks
Alibaba Cloud
- Developed over 20 inspectors (e.g., high-cost SQL, table and field existence, prohibition of simple processing) for pre-event phase, intercepting user operations, submissions, and releases, with daily check-tasks reaching tens of thousands.
- Built a highly available failover mechanism, enabling regular heartbeat reporting, master election upon disconnection, and secondary distribution of failed tasks.
- Designed five domains (R&D, storage, computing, quality, security) for governance items, developed over 60 governance items (e.g., missing upstream dependencies, data skew, consistent continuous import), and performed T+1 day lineage tracking, data processing, benefit calculation, health scoring, and report backflow, generating millions of governance items daily.
- Developed automated tools for governance items, such as one-click upstream dependency completion and data skew optimization (MapJoin, SkewJoin).
- Designed and developed a short URL generator, using auto-increment unique ID, base-62 conversion, storage mapping, and LRU algorithm for cache updates.
- Deeply optimized governance report query scenarios, implemented a multi-data source access mechanism combining OLAP (MySQL index optimization) and OLTP (Hologres column family optimization), ensured data consistency through Flink CDC link synchronization, and deployed monitoring and downgrade strategies.
Dec 2020 - Apr 2021
5 monthsShenzhen, China
Software Engineer Intern · LightSpeed & Quantum Studios
Tencent Games
- Implemented an asynchronous and high-performance C/C++ service framework based on the Router-Dealer prototype using ZeroMQ, providing asynchronous and concurrent support for game AI model training.
Jun 2019 - Sep 2019
4 monthsBeijing, China
Software Engineer Intern · Huawei Cloud
Huawei Technologies Co., Ltd.
- Implemented middleware in C for monitoring gateway traffic and load balancing clusters, referencing rate-limiting algorithms (leaky bucket, token bucket).
Languages
English
AdvancedChinese
AdvancedJapanese
ElementaryEducation
Sep 2020 - Sep 2022
Waseda University
Master of Engineering in Information Systems · Information Systems · Japan
Sep 2016 - Jun 2020
Dalian University of Technology
Bachelor of Science in Computer Science · Computer Science · Dalian, China · 3.8/4.0
Need a freelancer? Find your match in seconds.
Try FRATCH GPT More actions
Similar Freelancers
Discover other experts with similar qualifications and experience
- English
- Deutsch
2025 © FRATCH.IO GmbH. All rights reserved.