Software engineer in data group

Working as software intern of infrastructure team.

Worked as Data Engineer in Tencent's joint venture program, which collaborates with CICC, a leading investment bank in China. As a data engineer, I work on developing data wharehouse/ lake(based on Apache Iceberg) using tools like hive, spark and Apache Flink to ensure accuracy and availability of our company's data, and supports the business/data analysis group. My current job also involves reliability management of company's private hadoop/datalake cluster, metadata governance tool, and graph database.

∙ Work in the joint venture group of Tencent and CICC (金腾科技) to help manage the data that support finance service of the company.

∙ Manage distributed transaction and user data on Hadoop/Hive based company server

∙ Help building Spark and Hive Based machine learning platform in company's newly built private HDFS cluster

∙ Build data visualization and distributed machine learning tools in Scala/Python to help analyzing data in server