Working on data ingestion at near-petabyte scale; in-house workflow framework; data agent; data ontology tool; cloud brokers/file system/external data sources integration.

• Designed strategies to synchronize file metadata from multi-data sources(e.g., AWS Message Queue).

• Implemented complete and incremental indexing mechanism for files to increase search performance.

• Supported full text and regex file search functionality based on Elastic Search to increase platform usability.

My work focused on designing and implementing the data refreshing process in data warehouse.

• Redesigned the data refreshing rule in the ETL process

• Built data market according to analysts’ requirements

• Implemented a strategy for automatic metric collection to increase software engineers’ code quality

My work focused on designing the data model and improving the algorithm used for database backup.

• Designed a new data model to unify the data records generated over 20 scenarios.

• Proposed the shortest-path algorithm for identifying the data recovery path from the graph abstraction of the problem, resulting in a 90% reduction in recovery time for extreme user cases.