• Designed and implemented a real-time data feed pipeline using Apache Beam, Google Cloud Pub/Sub, and third-party webhooks, establishing a robust backbone for merchant-facing analytic;

• Refactored and optimized data infrastructure with Terraform, Airflow, Dataflow, and various micro services, resulting in reliable data transaction eco-system and achieving a 40% cost reduction;

• Managed data warehouse operations with DBT, Snowflake, and Looker, ensuring smooth data processing and reporting workflows. Implemented monitoring and alerting systems using SignalFX and Chromosphere;

Participant in development lifecycle of SaaS enterprise analytics platform from designing database schema to create RestFUL api that connect front-end server, using Django, Vue and PostgeSQL framework.

Write asynchronous tasks queue to connect AI server and system server; handle function such as update db, retrieve report, create dashboard; Due diligent in version control and unit test

Collaborate with multidisciplinary team of frontend engineers and data scientist team. Build data wrangler system that allow clients upload, clean, manipulate datasets for ML.

• Monetize web traffic by designing API using AWS CloudSearch and EC2, enable direct pay-per-click without sharing profits with third party; Automate updating function to ensure up-to-date data and optimized by Celery and RabbitMQ;

• Built product database(with Panda, ET, BOTO3, ftplib) and mapping with front-end NLP model (With flask, gunicorn and WSGI) ; Built fashion web crawler with Spyder framework and BeautifulSoup;

• Design PHP Wordpress plugin with Laravel Framework and Nova administration panel to integrate NLP and CV result; Cooperated with other developers on GitHub and familiar with Linux environment

* Improved performance (click-through-rate) of client news feed engine significantly (16%) by building a text mining model in R to curate web content; By tokenizing and text normalization various news source;

* Analyzed web traffic through Google Analytics and analyze customers’ geography distribution to curated more relevant content; Conducted A/B test email campaign;