•Implemented the whole SmartChat flow executor. Designed and implemented inherited merchant-customizable prompt and parameters settings system. Integrated with vector DB and implemented a cron job to sync product catalog and FAQs with their vectors in DB. Designed and implemented benchmark evaluation system to improve prompts and parameters. Implemented and exposed a general LLM calling framework for the backend development
•Integrated chat bot with various 3rd platforms in multiple areas, such as customer support(Zendesk Support, Helpscout, Gorgias), scheduling (Timekit, Acuity, Xtime), SMS(Postscript), shipment tracking(Easypost), rewards(LoyaltyLion, Swell). Designed rate limiter to handle inbound and outbound requests, and designed state machine to handle the sync issue between ticket status and conversation session state
•Implemented new features in backend, such as store locator in the chat bot, campaign/engagement/reminder sender, URL shortener, event logger and archiver
•Performed daily bug fix and maintenance in Java Servlet backend. Performed daily data maintenance such as writing script to import, fix data, and wipe data for GDPR
•Built auto-tester for the chat bot, which enables customized testing flow
•Managed servers in AWS EC2, set up load balancers, monitor multiple services with AWS CloudWatch. Constructed CI/CD flow with Jenkins and AWS CodeDeploy
•Monitored and fixed issues for important services like: production and staging instances, MQ, Redis, ELK, Rasa NLP, Jenkins, etc.
•Implemented analytics dashboard and statistical charts in Angular with D3.js