Milpitas, California, United States
Designed and implemented a robust framework to allow for backwards compatible MongoDB database migration for our software upgrade, making use of systemd, docker containers, and pymongo library.
Designed and implemented the backend stack for providing the network ACL feature, utilizing linux iptables, docker, and python celery/bottle.
Worked directly with customers to resolve issues on-demand, such as providing a timely patch to HSBC to provide them a backdoor access to cleaning up InfluxDB with corrupted metadata.
Overhauled build/deployment stack for the product various times, such as providing the stack the ability to run with dynamic configuration for cache/memory limits for celery and influxdb based on hardware.
Enhanced logging and debugging interface for developers and customers with enhanced logging by setting up rsyslog server/logrotate to manage and preserve logs, redirecting docker logs to the rsyslog server.
Worked with the pandas and polars libraries to develop and improve the network packet analytics engine and set up resource control to avoid running out of memory and bottlenecking the InfluxDB.