• Developer on Triton Inference Server, optimizing GPU-based inference orchestration.

• Led creation of Triton Model Analyzer, streamlining workload agnostic configuration optimization for Triton Inference Server on NVIDIA GPUs.

• Enhanced performance tuning via parameter search algorithms and detailed reporting of latency vs throughput curves.

• Implemented performance improvements and cloud model-store integration in the TensorRT inference server.