• Designing and prototyping a new architecture to ingest and validate customer data using Spark, Kubernetes, Kafka and Helidon.
• Also working on a new UI to digest real-time Elastic Search results under the new architecture.
• Added AnalyticViews using Oracle Autonomous Database to enable pre-aggregation and analysis on customer data.
• Designed and built machine learning prototype to detect potential errors and make predictions for customers by clustering and dimensionality reduction algorithms (KNN and PCA).
• Migrated and re-implemented old server under SOAP architecture to a RESTful server. Also migrated and implemented SOAP test suite under data bank pattern.