• Engineered near-real-time streaming API to seamlessly deliver data updates via AWS, Webhooks, and Azure.
• Developed a robust data ingestion/migration tool, facilitating smooth transition from Kafka and Cassandra to InfluxDB.
• Leveraged Apache Spark to architect a sophisticated migration pipeline from Cassandra to diverse destinations such as GCP (BigQuery) and CSV files for reporting purposes.
• Led the design, development, and maintenance of multiple reporting systems, encompassing power usage, sustainability, and API metrics.
• Pioneered the creation of an in-house system monitoring tool, leveraging Prometheus and Grafana for enhanced Observability.
• Led the development and implementation of a cutting-edge real-time power data collection component, utilizing Kafka, Storm, Cassandra, Redis, and Oracle technologies.
• Orchestrated the seamless implementation of REST APIs, empowering seamless information export to third-party entities, catering to both customer and internal requirements.
• Crafted and implemented a comprehensive data quality page, offering deep insights into IoT system performance and data integrity.
• Architected a centralized IoT platform, facilitating the collection of power utilization data from a myriad of devices using protocols like OPC, Modbus, BACnet, and SNMP.
• Deployed automated CI/CD workflows using GitHub Actions, optimizing software development processes for efficiency and reliability.
• Spearheaded unit testing, developed functional test cases, and configured monitoring/alert services to ensure system robustness and reliability.
