Project:
•Built a performance monitoring system that ingests and processes machine logs and generates intuitive visualizations at the real time according to the user configuration.
•A web-based application is composed of uploading logs, authoring tool, and graph explorer.
•Uploading log is used to store the logs data into the database.
•Authoring Tool is used to configuring the data flow using available nodes in Node-Red. The user can create its own complex data flow.
•Graph Explorer is used to visualize the data according to the configuration during the selected time range.
•Very useful and intuitive system for the workers to visualize the processing of their machine. Such tools can be used in the wide range of industries.
Architecture:
•The big data is getting processed, structured using Java engine and indexed in ElasticSearch / Solr.
•The processing engine is used to process the configuration along with searching data in the database to generate various charts as per the requirement.
•Generation of rules dynamically and applies rules for states of the machine. Predicts defects in the machine using Spark MLlib.
Tool & technologies:
Java, spring-boot, node js
Elastic Search, Kibana, Solr
Rest API
Drools Dynamic Rule Engine
Angular js
Eclipse, Spring Tool Suite, Sublime
Postman
Akka library for multi-threading