My work at Walmart lies at the interesting intersection of Big data and Engineering. Specifically into data engineering (build data ingestion pipelines to move international data from various data sources into the data lake for end users to consume) and pricing domain - (build algorithms to decide on markdown percentages that should be given to perishable products in order to reduce waste)
Some of the pieces I worked on are:
•Engineered an automated framework for DSIM (Dynamic Store Initiated Markdown) which is used for identifying seasonality trends for finelines and departments in international markets. Worked in Development of Alert Mechanism and Intelligent Feedback Correction system workstream to generate markdown for DSIM ASDA;
•Collaborated on a Machine Learning product for item recommendation that can lead to a better online experience and drive customer acquisition and conversions.
•Built data models and data pipelines on ETL workflows by using the Hadoop ecosystem, worked with various data sources (Oracle, Teradata, DB2, etc.).
•Leveraged SQL, Hadoop and Python to perform data validation tasks and migrate data into data lake.
