* F3 - Feature Framework Force
• Lead the project to build 3rd gen model building pipeline on Kubeflow/Spark/EKS
• Rewrite pipeline with kubeflow kfp
• Build operators dataset selection, datagen, featuregen, etc
• infrastructure setup and deployment EKS, Kubeflow, Spark, H2o etc
* Model Engineering Team / Prediction Service Team
• Feature Engineering
• Online prediction service development
• Rebuild model building pipeline with Airflow/Spark
• Experiment different model algorithms on AWS EMR
• Anything python related, dev environment setup, building system etc
Technology:
• Python, Scala, Java, Bash/Makefile, Gradle, gRPC, etc
• Spark, Hive, H2O, Airflow ...
• TeamCity, Datadog, PagerDuty, Loggly ...
• AWS (EMR, EC2, ECS, Cloudformation, etc) & Kubernetes