Technical lead to drive all aspects of search quality valuation including both online testing and human judgment, from backend development, launching live experiments, to presenting test results. In charge of evaluating products including AppStore, Apple Music, iTunes, HomePod, Apple TV and Siri
• Spearheaded the engineering effort to extend the capability of in-house A/B testing infrastructure to evaluate the impact of advertising on AppStore, and published reports post-launch
• Pioneered success metrics for Apple Music search and new iOS 11 features in AppStore
• Led the evaluation of how site speed performance impacts user engagement and conversion
• Engineered automated pipelines to benchmark Siri search performance before HomePod product launch
• Produced A/B test readouts to drive launch decisions for search algorithms including query refinement, topic modeling, signal boosting and machine-learned weights for ranking signals
• Designed and executed an evaluation plan to compare the search relevance of AppStore with competitors