# Daisy W. > Senior Data & Platform Engineer | Architecting the Intelligent Enterprise Location: San Jose, California, United States Profile: https://flows.cv/daisyw1 I build the high-velocity data ecosystems that modern companies run on. As a Senior Data & Platform Engineer, I specialize in architecting and operating the critical infrastructure that transforms raw data into secure, scalable, and AI-ready assets. My expertise lies in engineering terabyte-scale Spark pipelines on Google Cloud Platform (GCP) and deploying resilient microservices in Kubernetes. I thrive on solving complex data challenges and delivering the foundational systems that unlock advanced analytics, fuel business intelligence, and power data-driven decisions. ## Work Experience ### Senior Principal Software Engineer @ Broadcom Jan 2020 – Present | Palo Alto, California, United States Served as a key engineer for the SDL Data Pipeline and STAR Colossus Project, building the foundational systems for large-scale data processing and ingestion. •Architected the Central Nervous System for Enterprise Data: Built and scaled the sdl-data-pipeline from the ground up, processing terabytes of batch and streaming data with Spark on GCP Dataproc. This pipeline became the single source of truth, directly fueling business intelligence and enabling future ML models. •Mastered High-Stakes Data Operations: Owned the operational health of dozens of concurrent Spark/Hadoop jobs across multiple Dataproc clusters. Expertly diagnosed and resolved complex job failures in real-time, ensuring high data availability for mission-critical services. •Engineered Bulletproof Ingestion Services: Developed the core Java/Spring Boot microservice for all incoming telemetry data, creating a secure, high-throughput gateway. Implemented a robust JWT-based security model that guaranteed data provenance—a non-negotiable for building trusted AI. •Automated the Entire Data Lifecycle: Eradicated manual toil by scripting the end-to-end data workflow. Wrote powerful Bash and Python automation to handle everything from PostgreSQL extraction and GCS migration to archival, creating a self-healing and zero-maintenance data ecosystem. ### Principal Software Engineer @ Broadcom Jan 2019 – Jan 2020 | Mountain View, CA Technical member of the CASB (Cloud Application Security Broker) team. ### Principal Software Engineer @ Symantec Jan 2018 – Present | Mountain View, CA • Member of Architecture Change Team: implemented user authentication and authorizing features to secure Symantec's schema registry. • Designed, developed, optimized and hardened data processing framework and applications to enable real-time and batch ingestion of Peta-Bytes of cyber security related telemetry data into data lake. This successful effort has resulted in significant amount of cost savings for the company. • Technologies: Java, Spring, Spark, Kafka, Zookeeper, Storm, Hive, Oozie, HBase, Avro, ORC, Hadoop, MapReduce, AWS, S3, RDS/MySQL, Apache Ignite, Json Web Token, LDAP ### Senior Software Engineer @ Symantec Jan 2015 – Jan 2018 Built Symantec's Big Data Cyber Security Analytics platform on Amazon's AWS. • As a core member of the Symantec Authoritative Data Lake team, designed and developed real time streaming application using Apache Storm, Kafka, HDFS and HBase. • Enable fast lookup service (for data enrichment and data correlation) using open source solutions such as Chronicle Maps and Redis. • Developed data quality tool to collect Hive database and table meta data, to detect missing partitions. • Developed tools to monitor data ingestion rate, and alerting system for ingestion lags. ### Senior Software Engineer @ Narus Inc (Acquired by Symantec) Jan 2013 – Jan 2014 | Sunnyvale Developer for Narus network traffic intelligence, network analytics and cyber security products suites. Implemented job scheduling feature using open source solution Quartz. Developed REST service using GlassFish/Jersey. ### Principal Software Engineer @ EMC Jan 2012 – Jan 2013 | Pleasanton, California • Built OpenLDAP client library with RSA Share C, RSA Crypto C and RSA MES on all supported platforms. Successfully integrated OpenLDAP with Documentum products for FIPS compliance. • To support remote encryption keys in RSA Key Manager, implemented cryptographic key features in content server using RSA Key Manager C client library. • Collaborated with global teams in product design, development and QA testing. • Developed programs in C++ and Java. • Mentored and supervised 4 college new grads. ### Senior Software Engineer @ EMC Jan 2006 – Jan 2012 | Pleasanton, California • Re-architected LDAP user authentication feature to improve performance on all supported platforms (Windows, Linux, Solaris, AIX, and HP-UX) for Documentum Content Server 6.7 release. • Designed and implemented Java Method Server high availability to improve system robustness and reliability. • Provided solutions/workarounds to enterprise customer, to solve complex problems in areas of user provisioning, user authentication and user authorization. • Used VMWare vCenter Lab Manager to create virtual machines, to install and configure Documentum products on VMs for debugging, testing, and troubleshooting. ### Senior Analyst Programmer @ Hitachi Data Systems Jan 2003 – Jan 2006 | Santa Clara, California • Designed, implemented and deployed Single-Sign-On solution to integrate externally hosted Software Licensing and Entitlement Management System (SLEM), into the HDS extranet environment. Built and deployed Apache SOAP-based Web Services to perform user self-registration, serial number and ID validation securely over HTTPS. • Developed Java web-based admin console using Apache Velocity Template, to manage user profiles in LDAP directory server. Created server side components to enable report generation, password reset, and user provisioning to downstream applications. • Used the Stellent Universal Content Management System Site Builder to create and configure Stellent publisher projects. ## Education ### University of California, Davis ## Contact & Social - LinkedIn: https://linkedin.com/in/hire-daisy-wu --- Source: https://flows.cv/daisyw1 JSON Resume: https://flows.cv/daisyw1/resume.json Last updated: 2026-04-12