(1) Interactive video game encoding and streaming

• Developed the interactive game encoding and streaming on Raspberry Pi 3

• Designed and implemented special GoP structure to reduce streaming latency

• Developed the mobile client end decoder to decode the encoded game stream

• Developed the bandwidth estimation algorithm at the distribution server to adjust frame rate based on the estimated bandwidth

(2) Developed backend message pushing and email distribution service for short video social App

(1) Worked on backend transcoding framework for Verizon IPTV product

• Developed the backend server architecture for fast and reliable transcoding both live and Video-on-Demand (VoD) contents

• Developed the backend video pipeline for both live and VoD contents

• Developed the Raft consensus algorithm to improve the backend server stability

(2) Developed a monitoring system for IPTV backend that can show real time system health and act proactively to reduce the interruption to live channel transcoding

(1) Worked on the firmware development for HEVC hardware decoder in hardware video decoding engine (MIPS core)

(2) Developed HEVC decoder verification C model for the HEVC hardware decoder in multi-format video engine

(3) Developed the VP9 VLD decoder C-model that verifies the hardware design

(4) Involved in China’s next generation audio and video coding standard (AVS2 P2)

• Proposed the 10-bit profile for AVS P2

• Submitted proposals to modify inverse transform and direct mode motion vector derivation to make it friendly for hardware implementation

(1) Worked on the Cisco Prevision Video Engine (CPVE) which powers Cisco Jabber enterprise communication (audio/video/message) product family.

• Optimized the H.264 encoder/decoder performance on mobile platform using ARM NEON intrinsic functions and ARM assembly instructions

• Developed the H.264 encoder/decoder GStreamer element using Android MediaCodec API

• Developed the error resilience techniques for reliable video transmission cross IP network (H.264 picture buffer management with long term reference frame, error resilience protocol (FLUX))

• Developed the captured video parameter selection algorithm for grabber bin GStreamer elements in the CPVE pipeline

(1) Worked in a group to develop the first H.264 AVC encoder on Intel graphics chip

• Developed the frame level constant bit rate (CBR) and variable bit rate (VBR) rate control algorithm

• Developed the first H.264 AVC encoder kernel on Intel graphics chip

• Developed hierarchical motion search and multi-reference encoding tools to improve the H.264 AVC encoder quality

(2) Developed the video conference software prototype based on H.264 encoder enabled by Intel graphic chip

• Developed the camera model for video capture from 2D USB camera, stereoscopic camera, and depth camera

• Developed features to enhance user experience using stereoscopic camera and depth camera: background removal, 2.5D parallax viewing experience, face composition, 3D video conference with 3D re-composition on remote end