Bit is exploring the frontier technologies of combination of networking and LLM at Tencent Kubernetes Engine team. He is currently working on everthing around AI Infrastructure. Previously, he has been involved in NLP research at UESTC NLP Lab.
Bit is leading the development of vLLM Semantic Router, an intelligent auto reasoning router for Efficient LLM Inference on Mixture-of-Models, saving tons of cost by advanced routing algorithm.
As a CNCF Ambassador and Linux Foundation LFAPAC, Bit serves on the Envoy Gateway Steering Committee. He also maintains multiple projects including Envoy AI Gateway, vLLM AIBrix, Istio, Kiali, Aeraki-Mesh, and Merbridge, as well as the approver of Higress and MOSN. Additionally, Bit contributes as a Kubernetes Gateway API and Kubernetes Ingress2Gateway reviewer and member of Kubernetes.