Bit is exploring the frontier tech in combination of networking and LLM at Tencent. He is currently working around AI Infrastructure, serving as the Chair of K8S AI Gateway WG. Previously, he has been involved in research at UESTC NLP Lab.
Bit is leading the development of vLLM Semantic Router, an intelligent auto reasoning router for Efficient LLM Inference on Mixture-of-Models, saving tons of cost by advanced routing algorithm.
As a CNCF Ambassador and Linux Foundation LFAPAC, Bit serves on the Envoy Gateway Steering Committee. He also maintains multiple projects including Envoy AI Gateway, vLLM AIBrix, Istio, Kiali, Aeraki-Mesh, and Merbridge, as well as the approver of Higress and MOSN. Additionally, Bit contributes as a Kubernetes Gateway API and Kubernetes Ingress2Gateway reviewer and member of Kubernetes.