Bai Li
Bai Li is a machine learning engineer and PhD in natural language processing who creates content on LLM serving, prompt optimization, and speech AI.
About Bai Li
Bai Li is a machine learning engineer with a PhD in natural language processing. The channel's content focuses on practical machine learning engineering, covering topics such as prompt caching, multi-armed bandits for prompt testing, LLM-as-Judge evaluation, and structured output using grammars and state machines. It also explores speech AI, including streaming ASR inference, speech-to-text APIs, and Speech LLMs.
The channel discusses specific tools and models like Voice Writer, Deepseek GRPO, and NoGIL Python. Technical subjects include training LLMs for specific tasks like chess, AI-generated text detection, and the architecture of software components like Chrome Extension permissions. The content is aimed at developers and engineers working on AI and NLP systems.