Never let a signup go cold again.
Turn emails into revenue with Brew. No credit card, free credits to try.
Turn emails into revenue with Brew. No credit card, free credits to try.
livekit.io · newsletter
Explore this email design and adapt it to your own brand. Review the copy, links, and offer before sending.
Hey LiveKit devs,
We’ve got this month’s roundup for you, let’s get into it.
Product Changelog
Agent Console
Debug your voice agents in real time with Agent Console, a new web-based tool where you can talk to your agent directly to uncover why it’s not performing as expected. Use it to answer questions like: Why does my agent keep interrupting the user? Why is it taking so long to respond? Why is it not executing tool calls correctly? Why does it work in a browser but not over SIP?
From the LiveKit Cloud dashboard, you can view all the information you need to see how your agent behaves in a production environment: audio, events, latency, tool calls, transcripts, session and participant state, RPC traffic, DTMF, and usage. It works for agents built with Agents SDKs or Agent Builder, and deployed to LiveKit Cloud, self-hosted, or running locally. Learn more in our blog or watch Jesse’s walkthrough for an overview:
LiveKit Agent Console Launch Demo
Data tracks
We shipped data tracks, a new way to stream any kind of data in realtime between participants. Data tracks are designed for use cases where staying realtime matters over guaranteed delivery, such as sensor readings, teleoperation commands, and live telemetry. They’re more lightweight than media tracks for audio and video, with no codec overhead, E2E encryption, and the ability to publish multiple tracks per participant.
Data tracks are available for JavaScript, Python, Rust, C++, Unity, and Flutter. Read our blog and watch our video to learn more:
Stream Any Data in Realtime with LiveKit Data Tracks
livekit-wakeword
We open-sourced livekit-wakeword, a library that lets you train a custom wake word model with a single command. Give it a word or phrase, and it generates synthetic training data using TTS, augments it with background noise, and trains a lightweight model you can deploy anywhere with no ML experience or labeled datasets required.
It’s a great fit for LiveKit agents in embedded devices, smart home integrations, kiosks, in-car systems, and other applications where you need hands-free voice activation. livekit-wakeword delivers 100x fewer false positives per hour, 60x lower detection error, and 86% recall vs 69% recall for openWakeWord. It’s also fully compatible so you can drop it into Home Assistant or any existing integration. Watch our demo to see it in action and check out the blog for details.
Train a Custom Wake Word Model with One Command (Open Source)
Preemptive generation enabled by default
Starting in livekit-agents@1.5.0 and agents-js@1.2.0, preemptive_generation will now be enabled by default for all agents. Preemptive speech generation allows the agent to begin generating a response before the user’s end of turn is committed, which can reduce E2E latency by around 300ms.
Based on positive feedback from the community, we decided to make it the default behavior to optimize agent performance out of the box, though note that preemptive generation may consume more LLM and TTS tokens.
Content & Community Highlights
10k stars on livekit/agents
We recently hit 10k stars on GitHub for our Python Agents SDK. Thank you to every developer who has contributed, filed issues, and built with us. This community is what makes LiveKit better every day.
Reduce the latency of your voice agents
Minimizing end-to-end latency is usually the biggest challenge in delivering a great voice agent experience. In our latest deep dive, we break down the full voice agent pipeline, show you how to inspect metrics, and share practical tips for reducing latency across each stage. Check out Darryn’s video for an overview of where to start:
Reduce the latency of your voice agent
Fix mispronunciations with Rime Mist v3
Does your agent need to use medical terms, brand names, or technical jargon in conversations? Most TTS models struggle with uncommon terminology and can impact your agent’s credibility. With Rime Mist v3, you can use phonetic brackets to correct mispronunciations inline without post-processing or custom dictionaries. See the model in action in Jesse’s demo featuring medication names or try it yourself on LiveKit Inference:
Fix AI Voice Agent Mispronunciations with Rime Mist v3 Phonetic Brackets
Build avatars with emotions on Keyframe Labs
Keyframe Labs released a LiveKit Agents plugin for building hyper-realistic avatars with emotional expressions. Watch the full demo to see what's possible when you combine expressive avatars with voice agents, including agent handoffs and tool calling:
Hyper-Realistic AI Avatars with Emotions, Handoffs & Tool Calling
LiveKit in the Wild
livekit-wakeword on Reddit
Our new open-source library made waves in the r/homeassistant community. Developers are already using it to build custom wake words for their smart home setups that can be trained with one command and deployed locally with no cloud dependency.
Voice Agent Webinar with Simplismart and LiveKit
📅 Wednesday, April 22 at 8:30 PM - 10:00 PM (ET)
📍 Virtual (Zoom)
Looking to build your voice agent using open-source models? Register for our upcoming webinar with Simplismart where we walk you through how to get started with LiveKit. We’ll use Qwen for TTS, Whisper v3 Turbo for STT, and Gemma 3 4B as the LLM. The session will be hands-on and beginner-friendly.
Google Cloud Next: LiveKit Demos
📅 Wednesday, April 22 at 2:00 PM - 5:00 PM | Thursday, April 23 at 12:00 PM - 1:00 PM (PT)
📍 Mandalay Bay Convention Center, Las Vegas
If you’re heading to Las Vegas next week, don’t miss Jesse’s LiveKit demo in the Future of AI Garden area in the Startup Hub of the Expo Hall on Wednesday afternoon. We’ll also be joining the DeepMind team in their startup workshop on building agents with Gemini and Antigravity on Thursday.
The Agentic Evolution Hackathon
📅 Saturday, May 2 at 9:00 AM - 9:00 PM (GMT+1)
📍 CodeNode, London, UK
Join us in London for an in-person hackathon hosted by MongoDB and show us your best agents built with LiveKit. Prizes include £15,000 in cash and partner credits across the top three teams. Winners will demo their projects on stage at MongoDB.local London on May 7th.
Voice AI Speakeasy hosted by LiveKit + Cartesia | #AIAgentWeek
📅 Tuesday, May 5 at 6:00 PM - 9:00 PM (ET)
📍 Madame George, New York City
We’re hosting a happy hour with Cartesia during AI Agent Week in NYC. Join us for drinks and conversation to wind down from the conference. Space is limited, so request to join if you’ll be in town. Note that this is a private event and approval is required to attend.
Happy hacking!
Let's build together
Join our developer community
Follow us on X
Contribute on GitHub
Subscribe to Youtube
