Twilio, a customer engagement platform has announced an integration in collaboration with OpenAI to bring the company’s new Realtime API to the Twilio platform. The integration of streaming speech-to-speech (S2S) capabilities – part of the Realtime API – will enable over 300,000 Twilio customers and more than 10 million developers to build powerful conversational AI virtual agents leveraging OpenAI’s flagship multilingual and multimodal GPT-4o model.
The new integration builds on existing OpenAI and Twilio product integrations announced last year to bring the power of LLMs to the customer engagement platform.
“Integrating OpenAI’s Realtime API with Twilio’s platform enables businesses to offer more natural, real-time AI voice interactions at scale,” said Inbal Shani, Chief Product Officer, Twilio Communications.“Businesses can use this to create voice experiences that feel more human and can reduce operational costs and drive higher customer satisfaction.”
Speech-to-speech is an emerging technology that allows for voice conversations by AI virtual agents to feel more like real human dialogue. OpenAI’s Realtime API reduces latency and factors in key components like conversation pacing, interruption handling, tone, and balance between speaking and listening – all critical user experience elements that are essential for the right customer experience.
“The Realtime API’s speech-to-speech capabilities are designed to address strong customer demand for conversational AI solutions,” said Olivier Godement, Head of Product, API at OpenAI. “We’re thrilled to collaborate with Twilio to deliver a world class developer experience for building and deploying conversational AI agents.”
The technology is especially relevant for customer service and sales, delivering both operational efficiency and exceptional customer outcomes. Speech-to-speech is also set to support social impact at scale, empowering nonprofit and public sector organizations to deploy novel use cases like voice translation in real time between constituents and staff members who speak different languages.
Share