OpenAI Realtime API logo

OpenAI Realtime API

The OpenAI Realtime API is a developer interface for building voice agents that listen and speak in real time.

Documentation walks through creating a browser voice agent with the Agents SDK, then covers prompting, managing conversations, voice activity detection, tools and MCP connections. Developers can connect over WebRTC,…

OpenAI Realtime API screenshot

The OpenAI Realtime API is a developer interface for building voice agents that listen and speak in real time. Documentation walks through creating a browser voice agent with the Agents SDK, then covers prompting, managing conversations, voice activity detection, tools and MCP connections. Developers can connect over WebRTC, WebSockets or telephony and SIP, and related guides describe live transcription, live translation and text-to-speech. Custom voices, server-side controls and audio processing are part of the same section of the docs.

The audience is software engineers, solutions architects and product teams who want spoken interaction inside an application rather than a text box. A startup can prototype a voice front end for its product, while an enterprise team can follow the production guidance on latency, accuracy and cost optimization before launch. Contact center developers will look at the SIP and telephony options, and accessibility teams may explore live transcription. Working with it requires comfort with APIs and SDKs, so it is not a no-code option for general consumers or business users.

Typical scenarios include a support assistant that answers phone calls, an in-browser tutor that speaks with learners, a voice interface for a mobile app, and a live interpreter that translates speech between two languages. Developers connect tool calls so the agent can look up an order, schedule an appointment or query internal data in the middle of a conversation. The production section offers a deployment checklist, performance and quality tips, and ways to reduce cost and improve throughput as traffic grows.

OpenAI Realtime API alternatives

See all →

Frequently asked

6 questions
What does the OpenAI Realtime API do?
It powers voice agents that process and produce speech in real time. Developers use it to build conversational interfaces that handle live audio, tool calls and interruptions.
Who should use the OpenAI Realtime API?
Developers and product teams adding voice to an application are the intended users. It assumes familiarity with SDKs, APIs and realtime connections.
What can I build with the OpenAI Realtime API?
Examples include a browser voice agent, a phone support assistant over SIP, a live translator and a transcription feature. Tools and MCP connections let the agent take actions during a call.
How do I connect to the OpenAI Realtime API?
Supported connection types are WebRTC, WebSockets and telephony with SIP. A quickstart shows how to build a browser voice agent with the Agents SDK.
What is a practical limit of the OpenAI Realtime API?
Building a working product takes engineering effort, since this is a developer service. Latency, accuracy and cost need tuning, and the docs include dedicated guides for each.
Does the OpenAI Realtime API support custom voices and tools?
Custom voices are covered in the build-with-voice section, and tools and MCP servers can be attached to sessions. Server-side controls help manage behavior in production.

Reviews (0)

Write review

No reviews yet. Be the first to share your experience.