openai · OpenAI Platform Docs
Realtime API with WebRTC | OpenAI API
Teaches how to implement low-latency, real-time audio and video interactions by integrating the OpenAI Realtime API using WebRTC protocols.
Derived skill
Files assembled from official documentation
Viewing SKILL.md
Realtime API with WebRTC | OpenAI API
Teaches how to implement low-latency, real-time audio and video interactions by integrating the OpenAI Realtime API using WebRTC protocols.
When To Use
Use when you need to establish a real-time, low-latency connection for voice or multimodal interactions between a client and the OpenAI Realtime API using WebRTC.
Reference Files
| File | Contains | Use For |
|---|---|---|
SKILL.md | Entry point: scope, routing table, and workflow. | Start here. |
docs/realtime-api-with-webrtc-openai-workflow-guide.md | A guide explaining how to connect to the OpenAI Realtime API using WebRTC peer connections and the unified interface. | Questions about a guide explaining how to connect to the OpenAI Realtime API using WebRTC peer connections and the unified interface. |
examples/realtime-api-with-webrtc-openai-openai-realtime-webrtc-express-sdp-serve.text | An Express.js server implementation that parses raw SDP payloads to facilitate WebRTC connections with the OpenAI Realtime API. | Exact payloads, commands, or snippets shown in An Express.js server implementation that parses raw SDP payloads to facilitate WebRTC connections with the OpenAI Rea... |
examples/realtime-api-with-webrtc-openai-openai-realtime-webrtc-javascript-peerco.text | A JavaScript code snippet demonstrating how to initialize an RTCPeerConnection and handle remote audio tracks for the OpenAI Realtime API via WebRTC. | Exact payloads, commands, or snippets shown in A JavaScript code snippet demonstrating how to initialize an RTCPeerConnection and handle remote audio tracks for the... |
examples/realtime-api-with-webrtc-openai-openai-realtime-webrtc-express-session-c.text | A JavaScript configuration object for an Express server defining the session settings for the OpenAI Realtime API using WebRTC. | Exact payloads, commands, or snippets shown in A JavaScript configuration object for an Express server defining the session settings for the OpenAI Realtime API usi... |
examples/realtime-api-with-webrtc-openai-openai-realtime-webrtc-javascript-sessio.text | A JavaScript code snippet demonstrating how to fetch an ephemeral session token and initialize an RTCPeerConnection for the OpenAI Realtime API via WebRTC. | Exact payloads, commands, or snippets shown in A JavaScript code snippet demonstrating how to fetch an ephemeral session token and initialize an RTCPeerConnection f... |
examples/realtime-api-with-webrtc-openai-realtime-api-webrtc-data-channel-event-h.text | JavaScript code demonstrating how to create a WebRTC data channel and listen for server events using the OpenAI Realtime API. | Exact payloads, commands, or snippets shown in JavaScript code demonstrating how to create a WebRTC data channel and listen for server events using the OpenAI Realt... |
What This Skill Covers
- WebRTC is a powerful set of standard interfaces for building real-time applications. The OpenAI Realtime API supports connecting to realtime models through a...
- Main sections:
Overview,Connecting using the unified interface,Creating a session via the unified interface,Connecting to the server,Connecting using an ephemeral token.
Workflow
- Open the most relevant file under
docs/for the exact documented workflow and wording. - Open
schemas/files for exact structured contracts. - Open
examples/files for concrete requests, commands, snippets, and manifests. - Do not add behavior or configuration that is not present in the attached source files.
Canonical source: https://developers.openai.com/api/docs/guides/realtime-webrtc