openai · OpenAI Platform Docs
Using realtime models | OpenAI API
Teaches how to construct and optimize prompts specifically for realtime models to manage conversational flow, persona, and tool usage in low-latency voice or multimodal interactions.
Derived skill
Files assembled from official documentation
Viewing SKILL.md
Using realtime models | OpenAI API
Teaches how to construct and optimize prompts specifically for realtime models to manage conversational flow, persona, and tool usage in low-latency voice or multimodal interactions.
When To Use
Use when designing system instructions or prompt structures for low-latency, multimodal, or voice-based AI agents using OpenAI realtime models.
Reference Files
| File | Contains | Use For |
|---|---|---|
SKILL.md | Entry point: scope, routing table, and workflow. | Start here. |
docs/using-realtime-models-openai-api-workflow-guide.md | A guide detailing prompting strategies, recommended structures, and changes for the gpt-realtime-2 reasoning voice model. | Questions about a guide detailing prompting strategies, recommended structures, and changes for the gpt-realtime-2 reasoning voice mo... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guide.text | A text guide outlining strategies for role definition, personality, tone, and message channel management when prompting realtime models. | Exact payloads, commands, or snippets shown in A text guide outlining strategies for role definition, personality, tone, and message channel management when prompti... |
examples/using-realtime-models-openai-api-openai-realtime-models-reasoning-guidel.text | Guidelines for applying reasoning strategies when prompting realtime models for direct answers versus multi-step tasks. | Exact payloads, commands, or snippets shown in Guidelines for applying reasoning strategies when prompting realtime models for direct answers versus multi-step tasks. |
examples/using-realtime-models-openai-api-openai-realtime-models-preamble-guideli.text | Guidelines and best practices for using short preambles when interacting with realtime models to manage user expectations during tool calls or multi-step reasoning. | Exact payloads, commands, or snippets shown in Guidelines and best practices for using short preambles when interacting with realtime models to manage user expectat... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-verbos.text | Guidelines for controlling model verbosity, including instructions for direct answers, clarifying questions, and tool result summarization. | Exact payloads, commands, or snippets shown in Guidelines for controlling model verbosity, including instructions for direct answers, clarifying questions, and tool... |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-usage-instr.text | Guidelines and instructions for using tools within the OpenAI realtime models API. | Exact payloads, commands, or snippets shown in Guidelines and instructions for using tools within the OpenAI realtime models API. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-failure-han.text | Guidelines for instructing realtime models on how to communicate tool call failures to users in a user-friendly manner. | Exact payloads, commands, or snippets shown in Guidelines for instructing realtime models on how to communicate tool call failures to users in a user-friendly manner. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-availabilit.text | Text instructions defining how realtime models should handle tool availability and unavailable tool requests. | Exact payloads, commands, or snippets shown in Text instructions defining how realtime models should handle tool availability and unavailable tool requests. |
examples/using-realtime-models-openai-api-openai-realtime-models-waitforuser-tool.text | A JSON definition of the waitforuser tool used to end a turn without a spoken response in realtime models. | Exact payloads, commands, or snippets shown in A JSON definition of the waitforuser tool used to end a turn without a spoken response in realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-silence-and-back.text | Instructions for handling silence and background noise using the waitforuser tool in realtime models. | Exact payloads, commands, or snippets shown in Instructions for handling silence and background noise using the waitforuser tool in realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-commentary-chann.text | Instructions for prompting realtime models to provide verbal commentary before executing tool calls in the commentary channel. | Exact payloads, commands, or snippets shown in Instructions for prompting realtime models to provide verbal commentary before executing tool calls in the commentary... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-phase.text | A text example demonstrating the phase structure of model outputs including commentary and final answer phases for realtime models. | Exact payloads, commands, or snippets shown in A text example demonstrating the phase structure of model outputs including commentary and final answer phases for re... |
examples/using-realtime-models-openai-api-openai-realtime-models-response-done-ev.text | A text representation of a response.done event containing output audio transcripts and phase metadata from a realtime model session. | Exact payloads, commands, or snippets shown in A text representation of a response.done event containing output audio transcripts and phase metadata from a realtime... |
examples/using-realtime-models-openai-api-openai-realtime-models-unclear-audio-pr.text | Text instructions for prompting realtime models to handle unclear, noisy, or unintelligible user audio. | Exact payloads, commands, or snippets shown in Text instructions for prompting realtime models to handle unclear, noisy, or unintelligible user audio. |
examples/using-realtime-models-openai-api-openai-realtime-models-entity-collectio.text | Instructions for prompting realtime models to collect required entity values one at a time during a conversation. | Exact payloads, commands, or snippets shown in Instructions for prompting realtime models to collect required entity values one at a time during a conversation. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-spelle.text | Textual examples demonstrating how to format spoken sequences and separators for spelled-out characters when using realtime models. | Exact payloads, commands, or snippets shown in Textual examples demonstrating how to format spoken sequences and separators for spelled-out characters when using re... |
examples/using-realtime-models-openai-api-openai-realtime-models-spoken-number-ha.text | A list of text examples demonstrating how to convert various spoken number formats into numeric digits for realtime model prompting. | Exact payloads, commands, or snippets shown in A list of text examples demonstrating how to convert various spoken number formats into numeric digits for realtime m... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-exact-.text | A text-based guide outlining instructions for confirming high-precision identifiers when using realtime models. | Exact payloads, commands, or snippets shown in A text-based guide outlining instructions for confirming high-precision identifiers when using realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-email-.text | Instructions and conversational examples for prompting realtime models to accurately capture and confirm user email addresses. | Exact payloads, commands, or snippets shown in Instructions and conversational examples for prompting realtime models to accurately capture and confirm user email a... |
examples/using-realtime-models-openai-api-openai-realtime-models-entity-collectio-2.text | A text-based guide outlining the workflow for collecting and confirming exact values like order IDs and email addresses when using realtime models. | Exact payloads, commands, or snippets shown in A text-based guide outlining the workflow for collecting and confirming exact values like order IDs and email address... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guidel.text | Guidelines and best practices for prompting realtime models, including instructions for handling tool-use confirmation for write actions. | Exact payloads, commands, or snippets shown in Guidelines and best practices for prompting realtime models, including instructions for handling tool-use confirmatio... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guidel-2.text | Best practices and instructions for prompting realtime models, including requirements for user confirmation. | Exact payloads, commands, or snippets shown in Best practices and instructions for prompting realtime models, including requirements for user confirmation. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-instru.text | Text instructions demonstrating how to prompt realtime models to repeat confirmation codes verbatim and wait for user validation. | Exact payloads, commands, or snippets shown in Text instructions demonstrating how to prompt realtime models to repeat confirmation codes verbatim and wait for user... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guidel-3.text | Instructions for prompting realtime models to repeat captured identifiers like order IDs or PINs for user confirmation before executing tool calls. | Exact payloads, commands, or snippets shown in Instructions for prompting realtime models to repeat captured identifiers like order IDs or PINs for user confirmatio... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guide-2.text | A text guide outlining prompting strategies for realtime models to mirror user language, accent, and natural conversational patterns. | Exact payloads, commands, or snippets shown in A text guide outlining prompting strategies for realtime models to mirror user language, accent, and natural conversa... |
examples/using-realtime-models-openai-api-openai-realtime-models-language-detecti.text | Guidelines for language detection and response behavior when using OpenAI realtime models. | Exact payloads, commands, or snippets shown in Guidelines for language detection and response behavior when using OpenAI realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-langua.text | Instructions for managing language switching and default language settings when using OpenAI realtime models. | Exact payloads, commands, or snippets shown in Instructions for managing language switching and default language settings when using OpenAI realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting.text | A text example demonstrating how to use system instructions to influence the persona and accent of a realtime model. | Exact payloads, commands, or snippets shown in A text example demonstrating how to use system instructions to influence the persona and accent of a realtime model. |
examples/using-realtime-models-openai-api-openai-realtime-models-accent-prompting.text | A text guide providing specific prompting instructions for maintaining stable accents when using OpenAI realtime models. | Exact payloads, commands, or snippets shown in A text guide providing specific prompting instructions for maintaining stable accents when using OpenAI realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-contex.text | A text template demonstrating how to structure context, current state, and authoritative sources for prompting realtime models. | Exact payloads, commands, or snippets shown in A text template demonstrating how to structure context, current state, and authoritative sources for prompting realti... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-guide-3.text | A structured text template outlining roles, objectives, personality, context, and conversation flow for prompting realtime models. | Exact payloads, commands, or snippets shown in A structured text template outlining roles, objectives, personality, context, and conversation flow for prompting rea... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-role-o.text | A text-based system prompt defining a Quebecois French-speaking customer service bot persona for realtime models. | Exact payloads, commands, or snippets shown in A text-based system prompt defining a Quebecois French-speaking customer service bot persona for realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-system.text | A text-based example of a system role and objective prompt designed for guiding a user through a game-show scenario using realtime models. | Exact payloads, commands, or snippets shown in A text-based example of a system role and objective prompt designed for guiding a user through a game-show scenario u... |
examples/using-realtime-models-openai-api-openai-realtime-models-personality-tone.text | A text file defining personality and tone instructions for configuring a realtime model as a customer service assistant. | Exact payloads, commands, or snippets shown in A text file defining personality and tone instructions for configuring a realtime model as a customer service assistant. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-person.text | A text-based example demonstrating how to prompt realtime models to transition through different personality and tone states. | Exact payloads, commands, or snippets shown in A text-based example demonstrating how to prompt realtime models to transition through different personality and tone... |
examples/using-realtime-models-openai-api-openai-realtime-models-personality-and-.text | A text-based prompt defining the personality, tone, length, and pacing instructions for a realtime model customer service assistant. | Exact payloads, commands, or snippets shown in A text-based prompt defining the personality, tone, length, and pacing instructions for a realtime model customer ser... |
examples/using-realtime-models-openai-api-openai-realtime-models-personality-and--2.text | A text-based prompt template defining the personality, tone, length, and language constraints for a realtime model customer service assistant. | Exact payloads, commands, or snippets shown in A text-based prompt template defining the personality, tone, length, and language constraints for a realtime model cu... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-system-2.text | A text file containing a system prompt designed to configure a realtime model as a French language tutor. | Exact payloads, commands, or snippets shown in A text file containing a system prompt designed to configure a realtime model as a French language tutor. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-person-2.text | Text instructions defining the personality, tone, length, and language constraints for a realtime model customer service assistant. | Exact payloads, commands, or snippets shown in Text instructions defining the personality, tone, length, and language constraints for a realtime model customer serv... |
examples/using-realtime-models-openai-api-openai-realtime-models-pronunciation-re.text | A list of specific phonetic pronunciations for technical terms and proper nouns to be used when prompting realtime models. | Exact payloads, commands, or snippets shown in A list of specific phonetic pronunciations for technical terms and proper nouns to be used when prompting realtime mo... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-instru-2.text | A text file containing specific instructions and rules for prompting realtime models to format number and code speech output. | Exact payloads, commands, or snippets shown in A text file containing specific instructions and rules for prompting realtime models to format number and code speech... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-instru-3.text | A text file containing system instructions and conversation examples for guiding realtime model behavior during phone number verification tasks. | Exact payloads, commands, or snippets shown in A text file containing system instructions and conversation examples for guiding realtime model behavior during phone... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompt-critique-.text | A text-based prompt template defining the role and instructions for a Prompt-Critique Expert to evaluate LLM prompts for ambiguity and lack of definitions. | Exact payloads, commands, or snippets shown in A text-based prompt template defining the role and instructions for a Prompt-Critique Expert to evaluate LLM prompts... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompt-optimizat.text | A text template used to structure a prompt for requesting model variants to resolve specific instruction-following issues in realtime models. | Exact payloads, commands, or snippets shown in A text template used to structure a prompt for requesting model variants to resolve specific instruction-following is... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-instru-4.text | A set of system instructions and rules for configuring realtime models to handle audio clarity and language consistency. | Exact payloads, commands, or snippets shown in A set of system instructions and rules for configuring realtime models to handle audio clarity and language consistency. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-instru-5.text | A text file containing specific instructions and rules for prompting OpenAI realtime models, including constraints on sound effects and onomatopoeia. | Exact payloads, commands, or snippets shown in A text file containing specific instructions and rules for prompting OpenAI realtime models, including constraints on... |
examples/using-realtime-models-openai-api-openai-realtime-models-tools-definition.text | A text-based definition of tool schemas and function descriptions used for prompting realtime models. | Exact payloads, commands, or snippets shown in A text-based definition of tool schemas and function descriptions used for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-function-definit.text | A list of JSON function definitions including lookupaccount and checkoutage for use with realtime models. | Exact payloads, commands, or snippets shown in A list of JSON function definitions including lookupaccount and checkoutage for use with realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-calling-pro.text | Text instructions for prompting realtime models to use short conversational filler before executing tool calls. | Exact payloads, commands, or snippets shown in Text instructions for prompting realtime models to use short conversational filler before executing tool calls. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-definition.text | A text-based example of a tool definition for a lookupaccount function used within OpenAI realtime model prompting. | Exact payloads, commands, or snippets shown in A text-based example of a tool definition for a lookupaccount function used within OpenAI realtime model prompting. |
examples/using-realtime-models-openai-api-openai-realtime-models-tools-prompting-.text | Text instructions for prompting realtime models regarding tool calling behavior and proactive execution. | Exact payloads, commands, or snippets shown in Text instructions for prompting realtime models regarding tool calling behavior and proactive execution. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-definitions.text | A text-based list of tool definitions and usage guidelines for prompting realtime models. | Exact payloads, commands, or snippets shown in A text-based list of tool definitions and usage guidelines for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-tool-prompting-i.text | Text instructions defining tool usage behaviors and preamble requirements for proactive, confirmation-first, and preamble-required tools in realtime models. | Exact payloads, commands, or snippets shown in Text instructions defining tool usage behaviors and preamble requirements for proactive, confirmation-first, and prea... |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-2.text | A text-based example demonstrating how to structure prompts for interacting with OpenAI realtime models. | Exact payloads, commands, or snippets shown in A text-based example demonstrating how to structure prompts for interacting with OpenAI realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-3.text | A text-based example demonstrating response text and verbatim repeat requirements for prompting realtime models. | Exact payloads, commands, or snippets shown in A text-based example demonstrating response text and verbatim repeat requirements for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-tools-supervisor.text | A text definition of the Tools Supervisor tool including its name, parameters, and invocation logic for realtime models. | Exact payloads, commands, or snippets shown in A text definition of the Tools Supervisor tool including its name, parameters, and invocation logic for realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-functi.text | A text file defining function descriptions for realtime model prompting, including answer, escalatetohuman, and finishsession tools. | Exact payloads, commands, or snippets shown in A text file defining function descriptions for realtime model prompting, including answer, escalatetohuman, and finis... |
examples/using-realtime-models-openai-api-openai-realtime-models-conversation-flo.text | A text-based conversation flow template defining greeting goals and discovery steps for prompting realtime models. | Exact payloads, commands, or snippets shown in A text-based conversation flow template defining greeting goals and discovery steps for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-prompting-sample.text | A collection of sample phrases for acknowledgements, clarifiers, bridges, and empathy to guide realtime model prompting. | Exact payloads, commands, or snippets shown in A collection of sample phrases for acknowledgements, clarifiers, bridges, and empathy to guide realtime model prompting. |
examples/using-realtime-models-openai-api-openai-realtime-models-conversation-flo-2.text | A text-based guide outlining conversation flow strategies and sample phrases for prompting realtime models. | Exact payloads, commands, or snippets shown in A text-based guide outlining conversation flow strategies and sample phrases for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-conversation-sta.text | A list of conversation states including IDs, descriptions, and instructions for prompting realtime models. | Exact payloads, commands, or snippets shown in A list of conversation states including IDs, descriptions, and instructions for prompting realtime models. |
examples/using-realtime-models-openai-api-openai-realtime-models-state-machine-tr.text | A Python type definition illustrating state machine transitions for verify and resolve states in realtime model prompting. | Exact payloads, commands, or snippets shown in A Python type definition illustrating state machine transitions for verify and resolve states in realtime model promp... |
examples/using-realtime-models-openai-api-openai-realtime-models-safety-escalatio.text | Guidelines for identifying safety risks and determining when to escalate user interactions in realtime models. | Exact payloads, commands, or snippets shown in Guidelines for identifying safety risks and determining when to escalate user interactions in realtime models. |
What This Skill Covers
- gpt-realtime-2 is our state-of-the-art reasoning voice model for low-latency speech-to-speech applications. It can think before it speaks, follow instruction...
- Main sections:
Choose a model,Realtime 2.0 Prompting Guide,What changed in Realtime 2,Recommended prompt structure,Set reasoning effort.
Workflow
- Open the most relevant file under
docs/for the exact documented workflow and wording. - Open
schemas/files for exact structured contracts. - Open
examples/files for concrete requests, commands, snippets, and manifests. - Do not add behavior or configuration that is not present in the attached source files.
Canonical source: https://developers.openai.com/api/docs/guides/realtime-models-prompting