openai · OpenAI Platform Docs
Computer use
A guide on implementing computer use capabilities by setting up isolated environments via Docker or browser automation frameworks and executing a loop of screenshot capture, action processing, and UI interaction.
Derived skill
Files assembled from official documentation
Viewing SKILL.md
Computer use
A guide on implementing computer use capabilities by setting up isolated environments via Docker or browser automation frameworks and executing a loop of screenshot capture, action processing, and UI interaction.
When To Use
Use when you need to implement an agentic workflow that allows a model to interact with software interfaces through screenshots and UI actions.
Reference Files
| File | Contains | Use For |
|---|---|---|
SKILL.md | Entry point: scope, routing table, and workflow. | Start here. |
docs/computer-use-workflow-guide.md | A guide explaining how to enable a model to operate software through a user interface using screenshots and interface actions. | Questions about a guide explaining how to enable a model to operate software through a user interface using screenshots and interface... |
examples/computer-use-openai-computer-use-docker-build-command.bash | A bash command used to build the Docker image for the computer use environment. | Exact payloads, commands, or snippets shown in A bash command used to build the Docker image for the computer use environment. |
examples/computer-use-openai-computer-use-docker-run-command.bash | A bash command to run a Docker container configured for computer use with VNC display port 5900. | Exact payloads, commands, or snippets shown in A bash command to run a Docker container configured for computer use with VNC display port 5900. |
examples/computer-use-openai-computer-use-definitions-guide.text | A text document defining user versus non-user content safety guidelines for the computer use capability. | Exact payloads, commands, or snippets shown in A text document defining user versus non-user content safety guidelines for the computer use capability. |
examples/computer-use-openai-computer-use-confirmation-hygiene-guidelines.text | Best practices and behavioral guidelines for managing user confirmations during computer use tasks. | Exact payloads, commands, or snippets shown in Best practices and behavioral guidelines for managing user confirmations during computer use tasks. |
examples/computer-use-openai-computer-use-sensitive-data-transmission-guidelines.text | A text document outlining the types of sensitive data and security considerations when using the computer use tool. | Exact payloads, commands, or snippets shown in A text document outlining the types of sensitive data and security considerations when using the computer use tool. |
examples/computer-use-openai-computer-use-prompt-injection-security-guidelines.text | A text document outlining security risks and mitigation strategies for prompt injections during computer use operations. | Exact payloads, commands, or snippets shown in A text document outlining security risks and mitigation strategies for prompt injections during computer use operations. |
What This Skill Covers
- Computer use lets a model operate software through the user interface. It can inspect screenshots, return interface actions for your code to execute, or work...
- Main sections:
Prepare a safe environment,Create a Docker image,Choose an integration path,Option 1: Run the built-in Computer use loop,1. Send the first request.
Workflow
- Open the most relevant file under
docs/for the exact documented workflow and wording. - Open
schemas/files for exact structured contracts. - Open
examples/files for concrete requests, commands, snippets, and manifests. - Do not add behavior or configuration that is not present in the attached source files.
Canonical source: https://developers.openai.com/api/docs/guides/tools-computer-use.md