google · Google AI Docs
Gemini API Gemini Robotics-ER 1.6
An overview of the Gemini Robotics-ER 1.6 capabilities and its role within the Gemini API ecosystem for robotics applications.
Derived skill
Files assembled from official documentation
Viewing SKILL.md
Gemini API Gemini Robotics-ER 1.6
An overview of the Gemini Robotics-ER 1.6 capabilities and its role within the Gemini API ecosystem for robotics applications.
When To Use
Use when determining how to integrate Gemini's multimodal capabilities into robotics control loops or embodied AI workflows.
Reference Files
| File | Contains | Use For |
|---|---|---|
SKILL.md | Entry point: scope, routing table, and workflow. | Start here. |
docs/gemini-api-robotics-er-1-6-workflow-guide.md | An overview of the Gemini Robotics-ER 1.6 vision-language model, including safety information and getting started instructions for finding objects in a scene. | Questions about an overview of the Gemini Robotics-ER 1.6 vision-language model, including safety information and getting started ins... |
examples/gemini-api-robotics-er-1-6-python-prompt-template.text | A Python code snippet demonstrating a prompt template for object detection and point labeling using the Gemini API for robotics. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating a prompt template for object detection and point labeling using the Gemini API fo... |
examples/gemini-api-robotics-er-1-6-gemini-robotics-er-1-6-generatecontent-curl-i.text | A curl command demonstrating how to send a base64 encoded image to the Gemini Robotics-ER 1.6 model using the generateContent endpoint. | Exact payloads, commands, or snippets shown in A curl command demonstrating how to send a base64 encoded image to the Gemini Robotics-ER 1.6 model using the generat... |
examples/gemini-api-robotics-er-1-6-object-detection-labels.text | A list of detected object labels and their corresponding coordinates from a Gemini Robotics-ER 1.6 vision task. | Exact payloads, commands, or snippets shown in A list of detected object labels and their corresponding coordinates from a Gemini Robotics-ER 1.6 vision task. |
examples/gemini-api-robotics-er-1-6-python-object-detection.text | A Python code example demonstrating how to use the Gemini API to identify and locate specific objects within an image for robotics applications. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to use the Gemini API to identify and locate specific objects within an image... |
examples/gemini-api-robotics-er-1-6-object-detection-labels-2.text | A text list of object labels and their corresponding coordinate points for the Gemini Robotics-ER 1.6 model. | Exact payloads, commands, or snippets shown in A text list of object labels and their corresponding coordinate points for the Gemini Robotics-ER 1.6 model. |
examples/gemini-api-robotics-er-1-6-json-point-detection-prompt.text | A text-based prompt template for requesting object detection points and labels in a normalized JSON format for robotics tasks. | Exact payloads, commands, or snippets shown in A text-based prompt template for requesting object detection points and labels in a normalized JSON format for roboti... |
examples/gemini-api-robotics-er-1-6-object-detection-prompt.text | A text-based prompt example defining object queries and JSON output formatting for the Gemini Robotics-ER 1.6 model. | Exact payloads, commands, or snippets shown in A text-based prompt example defining object queries and JSON output formatting for the Gemini Robotics-ER 1.6 model. |
examples/gemini-api-robotics-er-1-6-python-object-detection-prompt.text | A Python code example demonstrating how to use the Gemini API to prompt for bounding box coordinates of objects within an image. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to use the Gemini API to prompt for bounding box coordinates of objects withi... |
examples/gemini-api-robotics-er-1-6-python-trajectory-prompt.text | A Python code snippet demonstrating how to use the Gemini API to generate trajectory points for robotic movement based on an image and a text prompt. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating how to use the Gemini API to generate trajectory points for robotic movement base... |
examples/gemini-api-robotics-er-1-6-coordinate-point-list.text | A list of numbered coordinate points representing spatial data for the Gemini Robotics-ER 1.6 model. | Exact payloads, commands, or snippets shown in A list of numbered coordinate points representing spatial data for the Gemini Robotics-ER 1.6 model. |
examples/gemini-api-robotics-er-1-6-python-image-json-detection.text | A Python code snippet demonstrating how to use the Gemini API to detect compostable objects in an image and return their coordinates in JSON format. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating how to use the Gemini API to detect compostable objects in an image and return th... |
examples/gemini-api-robotics-er-1-6-object-detection-labels-3.text | A list of detected object labels and their corresponding bounding box coordinates for the Gemini Robotics-ER 1.6 model. | Exact payloads, commands, or snippets shown in A list of detected object labels and their corresponding bounding box coordinates for the Gemini Robotics-ER 1.6 model. |
examples/gemini-api-robotics-er-1-6-python-image-clock-json-extraction.text | A Python code example demonstrating how to use the Gemini API to extract clock time from an image and return the result in a structured JSON format. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to use the Gemini API to extract clock time from an image and return the resu... |
examples/gemini-api-robotics-er-1-6-time-response.text | A text representation of a time response object containing hours and minutes for the Gemini Robotics-ER 1.6 API. | Exact payloads, commands, or snippets shown in A text representation of a time response object containing hours and minutes for the Gemini Robotics-ER 1.6 API. |
examples/gemini-api-robotics-er-1-6-python-vision-meter-reading.text | A Python code example demonstrating how to use the Gemini API to perform visual liquid meter level analysis from an image. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to use the Gemini API to perform visual liquid meter level analysis from an i... |
examples/gemini-api-robotics-er-1-6-gemini-robotics-er-1-6-python-generatecontent.text | A Python code example demonstrating how to use the Gemini Robotics-ER 1.6 model to process an image and a text prompt using the Google GenAI SDK. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to use the Gemini Robotics-ER 1.6 model to process an image and a text prompt... |
examples/gemini-api-robotics-er-1-6-python-image-annotation.text | A Python code snippet demonstrating how to use the Gemini API to process an image and return annotated instructions for robotic bin sorting. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating how to use the Gemini API to process an image and return annotated instructions f... |
examples/gemini-api-robotics-er-1-6-annotated-image-disposal-locations.text | An annotated text description mapping specific table items to their suggested disposal bins including compost, recycling, and trash. | Exact payloads, commands, or snippets shown in An annotated text description mapping specific table items to their suggested disposal bins including compost, recycl... |
examples/gemini-api-robotics-er-1-6-python-image-prompt.text | A Python code snippet demonstrating how to use the Gemini API to identify objects in an image using a JSON-formatted prompt for robotics tasks. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating how to use the Gemini API to identify objects in an image using a JSON-formatted... |
examples/gemini-api-robotics-er-1-6-object-removal-prompt.text | A text-based prompt example describing an object to be removed to make room for a laptop within the Gemini Robotics-ER 1.6 context. | Exact payloads, commands, or snippets shown in A text-based prompt example describing an object to be removed to make room for a laptop within the Gemini Robotics-E... |
examples/gemini-api-robotics-er-1-6-python-image-prompting.text | A Python code snippet demonstrating how to use the Gemini API to generate spatial point annotations for objects in an image for robotics tasks. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating how to use the Gemini API to generate spatial point annotations for objects in an... |
examples/gemini-api-robotics-er-1-6-lunch-box-packing-plan.text | A text-based example demonstrating a Gemini API robotics-ER 1.6 response that generates a step-by-step plan for packing a lunch box based on visual input. | Exact payloads, commands, or snippets shown in A text-based example demonstrating a Gemini API robotics-ER 1.6 response that generates a step-by-step plan for packi... |
examples/gemini-api-robotics-er-1-6-prompt-template.text | A text-based prompt template for the Gemini Robotics-ER 1.6 model specifying object localization and JSON output formatting. | Exact payloads, commands, or snippets shown in A text-based prompt template for the Gemini Robotics-ER 1.6 model specifying object localization and JSON output form... |
examples/gemini-api-robotics-er-1-6-object-detection-coordinates.text | A text representation of detected object labels and their corresponding spatial coordinates within the Gemini Robotics-ER 1.6 framework. | Exact payloads, commands, or snippets shown in A text representation of detected object labels and their corresponding spatial coordinates within the Gemini Robotic... |
examples/gemini-api-robotics-er-1-6-python-move-gripper.text | A Python code snippet demonstrating basic robot movement and gripper state control functions for the Gemini Robotics-ER 1.6 interface. | Exact payloads, commands, or snippets shown in A Python code snippet demonstrating basic robot movement and gripper state control functions for the Gemini Robotics-... |
examples/gemini-api-robotics-er-1-6-prompt.text | A text-based prompt example defining a six-degree-of-freedom robotic arm with specific movement functions for the Gemini Robotics-ER 1.6 model. | Exact payloads, commands, or snippets shown in A text-based prompt example defining a six-degree-of-freedom robotic arm with specific movement functions for the Gem... |
examples/gemini-api-robotics-er-1-6-reasoning-chain.text | A text example demonstrating the reasoning chain used by the Gemini API to plan a robotic pick and place operation. | Exact payloads, commands, or snippets shown in A text example demonstrating the reasoning chain used by the Gemini API to plan a robotic pick and place operation. |
What This Skill Covers
- Preview: The Gemini Robotics-ER 1.6 model is currently in preview.
- Main sections:
Safety,Getting started: Finding objects in a scene,Python,JSON,How it works.
Workflow
- Open the most relevant file under
docs/for the exact documented workflow and wording. - Open
schemas/files for exact structured contracts. - Open
examples/files for concrete requests, commands, snippets, and manifests. - Do not add behavior or configuration that is not present in the attached source files.
Canonical source: https://ai.google.dev/gemini-api/docs/robotics-overview