AI Habitat · Schema

AgentObservation

Full observation dict returned to an agent after each step

Artificial IntelligenceSimulationEmbodied AIRoboticsComputer VisionReinforcement LearningMachine LearningOpen SourceResearch

Properties

Name Type Description
rgb object RGB camera observation
depth object Depth camera observation
pointgoal_with_gps_compass object Point goal with GPS/compass sensor
objectgoal string Object category name for ObjectNav tasks
View JSON Schema on GitHub

JSON Schema

ai-habitat-agent-observation-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://raw.githubusercontent.com/api-evangelist/ai-habitat/refs/heads/main/json-schema/ai-habitat-agent-observation-schema.json",
  "title": "AgentObservation",
  "description": "Full observation dict returned to an agent after each step",
  "type": "object",
  "properties": {
    "rgb": {
      "type": "object",
      "description": "RGB camera observation"
    },
    "depth": {
      "type": "object",
      "description": "Depth camera observation"
    },
    "pointgoal_with_gps_compass": {
      "type": "object",
      "description": "Point goal with GPS/compass sensor"
    },
    "objectgoal": {
      "type": "string",
      "description": "Object category name for ObjectNav tasks",
      "example": "chair"
    }
  }
}