Log10 · Schema

FeedbackTask

An evaluation template defining the schema, instructions, and tag selectors for grading Log10 completions.

LLMLoggingObservabilityEvaluationFeedbackDebuggingLLMOpsArtificial IntelligenceMachine Learning

Properties

Name	Type	Description
id	string	The unique identifier for this task.
created_at_ms	number	Unix epoch timestamp (milliseconds) when this task was created.
name	string	Human-readable name of the feedback task.
instruction	string	Instructions shown to human reviewers when submitting feedback for this task.
json_schema	object	JSON Schema defining the structure and validation rules for feedback values.
completion_tags_selector	object	Tag-matching expression that determines which completions surface for grading under this task.

View JSON Schema on GitHub

JSON Schema

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://log10.io/schemas/feedback-task.json",
  "title": "FeedbackTask",
  "description": "An evaluation template defining the schema, instructions, and tag selectors for grading Log10 completions.",
  "type": "object",
  "required": ["name", "instruction", "json_schema", "completion_tags_selector"],
  "properties": {
    "id": {
      "type": "string",
      "description": "The unique identifier for this task."
    },
    "created_at_ms": {
      "type": "number",
      "description": "Unix epoch timestamp (milliseconds) when this task was created."
    },
    "name": {
      "type": "string",
      "description": "Human-readable name of the feedback task."
    },
    "instruction": {
      "type": "string",
      "description": "Instructions shown to human reviewers when submitting feedback for this task."
    },
    "json_schema": {
      "type": "object",
      "description": "JSON Schema defining the structure and validation rules for feedback values."
    },
    "completion_tags_selector": {
      "type": "object",
      "description": "Tag-matching expression that determines which completions surface for grading under this task."
    }
  }
}