Parea AI · Schema

TestCaseSchema

Schema for TestCaseSchema

LLMEvaluationObservabilityTestingPrompt ManagementAI EngineeringMachine LearningTracingExperimentationHuman Feedback

Properties

Name Type Description
inputs object Dictionary mapping input names to values. Input names correspond to the column names of the test case collection.
target string Optional target/ground truth value for the test case/inputs
tags array List of tags associated with the test case
View JSON Schema on GitHub

JSON Schema

TestCaseSchema.json Raw ↑
{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "$id": "https://raw.githubusercontent.com/api-evangelist/parea/main/json-schema/TestCaseSchema.json",
  "title": "TestCaseSchema",
  "description": "Schema for TestCaseSchema",
  "properties": {
    "inputs": {
      "additionalProperties": {
        "type": "string"
      },
      "type": "object",
      "title": "Inputs",
      "description": "Dictionary mapping input names to values. Input names correspond to the column names of the test case collection."
    },
    "target": {
      "title": "Target",
      "description": "Optional target/ground truth value for the test case/inputs",
      "type": "string",
      "nullable": true
    },
    "tags": {
      "items": {
        "type": "string"
      },
      "type": "array",
      "title": "Tags",
      "description": "List of tags associated with the test case",
      "default": []
    }
  },
  "type": "object",
  "required": [
    "inputs"
  ],
  "examples": [
    {
      "inputs": {
        "framework": "fastapi",
        "language": "python"
      },
      "tags": [
        "easy"
      ],
      "target": "a good program here"
    }
  ]
}