Scalable Inference Serving · Schema

RequestOutput

Specifies which output tensor to include in the response.

AICNCFDeploymentInferenceKubernetesLLMMachine LearningModel ServingMLOpsScalability

Properties

Name Type Description
name string Name of the output tensor to include.
parameters object
View JSON Schema on GitHub

JSON Schema

scalable-inference-serving-requestoutput-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/RequestOutput",
  "title": "RequestOutput",
  "type": "object",
  "description": "Specifies which output tensor to include in the response.",
  "required": [
    "name"
  ],
  "properties": {
    "name": {
      "type": "string",
      "description": "Name of the output tensor to include."
    },
    "parameters": {
      "type": "object",
      "additionalProperties": true
    }
  }
}