Scalable Inference Serving · Schema

TensorDatatype

Data type of a tensor. Follows the Open Inference Protocol datatype naming convention.

AICNCFDeploymentInferenceKubernetesLLMMachine LearningModel ServingMLOpsScalability
View JSON Schema on GitHub

JSON Schema

scalable-inference-serving-tensordatatype-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/TensorDatatype",
  "title": "TensorDatatype",
  "type": "string",
  "description": "Data type of a tensor. Follows the Open Inference Protocol datatype naming convention.",
  "enum": [
    "BOOL",
    "UINT8",
    "UINT16",
    "UINT32",
    "UINT64",
    "INT8",
    "INT16",
    "INT32",
    "INT64",
    "FP16",
    "FP32",
    "FP64",
    "BYTES",
    "STRING"
  ]
}