Baseten · Schema

CompletionTokensDetails

Breakdown of tokens used in the completion.

AIMLInferenceDeploymentMLOpsOpenAI CompatibleAnthropic CompatibleTruss

Properties

Name Type Description
accepted_prediction_tokens integer Number of tokens in accepted predictions (for speculative decoding).
audio_tokens integer Number of audio tokens generated.
reasoning_tokens integer Number of tokens used for reasoning (for models that support extended thinking).
rejected_prediction_tokens integer Number of tokens in rejected predictions (for speculative decoding).
View JSON Schema on GitHub

JSON Schema

baseten-completiontokensdetails-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/CompletionTokensDetails",
  "title": "CompletionTokensDetails",
  "additionalProperties": false,
  "properties": {
    "accepted_prediction_tokens": {
      "default": 0,
      "title": "Accepted Prediction Tokens",
      "type": "integer",
      "description": "Number of tokens in accepted predictions (for speculative decoding)."
    },
    "audio_tokens": {
      "default": 0,
      "title": "Audio Tokens",
      "type": "integer",
      "description": "Number of audio tokens generated."
    },
    "reasoning_tokens": {
      "default": 0,
      "title": "Reasoning Tokens",
      "type": "integer",
      "description": "Number of tokens used for reasoning (for models that support extended thinking)."
    },
    "rejected_prediction_tokens": {
      "default": 0,
      "title": "Rejected Prediction Tokens",
      "type": "integer",
      "description": "Number of tokens in rejected predictions (for speculative decoding)."
    }
  },
  "type": "object",
  "description": "Breakdown of tokens used in the completion."
}