cohere · Schema

TokenizeRequest

Properties

Name Type Description
text string The string to be tokenized. Must be between 1 and 65536 characters.
model string The name of the model whose tokenizer will be used to tokenize the input text.
View JSON Schema on GitHub

JSON Schema

cohere-tokenizerequest-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "#/components/schemas/TokenizeRequest",
  "title": "TokenizeRequest",
  "type": "object",
  "required": [
    "text",
    "model"
  ],
  "properties": {
    "text": {
      "type": "string",
      "description": "The string to be tokenized. Must be between 1 and 65536 characters.",
      "minLength": 1,
      "maxLength": 65536
    },
    "model": {
      "type": "string",
      "description": "The name of the model whose tokenizer will be used to tokenize the input text.",
      "example": "command-r-plus"
    }
  }
}