Hugging Face · Schema

CompletionRequest

Properties

Name Type Description
model string
prompt string
max_tokens integer
temperature number
top_p number
stop array
stream boolean
seed integer
suffix string Suffix to append after generated text
View JSON Schema on GitHub

JSON Schema

hugging-face-text-generation-inference-completion-request-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "title": "CompletionRequest",
  "type": "object",
  "properties": {
    "model": {
      "type": "string"
    },
    "prompt": {
      "type": "string"
    },
    "max_tokens": {
      "type": "integer"
    },
    "temperature": {
      "type": "number"
    },
    "top_p": {
      "type": "number"
    },
    "stop": {
      "type": "array"
    },
    "stream": {
      "type": "boolean"
    },
    "seed": {
      "type": "integer"
    },
    "suffix": {
      "type": "string",
      "description": "Suffix to append after generated text"
    }
  }
}