Hugging Face · Schema

CompletionRequest

Properties

Name Type Description
model string Model ID to use
prompt string Prompt(s) to generate completions for
max_tokens integer
temperature number
top_p number
stop array
stream boolean
seed integer
View JSON Schema on GitHub

JSON Schema

hugging-face-inference-providers-completion-request-schema.json Raw ↑ 
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "title": "CompletionRequest",
  "type": "object",
  "properties": {
    "model": {
      "type": "string",
      "description": "Model ID to use"
    },
    "prompt": {
      "type": "string",
      "description": "Prompt(s) to generate completions for"
    },
    "max_tokens": {
      "type": "integer"
    },
    "temperature": {
      "type": "number"
    },
    "top_p": {
      "type": "number"
    },
    "stop": {
      "type": "array"
    },
    "stream": {
      "type": "boolean"
    },
    "seed": {
      "type": "integer"
    }
  }
}