Prime Intellect Evaluation

An evaluation run against a Prime Intellect Environments Hub environment, either client-driven or hosted.

AIArtificial IntelligenceReinforcement LearningGPU ComputeDecentralized ComputeFoundation ModelsInferenceSandboxesTrainingEnvironmentsEvaluationsLoRAOpen SourceAgents

Properties

Name	Type	Description
id	string
name	string
model	string
environment	string
kind	string
status	string
samples_count	integer
score	number
created_at	string
team_id	string

View JSON Schema on GitHub

JSON Schema

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://raw.githubusercontent.com/api-evangelist/prime-intellect/main/json-schema/prime-intellect-evaluation-schema.json",
  "title": "Prime Intellect Evaluation",
  "description": "An evaluation run against a Prime Intellect Environments Hub environment, either client-driven or hosted.",
  "type": "object",
  "required": ["id", "status"],
  "properties": {
    "id": {"type": "string"},
    "name": {"type": "string"},
    "model": {"type": "string"},
    "environment": {"type": "string"},
    "kind": {"type": "string", "enum": ["client", "hosted"]},
    "status": {"type": "string", "enum": ["pending", "running", "finalized", "failed", "cancelled"]},
    "samples_count": {"type": "integer"},
    "score": {"type": "number"},
    "created_at": {"type": "string", "format": "date-time"},
    "team_id": {"type": "string"}
  }
}