Skip to main content

Evaluators Flows

Command flows for publishing, validating, and operating evaluator artifacts.

These flows cover the CLI paths that manage evaluator versions before they are selected by a run. They focus on artifact validation, registry reads and writes, state changes, and local test execution.

Each command page includes:

  • an execution flow that shows the runtime boundary calls
  • a decision flow that shows validation, branching, and response outcomes

Commands​

  • Publish records a validated evaluator artifact and its metadata.
  • Search reads evaluator registry entries for discovery and filtering.
  • Show loads one evaluator record for inspection.
  • Test validates an evaluator against local input without publishing it.
  • Set state updates an evaluator version state used by run selection.