Configuration

These references define the files and runtime settings used to create evaluation runs, publish evaluators, and operate workers safely.

References

Copyable profile examples for binary, numeric linear, numeric curve, numeric threshold, and ordinal scoring.

YAML or JSON configuration for agent target invocation, evaluator bindings, case groups, aggregation policy, and gate behavior.

YAML or JSON test case format used by evaluation runs, including inputs, expected outputs, tags, case groups, and metadata.

Evaluator package manifest for Wasm artifact paths, WIT contract metadata, package identity, and publish profiles.

Command-scoped database, messaging, creation, circuit-breaker, Wasmtime, and worker concurrency settings.