Skip to main content

Configuration

These references define the files and runtime settings used to create evaluation runs, publish evaluators, and operate workers safely.

References​

Run Profile

YAML or JSON configuration for target agent invocation, evaluator bindings, case groups, aggregation policy, and gate behavior.

Open Run Profile

Dataset Format

YAML or JSON test case format used by evaluation runs, including inputs, expected outputs, tags, case groups, and metadata.

Open Dataset Format

Vigilo.toml

Evaluator package manifest for WASM artifact paths, WIT contract metadata, package identity, and publish profiles.

Open Vigilo.toml

Runtime Limits

Operational limits for Wasmtime evaluator memory, fuel, timeout, log volume, and worker-wide active evaluation concurrency.

Open Runtime Limits
  1. Run Profile
  2. Dataset Format
  3. Vigilo.toml
  4. Runtime Limits