Add agent output, events file and skills for coding agents

[Lawouach]

Summary

Makes Chaos Toolkit an engine coding agents can rely on to run bespoke experiments, and ships skills that teach them how.

Agent output (--output agent)

• chaos run --output agent writes a single JSON report (chaostoolkit/agent/run/v1) once the run is over:
  • a deterministic outcome derived from the journal: passed, deviated, baseline-not-met, probe-error, aborted, interrupted or error;
  • whether it is conclusive, a short verdict and stable warnings codes (dry run, no hypothesis, failed method activity, rollbacks not played or failed);
  • interrupted_by naming a safeguard, a bundled control or a signal when the journal tells;
  • a summary of steady states, method and rollbacks, and the journal path.
• chaos validate --output agent writes a single report with the first error and its stage.
• The process exit code is unchanged: it still reflects whether the process went through normally.
• In agent mode, stdout carries the report only; whatever activities or controls print goes to stderr. When the uv runtime cannot be prepared, an error report is still written.
• chaos run --events-file PATH streams progress as NDJSON, to follow long runs.

Runtime

• SIGINT and SIGTERM received by chaos are now relayed once to the uv runtime child, which runs in its own session. Interrupted runs play rollbacks and still report. Previously SIGTERM left the child running unsupervised.

chaos skills list|show|install

Installs skills for Claude, Codex or OpenCode, in the workspace or the home directory, mirroring fault skill install:

• chaostoolkit-experiment: when an experiment is warranted, steady states from real data (error budget burn rate and projection onto the SLO window), load when it matters (defaulting to oha), one perturbation, tempo derived from the system, safeguards, bespoke Python activities, runtime.python.dependencies, scratch-area storage, a pre-run checklist, long-run handling and how to read the report.
• chaostoolkit-network-faults: network faults through fault's engine (faultlib), set and cleared by the method, with a routing check so a misrouted run is never reported as a pass.
• When fault 1.0+ is on PATH, fault's own skill is installed alongside.

Related

• Requires chaostoolkit-lib 1.45.1 (Do not turn an interruption into a failed Python activity chaostoolkit-lib#274): interruptions are no longer turned into failed Python activities. The agent report also detects the old behaviour, reporting interrupted rather than a pass.
• The skills ask for chaostoolkit-addons 0.12 (Record the safeguard that interrupted the execution chaostoolkit-addons#12): the safeguards control records which safeguard fired, surfaced as interrupted_by.

Testing

• 136 tests, including agent reports for every outcome, runtime child failures, signal relaying and skills installation.
• End to end with real processes: fault proxies through faultlib with oha load and a burn-rate probe (deviated, then a misrouted run reported inconclusive), safeguards interruption, and a failure matrix (unresolvable runtime, busy proxy port, SIGINT/SIGTERM with and without a uv runtime).