CLI command

probierz benchmark schedule

Have Stado run the benchmark loop on a cron, pinned to one host, so nothing waits for anyone to type it.

Invocation#

Shell
probierz benchmark schedule --cron <CRON> --host <HOST> --harness-dir <HARNESS_DIR>

Required inputs and options#

  • `--cron` is a five-field expression in UTC; `--host` the Stado host the cycle runs on; `--harness-dir` the Probierz harness on that host. `--secret-env NAME=ITEM#FIELD`, repeatable, names a Skarbiec field the cycle reads, such as `STADO_MODEL_ROUTER_TOKEN` and `PROBIERZ_MODEL_AGENT_SECRET`; `--env NAME=VALUE`, repeatable, sets a setting that is not secret, such as `STADO_MODEL_ROUTER_URL` (the Brama address Stado's service directory gives Probierz's consumer on that host) and `PROBIERZ_MODEL_AGENT_ID`; `--policy` names a policy file on that host.

Output and state effects#

Creates a Stado schedule whose command sets the harness and every `--env` setting and runs `probierz benchmark cycle` (with `--policy` when given), every value shell-quoted, pinned to the host and to the provider the registry names as that host's kind, so its agent claims the job. Its creation identity is a digest of those inputs: running it again with the same inputs changes nothing. Answers the persisted schedule, the command, and the schedule id that Stado's schedule show, run and edit take.

Exact refusals#

  • An empty `--harness-dir`, and an `--env` that is not `NAME=VALUE` with an upper-case environment name, are refused before Stado is asked.
  • A schedule that already runs the cycle under other inputs is refused by its id: one loop runs at a time, and Stado's schedule rm removes the old one first.
  • Stado's own refusal, quoted first, including a host the registry does not hold.

Source snapshot#

Generated from the Rust binaries at https://github.com/wisent-ai/probierz.git revision `f65b755da397f2ec7435eb80ed722aa6017437c1`.

Combined help SHA-256: `4a12655d233812abc29eeebbf3db3065efe3e00288024383f3eef3970d092e94`; binary SHA-256: `d5398832d3ab52c541b1efe979730dea62941ac6197898a20fccfc5d3fca44df`.