WisentProbierz
Probierz/Docs

CLI command

probierz benchmark adopt

The operator's decision on one scouted brief: Stado creates the product's private repository and preview catalog record, the catalog names its rivals and benchmark, and Probierz drafts its first suite.

Invocation#

Shell
probierz benchmark adopt --cases <CASES> --rounds <ROUNDS> <BRIEF>

Required inputs and options#

  • `<brief>` is a file `benchmark scout` wrote. `--allow-create` is the operator's authority to create the brief's private repositories; without it nothing runs. `--cases` and `--rounds` are required and are passed to the suite draft.
  • Stado with Wisent Integrations reachable for repository creation, and the model router settings `benchmark author suite` needs.

Output and state effects#

Writes the brief's creation request beside it as `<brief>.creation.json` and hands it to `stado product create` with the operator's authority, which creates the private repository, its canonical checkout on `main` and a `preview` catalog record carrying the brief's evidence. Then `stado product registry set <id>` adds every rival and the benchmark in one write, and Probierz writes `apps/<id>/probierz.yaml` over the new checkout when there is none. Unless the brief's suite is already declared, it is drafted as `benchmark author suite` drafts one. The answer carries the creation state, the catalog record's status, rivals and benchmark as read back, the manifest, the suite and the next commands: `probierz benchmark author contender <id> --contender <id> --ours --suite <suite>, then one per rival, then probierz benchmark run <id> --suite <suite>`. Every step is idempotent, so an adoption that stopped is finished by running it again.

Exact refusals#

  • `<file> is not a scouted brief (ai.wisent.probierz.benchmark.opportunity.v1)`, or a file that cannot be read or is not JSON.
  • `adopting <brief> creates the private repositories <list> through Stado and a preview catalog record for <id>; --allow-create is the operator's authority for that` before anything is written.
  • Stado's own refusal of the creation request or of the registry write, quoted; a creation Stado leaves unprovisioned is refused naming the `stado product create` command that resumes it (exit 75, unavailable), after printing Stado's answer.
  • Everything `benchmark author suite` refuses.

Source snapshot#

Generated from the Rust binaries at https://github.com/wisent-ai/probierz.git revision `f65b755da397f2ec7435eb80ed722aa6017437c1`.

Combined help SHA-256: `4a12655d233812abc29eeebbf3db3065efe3e00288024383f3eef3970d092e94`; binary SHA-256: `d5398832d3ab52c541b1efe979730dea62941ac6197898a20fccfc5d3fca44df`.