CLI command
probierz benchmark rivals
Confront the rivals Stado's product catalog names with the contenders and suites the manifest declares.
Invocation#
probierz benchmark rivals <APP_ID>Required inputs and options#
- The catalog product is the manifest's `productId`, else the app ID. The record is read from Stado's product catalog, which serves every record whole.
Output and state effects#
Prints every catalog rival with whether a contender measures it, every catalog suite with whether the manifest declares it, and the gaps. Exit 0 only when there is no gap.
Exact refusals#
- Each gap is named, with the command that closes it: `the catalog names no rival for <product>` (closed by the Stado registry command that adds a rival), `the catalog's benchmark for <product> names app <app>, not <app>`, `rival <id> has no contender in <manifest>; probierz benchmark author contender <app> --contender <id> --suite <id> drafts and verifies one`, `suite <id> is named by the catalog but not declared in <manifest>; probierz benchmark author suite <app> --suite <id> drafts one`, and `contender <id> is not a rival the catalog names for <product>`; the command then fails with `<n> gap(s) between the catalog and the manifest: …`.
- `the product catalog has no product <product>; the manifest's productId names it`, and a Stado that cannot be started or refuses is named with its own error.
Source snapshot#
Generated from the Rust binaries at https://github.com/wisent-ai/probierz.git revision `f65b755da397f2ec7435eb80ed722aa6017437c1`.
Combined help SHA-256: `4a12655d233812abc29eeebbf3db3065efe3e00288024383f3eef3970d092e94`; binary SHA-256: `d5398832d3ab52c541b1efe979730dea62941ac6197898a20fccfc5d3fca44df`.