CLI command

probierz benchmark select

Order the Stado capability family a suite measures by the composite of the market its newest run measures.

Invocation#

Shell
probierz benchmark select --suite <SUITE> <APP_ID>

Required inputs and options#

  • benchmark.families.<suite> names the family. The newest run of --suite must measure exactly one market, scored.

Output and state effects#

Writes the market's ranking, best composite first, as the family's order with stado capabilities select <family> --order <ids>, each contender id standing for the alternative of that name as stado capabilities list <family> --json lists them; a ranked contender that is no alternative of the family is skipped and named. Answers {appId, suite, runId, product, market, family, order, skipped, ranking}.

Exact refusals#

  • Everything benchmark standing refuses.
  • probierz.benchmark.select: family-undeclared (no family named for the suite), market-not-one (the run measures no market, or several, naming them), market-unscored (every axis weighs 0), alternatives-unlisted (Stado lists no order of alternatives for the family) and none-alternative (no ranked contender is an alternative of it). Stado's own refusal of the listing or the selection is refused by probierz.stado.call.

Source snapshot#

Generated from the Rust binaries at revision 99a74945a3598a8d73b6c6cbe5aae4f283becea3 of Probierz's private source repository.

Combined help SHA-256: 77529678a61237f774b59e76df0d1907cb749ef5da56d2ed913b040793b7d30b; binary SHA-256: be9e0eaff0e6ea50403a0c6f6d467697a4eac676f9523b8dc13a596d2b5526c5.