CLI command
probierz benchmark select
Order the Stado capability family a suite measures by the composite of the market its newest run measures.
Invocation#
probierz benchmark select --suite <SUITE> <APP_ID>Required inputs and options#
benchmark.families.<suite>names the family. The newest run of--suitemust measure exactly one market, scored.
Output and state effects#
Writes the market's ranking, best composite first, as the family's order with stado capabilities select <family> --order <ids>, each contender id standing for the alternative of that name as stado capabilities list <family> --json lists them; a ranked contender that is no alternative of the family is skipped and named. Answers {appId, suite, runId, product, market, family, order, skipped, ranking}.
Exact refusals#
- Everything
benchmark standingrefuses. probierz.benchmark.select:family-undeclared(no family named for the suite),market-not-one(the run measures no market, or several, naming them),market-unscored(every axis weighs 0),alternatives-unlisted(Stado lists no order of alternatives for the family) andnone-alternative(no ranked contender is an alternative of it). Stado's own refusal of the listing or the selection is refused byprobierz.stado.call.
Source snapshot#
Generated from the Rust binaries at revision 99a74945a3598a8d73b6c6cbe5aae4f283becea3 of Probierz's private source repository.
Combined help SHA-256: 77529678a61237f774b59e76df0d1907cb749ef5da56d2ed913b040793b7d30b; binary SHA-256: be9e0eaff0e6ea50403a0c6f6d467697a4eac676f9523b8dc13a596d2b5526c5.