CLI command

probierz benchmark author rivals

Find the products an existing product competes with, check that each exists, and add them to the catalog, so its rivals are not listed by hand.

Invocation#

Shell
probierz benchmark author rivals --count <COUNT> --rounds <ROUNDS> <APP_ID>

Required inputs and options#

  • The product's record, the rivals the catalog already names and the ids of every catalog product come from Stado's product catalog (the manifest's productId, else the app ID). --count (the most new rivals to name) and --rounds (how many drafts are allowed) are required and must be at least 1.
  • Stado's inference alternative, as for benchmark author suite, and the network: every page a draft cites is fetched.

Output and state effects#

The model answers {rivals: [{id, name, url, evidence}]}: each rival's id as a Stado identity (its contender id), its home page and one public page (repository, documentation or API reference) showing it doing the product's job. A draft is sent back with its refusal unless it names 1 to --count rivals, each id a Stado identity naming no catalog product of ours and no rival already named, once, with a name, and both pages https:// addresses that answer a GET with success. The rivals that hold are added with stado product registry set <product> --add-rival beside the ones the catalog names, and the answer carries them, the catalog's rivals as read back, and each round's model and usage.

Exact refusals#

  • Usage (exit 2): rounds-zero of probierz.benchmark.author for --count or --rounds of 0, before anything is read.
  • Each round's draft is judged before anything is written, and a refused one goes back with its cause: rivals-not-json (not the rivals object), rivals-count (none, or more than --count), rival-invalid (an id that is no Stado identity, one of our products, a rival already named or named twice, an empty name, a page that is not https://) and rival-page-unanswered (a page that did not answer with success, quoting the transport or server). drafts-exhausted when no draft held after --rounds rounds (exit 1, refused), after printing every round.
  • A catalog without the product is refused as in benchmark rivals; the registry's own refusal of the write through probierz.stado.call; a model draft that fails through Stado's inference alternative exits 69 with Stado's or the provider's sentence.

Source snapshot#

Generated from the Rust binaries at revision 99a74945a3598a8d73b6c6cbe5aae4f283becea3 of Probierz's private source repository.

Combined help SHA-256: 77529678a61237f774b59e76df0d1907cb749ef5da56d2ed913b040793b7d30b; binary SHA-256: be9e0eaff0e6ea50403a0c6f6d467697a4eac676f9523b8dc13a596d2b5526c5.