CLI command

probierz ask

Answer a question about a product with evidence: the one read-only check that answers it, run, and the answer read from what it printed.

Invocation#

Shell
probierz ask "<QUESTION>" [--link <STORE_LINK>] [--app <APP_ID>]

Required inputs and options#

  • <QUESTION> as a person asks it ("Does the support of this app answer its users?"); --link the App Store or Google Play link it is about; --app the product it is about. PROBIERZ_ASK_MODEL names the model, any when unset.

Output and state effects#

Asks the inference alternative Stado hands out which check answers the question, from those that only read: store-show, store-support, store-reviews (with the link), store-release, status-page (the last 7 days), legal-pages, dependencies, report, run-history (history <APP> --limit 20: the product's newest recorded runs and when each journey last worked) and command-line (evaluate cli) (with the product). Probierz runs that check as its own command, keeps what it printed and its exit status, and asks the model to answer from that output alone, then prints {question, check, command, exitStatus, evidence, refusal, answer, verdict} (yes, no or unknown). A check that refuses is evidence too. Both model calls are kept in the cost ledger.

Exact refusals#

  • model-unanswered (exit 69): no inference alternative answers, or one answers without the tool call it was asked for, naming why; no check runs.
  • no-check (exit 1): none of the checks answers the question, so it is not answered from what a model knows.
  • check-incomplete (exit 2): the chosen check needs a store link or a product the question did not give, naming which. Real test: tests/ask/question.rs (a real model through the host's Stado, and the real App Store).

Declared refusals#

What probierz refusals list declares for this command at revision d2cd6156e8b8dc6204dab7b46ec0b34b2bb03cea (probierz 0.1.7 (revision unknown, not built from a git checkout)): each cause's id, the operation declaring it, its exit status and code, and its remedy.

  • state-blank (probierz.config, exit 1, config): finding Probierz's state directory: PROBIERZ_STATE_DIR is set but blank, so it names no directory. set PROBIERZ_STATE_DIR to an absolute directory, or unset it so .probierz in the home directory is used.
  • state-relative (probierz.config, exit 1, config): finding Probierz's state directory: PROBIERZ_STATE_DIR names {path}, which is not an absolute path, so it would mean a different directory in every working directory. set PROBIERZ_STATE_DIR to an absolute directory.
  • unreadable (probierz.config, exit 1, config): reading this instance's configuration at {file}: the file cannot be read: {error}. make {file} a file this user can read, or remove it to set no key.
  • malformed (probierz.config, exit 1, config): reading this instance's configuration at {file}: the file is not a JSON object of keys: {error}. write {file} again with probierz config set, or remove it to set no key.
  • stored-unknown (probierz.config, exit 1, config): reading this instance's configuration at {file}: it holds {key}, which no part of this Probierz reads (a key a release before or after this one declared). remove it with probierz config unset {key}.
  • stored-invalid (probierz.config, exit 1, config): reading {key} from this instance's configuration at {file}: it holds {value}, which is not a {kind}. set it again with probierz config set {key} <value>, or remove it with probierz config unset {key}.
  • unwritable (probierz.config, exit 1, config): writing this instance's configuration at {file}: {step} failed: {error}. make {directory} a directory this user can write, or point PROBIERZ_STATE_DIR at one.
  • key-unknown (probierz.config, exit 2, refused): naming a configuration key: {key} is no key any part of Probierz reads. name one of the listed keys; probierz config list prints what each decides.
  • value-invalid (probierz.config, exit 2, refused): setting {key}: {value} is not a {kind}: {why}. give {key} a {kind}.
  • stado-missing (probierz.alternatives, exit 1, config): asking Stado which alternative answers: {command}: Stado could not be started: {error}. install Stado (the stado release installer at stado://releases/stado/<version>/<platform>/install.sh) so its alternatives can be asked.
  • none-answers (probierz.alternatives, exit 69, infra_down): finding an alternative of {family} for Probierz: no alternative answered {command}: {cause}. make one of the alternatives Stado names answer (stado capabilities list {family}), or select another order with stado capabilities select {family}.
  • answer-malformed (probierz.alternatives, exit 1, config): reading Stado's answer to {command}: {error}. update Stado to the release whose answer Probierz reads (stado product update stado).
  • program-failed (probierz.alternatives, exit 1, refused): {command}: {cause}. fix what the provider names, or ask Stado for the next alternative with stado capabilities resolve --failed <provider>.
  • placement-unset (probierz.alternatives, exit 1, config): opening a browser: this instance has not decided where a browser may run (browser.placement). run probierz config set browser.placement stado (only on a host Stado places the run on) or local.
  • placement-refused (probierz.alternatives, exit 1, refused): opening a browser: browser.placement is stado and this process is not a job Stado placed. run it through Stado: probierz remote run web --app <app> --host <host>, or the same verb under probierz remote.
  • model-answer-not-json (probierz.model, exit 69, infra_down): reading what the inference alternative answered for {what}: the answer is not the JSON a chat completion is. stado capabilities list inference names the alternative that answers; ask again, and remove that alternative from Stado's order when it keeps answering so.
  • provider-refused (probierz.model, exit 69, infra_down): asking a model for {what}: the inference alternative that answered refused the request: {said}. act on what the alternative said; stado capabilities list inference names it and the others Stado can hand the request to.
  • tool-call-malformed (probierz.model, exit 69, infra_down): reading the {tool} call the model was asked to answer with: the answer does not carry the one {tool} call the request asked for: {why}. ask again; a model that keeps answering without the call is one Stado's order should not reach first (stado capabilities list inference).
  • model-unanswered (probierz.ask, exit 69, infra_down): asking a model which check answers "{question}": {cause}. make an inference alternative answer (stado capabilities list inference), then ask again.
  • no-check (probierz.ask, exit 1, refused): choosing the check that answers "{question}": none of Probierz's checks answers it, so it is not answered from what a model knows. ask about what a check reads: a store link's app, support, reviews or release, a product's status page, legal pages, dependencies or report.
  • check-incomplete (probierz.ask, exit 2, refused): running {check} for "{question}": {check} needs a {needs}, and the question gave none. give it with --link <store link> or --app <product>.

Source snapshot#

Generated from the Rust binaries at revision 99a74945a3598a8d73b6c6cbe5aae4f283becea3 of Probierz's private source repository.

Combined help SHA-256: 77529678a61237f774b59e76df0d1907cb749ef5da56d2ed913b040793b7d30b; binary SHA-256: be9e0eaff0e6ea50403a0c6f6d467697a4eac676f9523b8dc13a596d2b5526c5.