CLI command
probierz oracle
Every run judged beyond its assertions, and model oracles calibrated on known cases.
Invocation#
probierz oracle <judge|calibrate|list>Required inputs and options#
- The leaf must be one of
judge,calibrate,list.
Output and state effects#
The group dispatches to the selected leaf.
Exact refusals#
- Missing or unknown leaves return the group usage and exit 2.
Declared refusals#
What probierz refusals list declares for this command at revision d2cd6156e8b8dc6204dab7b46ec0b34b2bb03cea (probierz 0.1.7 (revision unknown, not built from a git checkout)): each cause's id, the operation declaring it, its exit status and code, and its remedy.
json-unreadable(probierz.records.json, exit 1, config): reading {file}: the file cannot be read: {error}. make {file} readable to this user.json-malformed(probierz.records.json, exit 1, config): reading {file}: the file does not hold JSON: {error}. write {file} again as the command that made it does, or remove it.json-missing(probierz.records.json, exit 1, not_found): reading {file}: no file is there, and the command needs it. name a file that is there.run-unknown(probierz.records.run, exit 1, not_found): reading run {run} of {app}: no run of that id is recorded for {app}. name a runprobierz history {app}lists.run-record-incomplete(probierz.records.run, exit 1, config): reading when the run recorded at {file} expires: the run record {problem}. a run Probierz records states its kind and when it started and completed as RFC 3339 times: restore the record from its bundle withprobierz restore, or name its kind after the run id where the command takes one (probierz protect <appId> <runId> <kind>).state-blank(probierz.config, exit 1, config): finding Probierz's state directory: PROBIERZ_STATE_DIR is set but blank, so it names no directory. set PROBIERZ_STATE_DIR to an absolute directory, or unset it so .probierz in the home directory is used.state-relative(probierz.config, exit 1, config): finding Probierz's state directory: PROBIERZ_STATE_DIR names {path}, which is not an absolute path, so it would mean a different directory in every working directory. set PROBIERZ_STATE_DIR to an absolute directory.unreadable(probierz.config, exit 1, config): reading this instance's configuration at {file}: the file cannot be read: {error}. make {file} a file this user can read, or remove it to set no key.malformed(probierz.config, exit 1, config): reading this instance's configuration at {file}: the file is not a JSON object of keys: {error}. write {file} again withprobierz config set, or remove it to set no key.stored-unknown(probierz.config, exit 1, config): reading this instance's configuration at {file}: it holds {key}, which no part of this Probierz reads (a key a release before or after this one declared). remove it withprobierz config unset {key}.stored-invalid(probierz.config, exit 1, config): reading {key} from this instance's configuration at {file}: it holds {value}, which is not a {kind}. set it again withprobierz config set {key} <value>, or remove it withprobierz config unset {key}.unwritable(probierz.config, exit 1, config): writing this instance's configuration at {file}: {step} failed: {error}. make {directory} a directory this user can write, or point PROBIERZ_STATE_DIR at one.key-unknown(probierz.config, exit 2, refused): naming a configuration key: {key} is no key any part of Probierz reads. name one of the listed keys;probierz config listprints what each decides.value-invalid(probierz.config, exit 2, refused): setting {key}: {value} is not a {kind}: {why}. give {key} a {kind}.stado-missing(probierz.alternatives, exit 1, config): asking Stado which alternative answers: {command}: Stado could not be started: {error}. install Stado (the stado release installer atstado://releases/stado/<version>/<platform>/install.sh) so its alternatives can be asked.none-answers(probierz.alternatives, exit 69, infra_down): finding an alternative of {family} for Probierz: no alternative answered{command}: {cause}. make one of the alternatives Stado names answer (stado capabilities list {family}), or select another order withstado capabilities select {family}.answer-malformed(probierz.alternatives, exit 1, config): reading Stado's answer to {command}: {error}. update Stado to the release whose answer Probierz reads (stado product update stado).program-failed(probierz.alternatives, exit 1, refused): {command}: {cause}. fix what the provider names, or ask Stado for the next alternative withstado capabilities resolve --failed <provider>.placement-unset(probierz.alternatives, exit 1, config): opening a browser: this instance has not decided where a browser may run (browser.placement). runprobierz config set browser.placement stado(only on a host Stado places the run on) orlocal.placement-refused(probierz.alternatives, exit 1, refused): opening a browser: browser.placement is stado and this process is not a job Stado placed. run it through Stado:probierz remote run web --app <app> --host <host>, or the same verb underprobierz remote.cases-invalid(probierz.oracle, exit 1, config): reading the known cases in {file}: {problem}. give every case its input and the verdict a person gave it: { screen, promise, verdict: pass|fail } for screen, { rubric, question, answer, verdict: pass|fail } for rubric.evidence-unreadable(probierz.oracle, exit 1, config): reading what a run kept: {path} cannot be read: {error}. make the run's evidence readable to this user, then judge it again.rubric-invalid(probierz.oracle, exit 1, config): reading the rubric a journey of {app} is graded on: rubric {rubric} of {app} {problem}. keep the rubric as JSON under .probierz/{app}/ at the path the journey names, with its criteria and a numeric threshold from 0 to 1 an answer has to reach.
Source snapshot#
Generated from the Rust binaries at revision 99a74945a3598a8d73b6c6cbe5aae4f283becea3 of Probierz's private source repository.
Combined help SHA-256: 77529678a61237f774b59e76df0d1907cb749ef5da56d2ed913b040793b7d30b; binary SHA-256: be9e0eaff0e6ea50403a0c6f6d467697a4eac676f9523b8dc13a596d2b5526c5.