CLI command
probierz figure-evaluate
Render a reference and candidate figure deterministically, then obtain a rubric-scored vision verdict through the authenticated Stado model router.
Invocation#
probierz figure-evaluate --reference <REFERENCE> --candidate <CANDIDATE>Required inputs and options#
- `--reference` and `--candidate` are required supported SVG, TeX, PDF, or image files.
- The model comes from `--model` or `PROBIERZ_FIGURE_VISION_MODEL`; router URL/token may come from flags, stdin, or the documented environment.
- `--router-token-stdin` reads the bearer from stdin line 1 and optional agent secret from line 2.
Output and state effects#
Creates deterministic renders and a JSON report containing dimensions, evidence, blockers, fidelity losses, recommendations, and `verdict.pass`. A non-passing verdict sets exit code 1.
Exact refusals#
- Missing required paths: `figure-evaluate needs --reference` or `figure-evaluate needs --candidate`; unknown, repeated, or valueless options are refused.
- Inputs must exist with supported types; output must end in `.json` and no report/render output may already exist.
- The router URL, bearer, selected model, rubric, render tools, and returned model evaluation are all validated; invalid or incomplete values are refused.
Source snapshot#
Generated from the Rust binaries at https://github.com/wisent-ai/probierz.git revision `c589d6917201c31f57e6a7f24522c0d50ae5bd0f`.
Combined help SHA-256: `43f0d9cd136ac2c46ec3eedb2824bd5d6168f235dea4caaa50610c005f40c84a`; binary SHA-256: `7e42c843082863ed265817de90a110a2f27546426a54d372e10009fd665a4d8e`.