Skip to manual
gluon

CLI reference

gluon eval

Run the package's `answers` test cases, score them and write an immutable evaluation run.

Model author or developer

Usage

Run it as gluon eval (in the repository, cargo run -p gluon-cli -- eval).

Console / text
Run `answers` cases against a pinned provider, score them (E704) and write an immutable run

Usage: gluon eval [OPTIONS] <PATH>

Arguments:
  <PATH>

Options:
      --provider <PROVIDER>  Pinned provider; 'fixed' is the CI provider [default: fixed]
      --runs <RUNS>          Directory for the immutable evaluation run [default: runs]
  -h, --help                 Print help

What it reads and writes

It answers each answers case with the provider you name in --provider and scores the result. Only fixed, the offline provider CI uses, runs today: any other name stops with an error. The run goes to run-<digest>.json in the --runs folder (default runs/). The same inputs and results give the same file, and an existing run is never overwritten. A failing case exits 1.

The options for gluon eval.
The options for gluon eval.