Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / EvalCaseResult

Interface: EvalCaseResult

Defined in: packages/evals/src/case.ts:80

The measured result of one EvalCase.

Properties

PropertyTypeDescriptionDefined in
costUsdnumberTarget run cost plus all judge run costs (CostReport.totalUsd sums).packages/evals/src/case.ts:89
error?WireError-packages/evals/src/case.ts:99
judgeCostUsdnumberThe judge-run share of costUsd.packages/evals/src/case.ts:91
latencyMsnumberrun:start to run:end of the target run, from event timestamps; no separate measurement channel exists.packages/evals/src/case.ts:96
namestringWorkflow name, disambiguated by the suite runner on duplicates.packages/evals/src/case.ts:82
passedbooleanstatus 'ok' AND every grader passed.packages/evals/src/case.ts:86
status"ok" | "error" | "cancelled" | "exhausted" | "suspended"The target run's settle status.packages/evals/src/case.ts:84
usageUsageThe target run's normalized usage.packages/evals/src/case.ts:98
verdictsGraderVerdict[]-packages/evals/src/case.ts:87