Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / runEvalCase

Function: runEvalCase()

ts
function runEvalCase(
   engine, 
   evalCase, 
options?): Promise<EvalCaseResult>;

Defined in: packages/evals/src/case.ts:131

Runs one EvalCase on the given engine: the target workflow as its own run, pure graders host-side over the outcome, judge graders through the engine via GraderContext.judge. Grader thrown errors are not absorbed: a grader that cannot grade is a defect of the suite, not a failed case.

Parameters

ParameterType
engineEngine
evalCaseEvalCase
optionsRunEvalCaseOptions

Returns

Promise&lt;EvalCaseResult&gt;