Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / JudgeGraderOptions

Interface: JudgeGraderOptions

Defined in: packages/evals/src/graders/judge.ts:26

Properties

PropertyTypeDescriptionDefined in
instructionstringWhat to judge: the criteria prose embedded into the judge prompt.packages/evals/src/graders/judge.ts:30
modelModelSpecJudge model; required, never defaulted (role quality floors).packages/evals/src/graders/judge.ts:28
name?string-packages/evals/src/graders/judge.ts:31
schema?JsonSchemaCustom verdict schema; requires toVerdict. The default schema is JUDGE_VERDICT_SCHEMA with its boolean passed.packages/evals/src/graders/judge.ts:36
toVerdict?(output) => { passed: boolean; score?: number; }Maps the judge's structured output onto a pass/score pair.packages/evals/src/graders/judge.ts:38