Skip to content
MrJev

jev-harness

TypeScript library that wraps Jev answers in policies, confidence gates, shadow mode, and reusable recipes.

View on GitHub →

Hands-on review

A small TypeScript library for the glue nobody enjoys writing: a policy, a confidence gate, shadow mode, reusable recipes and an offline eval CLI.

Good for

  • Not hand-writing a confidence gate and a shadow mode for the fifth time
  • Trying a policy against recorded cases before it touches traffic
  • A vocabulary for the layer between an answer and an action

Watch out for

  • Three stars, eleven commits; the API will move
  • No test suite in the repository — examples and an eval CLI instead
  • The library is the policy layer; the data question is still yours

Tested Sep 20, 2026 at 2934d12e1815 · Node 24 in Docker; read at the pinned commit — the repository ships examples and an eval CLI rather than a test suite

How we reviewed this: we read the repository at the pinned commit and installed it in Docker. It ships examples and an offline eval CLI rather than a test suite, so there is no pass/fail tally to report.

What it does

jev-harness, by Antonio Coppe, is the layer between a probability and an action. Jev gives you a choice, a score or a yes/no with a confidence; this adds the parts every team writes afterwards:

  • a policy that maps answers to actions;
  • a confidence gate, so low-confidence answers escalate rather than act;
  • shadow mode, to run a policy alongside production without doing anything;
  • recipes for the shapes that recur;
  • an offline eval CLI to run a policy against recorded cases.

That list is the right list. Shadow mode in particular is the feature most teams skip and then wish they had.

What to know

It’s early — three stars, eleven commits — and the repository has examples rather than tests, so treat the API as unsettled and read the source before depending on it.

And it doesn’t change what you send: that’s still your application’s decision.

Verdict

A good inventory of the missing pieces, and worth reading even if you write your own. If you’re about to build a confidence gate by hand, read this first.

For the same layer inside a specific tool, see the policy gate in Jev-cu and the bands in Abide.

See how it compares with other tools in Best Jev tools, tested hands-on.

Review updated Sep 20, 2026. Numbers quoted from the project are its author's own; we don't publish our own measurements of Jev.

More in Libraries & Integrations

agentrun

★ 423▲ 13

Parcha-ai/agentrun

A workflow DSL for agents with a Jev package for the steps that are decisions rather than generation.

TypeScript

switch

★ 420▲ 170

osolmaz/switch

TypeScript framework for decision-model harnesses: your program offers a short list of next steps and the model picks one at a time until it can answer, with chess, wikirace and rubric-judge examples run on Jev.

TypeScript

Ten Levels of Jev

★ 264▲ 10

disler/ten-levels-of-jev

Thirty worked uses arranged in ten levels, from one if statement to an agent that reaches for Jev itself, with a video walkthrough.

TypeScriptReviewed

Get new Jev projects every week

New Jev releases, pricing changes, and the best new projects, once a week. No spam; unsubscribe anytime.

Powered by Buttondown. See our privacy policy.