Pular para o conteúdo
← Back to Skalablog

Published article

Jev vs LLM Cost: The 7-Cent Breakeven Math

Software EngineeringClaudeAnthropicClaude Code

On a 10-million-record workload, the speaker in this analysis puts Jev's bill at $420 and GPT-5.6 Soul's at $44,000, a saving of roughly $43,500. Against that saving sit 630,000 extra disagreements, which is where the 7-cent Jev vs LLM cost breakeven comes from.

What Is Jev and How Does It Differ From an LLM?

Jev is a discriminative language model released by TypeSafe AI on September 15, 2026, and it cannot generate free text. You supply a situation, a question, and the answers it is allowed to give; it returns a probability for each allowed answer and nothing else. A generative LLM such as Claude, Anthropic AI assistant, or an OpenAI GPT model, produces open-ended text instead.

The vendor's own evaluation wraps every model, including Jev, in the same harness of narrow yes-or-no questions with ordinary code doing the final deciding. The eval page reports that each model scores better inside this harness than when the same rules arrive as one long prompt: higher accuracy on their metric, lower cost, and less time per case.

Because Jev is constrained to a fixed answer list, the vendor describes it as zero-hallucination in the schema sense. The launch post states plainly that this figure is not empirical: schema matching is guaranteed, meaning an answer can only come back from the list it was given, but inside that list the model can still be wrong. Both halves are true at once, and the invoice case below shows Jev being wrong in exactly that way.

How Does the Vendor's Evaluation Work?

The evaluation, published on TypeSafe AI's own site and fetched by the source video on September 16, 2026, covers four workflows the vendor's team built: security incidents, agent traces, invoices, and customer service. Nine models run on each workflow under the same harness. The page defines its accuracy metric explicitly: agreement with the average answer of two frontier models at high thinking settings, GPT-6 Astra and Claude Fable 5.1.

That reference is an answer key, not ground truth. The eval page itself includes examples on every workflow where all compared models miss the reference, so the column measures agreement with two purchasable frontier models on questions the vendor's own team wrote.

Read down the resulting table and Jev is the cheapest model on all four workflows and the fastest on all four, but the most accurate on none. Its mean agreement with the reference is 67.8 percent, while the top of the column, GPT-5.6 Soul, reaches 74 percent. All figures below are vendor-reported measurements from that page, not independent reproductions.

The Invoice Case: Where One Probability Decided the Outcome

The clearest illustration of how the models diverge is an invoice packet labeled ap_00074 on the vendor's eval page: a bill for a vulnerability scan with a courier fee, packaged with the purchase order, contract, vendor file, earlier invoices, emails, and approvals an accounts team would hold.

The harness asks narrow questions rather than one broad fraud judgment. Three settle the fraud branch: does the correspondence claim new payment details, is the unknown sender plausible, and is there a pressure pattern (a short deadline plus a threat). Jev answered 0.92 that the sender's story is unconfirmable, 0.18 that a pressure pattern exists, and 0.43 on the bank-details question.

That 0.43 is the whole disagreement. The vendor's rule sends a case to fraud review only when the bank question comes back yes, and in their code a yes starts at 0.5. Jev's 0.43 is a no, so the fraud branch never fired; the doubtful-sender rule triggered a phone call instead, and a fourth question about the unexplained courier fee sent the invoice back to the vendor for correction.

The two frontier models read the same email differently. The message says payment details remain unchanged, then names an account that differs from the one printed on the invoice and the vendor file. Claude model put the bank question at 0.85 and GPT-5.6 Soul higher still, so both cleared the 0.5 threshold and called fraud review. By the vendor's answer key, Jev's single probability fell on the wrong side of a half.

What Does 445x Cheaper Actually Compare?

The homepage headline says 444.6 times cheaper. The speaker does not dispute the arithmetic: it is the vendor's own computation across their workflows against the frontier reference. What the headline never states is cheaper than which model, and the multiple collapses as you move down the accuracy column.

On a per-case basis from the vendor's table, Jev costs about 440 times less than Claude Opus row, which is roughly five accuracy points ahead of Jev. Against GPT-5.6 Soul the multiple is 209, with Soul six points more accurate. Against GPT-5.6 Luna, the cheapest LLM on the table, the multiple is only 8, and Luna sits about a point behind Jev on the mean.

The pattern is consistent: the bigger the headline multiple, the more the reference agrees with the expensive model. A price cut bought by dropping to Jev must be netted against the disagreements it brings with it, which is the calculation the next section runs.

The 7-Cent Breakeven, Step by Step

Everything in this section is the video author's arithmetic on the vendor's published numbers, run against a hypothetical load of 10 million records at 1,000 input tokens each, priced at each provider's public list prices that week. The load is invented; the author says so in the video.

The steps are simple enough to rerun with your own figures:

  1. Take the accuracy gap between Jev and the LLM you would otherwise use. Against Soul the mean gap is 6.3 percentage points.

2. Convert the gap into disagreements: 0.1 point on 10 million records is 10,000 cases, so 6.3 points is about 630,000 extra disagreements.

3. Compute the bill difference. Jev's list-price bill on the load is $420 against Soul's $44,000, a saving of roughly $43,500. (The per-case multiples are larger because the vendor's harness asks dozens of questions per case; plain list-price tokens sit closer together.)

4. Divide the saving by the extra disagreements: $43,500 divided by 630,000 gives a breakeven of about 7 cents per disagreement.

If finding and fixing one wrong answer costs you more than 7 cents, Soul pays for itself on this load. If a disagreement costs you nothing, because nobody acts on the output and nobody would ever audit it, the saving is the whole story.

How the Breakeven Moves Across Workflows and Models

The 7-cent line is an average over four workflows, and it swings widely. The table below collects the speaker's calculations from the vendor's per-workflow gaps and per-case costs. Treat every row as arithmetic on vendor-reported data, not an independent measurement.

ComparisonMean accuracy gapBreakeven per disagreement
Jev vs GPT-5.6 Soul (all workflows, mean)6.3 pointsabout 7 cents
Jev vs Claude row (mean)about 5 pointsnear 10 cents
Jev vs Soul on invoices (worst workflow)17 pointsabout 2.5 cents
Jev vs Soul on customer serviceabout 2 pointsabout 19 cents
Jev vs GPT-5.6 Luna (mean)Jev leads by about 1 pointno line: Jev wins cost and mean accuracy

Two qualifications matter. First, the Luna row's one-point lead is a mean; on invoices Luna runs six points ahead of Jev, so the workflow mix changes the verdict. Second, Jev is 8 times cheaper and 32 times faster than Luna per case on the vendor's table, so on the vendor's mean, the model Jev replaces outright is the cheap LLM, not the frontier one.

Volume changes the picture too. At 10,000 records a month the speaker puts Jev's bill at 42 cents and Luna's at $2.24 on the same load. At the 10-million scale, Google's Gemini 2.5 Flash, a smaller model still on Google's price list, comes in around $360 once most of the prompt is billed at the cached rate, which is below Jev's bill. Below some volume, none of this is real money.

Caveats Before You Trust the $420 Bill

Two sentences from the vendor belong next to any purchasing decision. On pricing, the launch post says the company cannot prove the price is not subsidized, so the $420 figure is today's number and not a promise. Pricing behavior can change after a launch.

On accuracy, the homepage advertises zero hallucinations, and the launch post qualifies it: the claim is not empirical, and what is guaranteed is schema matching. The model cannot return an answer outside the list it was given, but within the list it can still be wrong, as the 0.43 on the invoice case shows by the vendor's own answer key.

Finally, all performance figures here are vendor-reported, measured on workflows the vendor's team wrote, against a reference defined as two frontier models rather than ground truth. No independent reproduction of these numbers existed as of the video's September 16, 2026 fetch date. If your workload resembles none of the four tested workflows, the table tells you about the models, not about your costs.

FAQ

  • When does Jev save money over an LLM? On the vendor's own evaluation, Jev replaces the LLM wherever a wrong answer costs you less than about 7 cents to find and fix, which is the breakeven against GPT-5.6 Soul on the mean of four workflows. Against Claude Opus row the line sits a little higher, near 10 cents.
  • Cheaper than which model is the 444.6x claim? The homepage does not say, but the vendor's table gives per-case multiples of about 440 against the Opus row, 209 against GPT-5.6 Soul, and only 8 against GPT-5.6 Luna, the cheapest LLM tested. The huge multiple always pairs with the models that agree most with the reference.
  • Can Jev hallucinate? It cannot return an answer outside the fixed list it is given, which the vendor calls guaranteed schema matching, and the launch post says the zero-hallucination figure is not empirical. Within the list it can still assign a probability to the wrong answer.
  • What was the invoice disagreement about? An email said payment details were unchanged while naming a different account than the invoice and vendor file. Jev scored the bank-details question at 0.43, below the 0.5 yes threshold in the harness code, so fraud review never fired; the frontier models scored it at 0.85 or higher and called fraud review.
  • Are these numbers independent? No. The accuracy, cost, and time figures come from TypeSafe AI's evaluation of workflows its own team built, against a reference answer key of two frontier models. The 10-million-record bills and breakevens are the video author's arithmetic on those published numbers, not measured results.

Source video