Skip to main content

The Decision Layer

Jev, cheap judgement, and the choices we turn into code

A path dividing between storm and light — judgement as a choice before code acts
  • The useful unit of AI inside software may be a bounded judgement rather than an autonomous agent.
  • A correctly typed answer, a calibrated probability, and permission to act are three different things.
  • Cheaper judgement could make more checks practical. It also makes the design of questions, exceptions, and consequences more important.
  • Vendor workflow evals and a small writing experiment earn serious evaluation of Jev — not a blanket transfer of trust from charts to operational decisions.
  • Adjacent projects (GLiClass, GLiNER, SetFit, structured outputs, NuExtract, routers, DSPy) address related pieces; evaluate by the work performed, not a single league table.
  • When an answer space becomes executable, its omissions become operational. The organisation still owns what happens next.
What does Jev change about the interface between AI and software?

It aims to return bounded judgements with probabilities (Noul, Choice, Score) from a supplied state, rather than writing replies, code, or explanations. Interpretation becomes a callable component; arithmetic, permissions, and explicit rules stay in ordinary software.[^1][^2][^7]

Has the author tested Jev?

No. This volume examines public documentation, published experiments, and related projects as of 16 September 2026. A follow-up is planned once waitlist access allows first-hand tests.

Do TypeSafe’s speed and cost figures prove Jev for production?

No. Advertised prices and workflow multipliers are company-published figures with stated caveats. Workflow evals use model-derived reference labels; an Every writing check shows a speed–accuracy trade-off on a small set. Serious evaluation is earned; blanket operational trust is not.[^8][^9][^10]

Does “Zero Hallucinations” mean zero factual mistakes?

No. TypeSafe’s narrower meaning is guaranteed schema matching. A schema-conforming answer can still select the wrong permitted option — the same distinction OpenAI notes for Structured Outputs.[^8][^1][^15]

Is a high confidence score the same as a probability of correctness?

Not for Choice and Score. TypeSafe’s confidence field summarises the shape of the returned distribution; it is not a separately observed probability that the answer is correct. Calibration must be measured on the actual work.[^22][^21]

Which existing approaches address similar problems?

Open-label classifiers (GLiClass, GLiNER), task-trained few-shot models (SetFit), structured generation (OpenAI Structured Outputs, Outlines, XGrammar), specialised extraction (NuExtract), routing (Arch-Router), and pipeline frameworks (DSPy). Some could replace a call; others prepare inputs or organise the workflow.[^11]–[^20]

Author’s note: I am on Jev’s waitlist and have not yet tested the model. This volume examines public documentation, published experiments, and related projects. I will write a follow-up volume once I have access and can report on my own tests. Product claims and prices below reflect the material available on 16 September 2026.

Imagine an invoice arriving with the right total, a familiar supplier, and an email that says: “Please hold this until we have sorted out the delivery.”

Adding the numbers is straightforward. Recognising that the accompanying message changes what should happen next is a different kind of work.

A program needs to know whether the message concerns this invoice, whether it describes an unresolved problem, and whether the evidence is sufficient to continue. None of those questions necessarily needs a paragraph in return. They need answers that can be inspected and combined with rules.

That is the opening TypeSafe is pursuing with Jev, introduced in early access on 15 September 2026. 1

The model is designed to accept natural-language information and return bounded judgements with probabilities. It does not write a reply, produce code, or generate an explanation of its reasoning. 2

I find that restriction interesting. Instead of asking a model to become the employee responsible for the invoice, we can ask it to perform a small, defined part of the work.

The question is what becomes possible when that part becomes sufficiently fast, inexpensive, and reliable—and what responsibility remains outside it.

A smaller interface to intelligence

Jev works on a supplied state: the information relevant to the questions being asked. TypeSafe’s documentation encourages structured context, with the relevant records and evidence supplied explicitly. That makes preparing the input part of the application’s work, rather than something to assume the model has already done. 3

The developer then defines the questions and their possible answers. Three primitives provide the interface:

PrimitivePurposeWhat software receives
NoulAssess a yes-or-no proposition.The probability that the answer is yes.
ChoiceSelect among developer-defined alternatives.A selected option, a probability distribution, and a confidence statistic.
ScoreAssess a position on an ordered rubric.A score, a distribution across the defined levels, and a confidence statistic.

These distinctions matter. Uncertainty about whether something is urgent is different from judging it moderately urgent. The former concerns a proposition; the latter concerns a scale whose levels somebody must define. 4

TypeSafe calls its training approach Reinforcement Learning for Calibrated Decisions, or RLCD. Its stated objective is to make the probabilities useful to software by aligning them with outcomes, rather than optimising for the appeal of a generated response. That is the company’s account of the training objective, not an independently established result of this review. 5

The other important feature is parallel evaluation. TypeSafe recommends asking several questions about the same state together, including questions that may later prove irrelevant. A program could request both a document category and an assessment specific to one category, then discard the latter when it does not apply. 6

This suggests a different way to build a workflow. Gather the judgements needed for the next decision; let the code determine which ones matter. Keep arithmetic, permissions, and explicit rules in ordinary software. The model contributes where interpretation is needed. This is also the division of labour TypeSafe recommends. 7

“System One” is TypeSafe’s name for this approach. I use it here as product terminology, not as proof that a new scientific category has been established. Architectural novelty and practical usefulness are separate questions. A better component can matter without requiring every idea behind it to be unprecedented.

What the early evidence earns

The advertised input price is US$0.042 per million tokens, equivalent to US$42 per billion. TypeSafe also advertises large workflow advantages: 193.6 times faster and 444.6 times cheaper. These are the company’s published figures, not universal properties of every task. 8

The launch material says output tokens are not charged. It also acknowledges that its largest gains are probably toward the high end of real-world results, and that its LLM comparison requests full probability outputs—a more expensive comparison than requesting only a selected answer. 1

The evaluation design deserves attention. TypeSafe publishes four workflows covering security incidents, agent traces, invoices, and customer service. Models run through a fixed workflow, and reference labels come from the averaged responses of two larger models operating at high reasoning effort. The correctness of the workflow itself is assumed. 9

This measures agreement with model-derived references. It does not establish independently adjudicated correctness. A disagreement could expose an error in the tested model, an error in the reference, or ambiguity in the question. Agreement can preserve a shared mistake.

There is nevertheless a useful result inside that limited setup: averaged across the four examples, every tested model did better on accuracy, cost, and time when operating inside the explicit workflow than when given the same policy as a standalone prompt. 9

That suggests part of the improvement belongs to the application’s structure. A comparison should separate the benefit of a better model from the benefit of asking models to do less of what code can already do.

An external experiment provides a more tangible trade-off. In Every’s published test of four writing checks across 12 synthetic passages, Jev took a median 0.35 seconds per passage, compared with 8.83 seconds for Fable 5.1 at high effort. Jev identified six of seven deliberately introduced defects; the comparison model identified all seven. Jev’s missed defect remained missed across three runs. 10

That is encouraging evidence for fast checking, with a visible limitation. It is not a large production trial, a calibration study, or a comparison against every inexpensive alternative.

My reading is that Jev has earned a serious evaluation. It has not yet earned a blanket transfer of trust from a performance chart to an operational decision.

This is not an empty field

A fair account of Jev must include the approaches already addressing parts of this problem. They are not interchangeable, and “similar” should not mean that a shared output format proves an equivalent model.

Open-label classification: GLiClass and GLiNER

GLiClass, developed by Knowledgator, is a particularly relevant comparison. It accepts text and candidate labels, supports zero-shot and few-shot classification, and is designed to score labels efficiently rather than generate an explanatory response. Its research also explores reinforcement learning for multi-label classification. 11

Fastino’s GLiNER2 combines entity recognition, text classification, and structured extraction through a schema-based interface built around a compact encoder. The current GLiNER2.5 offering extends this family with capabilities including constrained classification and joint entity–relation extraction. Fastino provides open models and describes CPU-capable deployment. 12 13

These projects are relevant because they challenge the assumption that flexible, language-defined tasks require a conversational model. Their existence does not establish that they match Jev’s judgement quality or calibration. It establishes that the comparison should include them where the task fits.

Task-trained classification: SetFit

SetFit takes another route: adapting sentence-transformer models using relatively small labelled datasets. It is designed for efficient, few-shot text classification rather than a new set of arbitrary questions on every request. 14

For a stable, repeated task, I would include this kind of specialist in the evaluation. The relevant trade-off is between maintaining a task-trained model and buying a more flexible judgement service. A general-purpose interface is valuable, but flexibility is not automatically the property a particular workflow needs most.

Structured generation: OpenAI, Outlines, and XGrammar

OpenAI’s Structured Outputs already uses constrained decoding to enforce supported schemas. Outlines provides structured-generation interfaces across model backends, while XGrammar focuses on efficient grammar-constrained generation. 15 16 17

These approaches address the shape of generated output. Jev’s proposition goes further: a decision-oriented training objective and an output mechanism intended to avoid generating answers token by token. 5 1 Whether that combination produces a better balance of accuracy, latency, and cost must be measured. A comparison against an unconstrained chatbot would not settle it.

Specialised extraction: NuExtract

NuExtract, from NuMind, is another adjacent approach. Its current platform presents NuExtract3 as a specialised vision-language model for producing structured JSON and Markdown from documents, with managed and private-deployment options. 18

Extracting fields from a document and judging whether evidence supports an action are different tasks. They can, however, sit next to one another in the same workflow. A document extractor could prepare information that a decision model subsequently evaluates.

Routing and composition: Arch-Router and DSPy

Katanemo’s Arch-Router is a compact model for assigning requests to routes according to user-defined domains and actions. It illustrates the value of a specialised routing component, although it remains a generative model rather than Jev’s described non-text decision interface. 19

DSPy operates at a different layer. It provides a way to express and optimise language-model pipelines as programs with declarative modules. It is a framework, not a competing decision model. 20

The distinction matters. Some of these projects could replace a particular Jev call. Others could prepare its inputs, constrain a generative alternative, or organise the surrounding workflow. I would evaluate them by the work they perform, rather than arrange unlike components into a single league table.

The interesting direction is broader than any one vendor: make interpretation a component that software can call, evaluate, and replace.

Correctly shaped is not necessarily correct

TypeSafe’s homepage uses the phrase “Zero Hallucinations.” Its launch explanation gives that claim a narrower meaning: the zero follows from guaranteed schema matching, rather than an empirical finding of zero factual mistakes. 8 1

Suppose the permitted answers are pay, hold, and reject. Preventing a model from inventing a fourth answer removes one kind of failure. It does not prevent the model from selecting pay when the evidence calls for hold.

The application may then execute the wrong decision without a parsing error, exception, or conspicuous sentence to attract attention.

OpenAI’s own Structured Outputs documentation makes the same underlying distinction: a schema-conforming response can still contain incorrect values. 15

Type safety is useful. It gives software a more dependable interface. But it cannot establish the truth of the proposition represented by that interface.

For the invoice example, I would distinguish whether the message reports a duplicate charge from whether the transaction records establish one. Recognising a claim, verifying it, and authorising a response require different evidence.

A narrow model interface helps expose those distinctions. It does not make them disappear.

A decimal point is not a guarantee

Calibration is the next question. In a well-calibrated predictor, events assigned a probability near 0.8 should occur about 80 per cent of the time across the relevant group of predictions. Research on neural-network calibration long predates Jev; Guo and colleagues examined both the problem and practical calibration methods in 2017. 21

There is also a specific detail in TypeSafe’s API that deserves care. For Choice and Score, the confidence field summarises the shape of the returned probability distribution. It is not a separately observed probability that the answer is correct. Noul returns its yes-probability without that additional field. 22

A confidence value of 0.9 should therefore not be casually translated into “90 per cent correct.” The field’s definition and the measured behaviour of the underlying probabilities both matter.

The operating question is how much work a system can accept at a tolerable observed error rate, while sending the rest elsewhere. This trade-off between coverage and error is the subject of selective classification: a predictor may decline cases instead of answering all of them. 23

For a proposed deployment, I would want that trade-off measured on the actual work. A high refusal rate can produce reassuring accuracy while leaving most of the workload untouched. A low refusal rate can make automation look productive while passing the costly mistakes onward.

Nor should calibration measured in one setting be assumed to survive changes in the inputs. Ovadia and colleagues’ study of uncertainty under dataset shift demonstrated limitations in several calibration approaches when the data changed. That was not a Jev study; it is a reason to test this property rather than infer it from a training objective. 24

There is a further distinction between separately requested judgements and independent evidence. Three checks can all rely on the same incomplete record. Their agreement does not create three independent confirmations. I would not multiply their confidence values and call the resulting number a guarantee of workflow correctness.

The choices come before the model

Before a model selects an answer, someone has decided what answers are available.

TypeSafe’s own guidance recommends an other or none of the above option when a Choice might not cover every input. 4

Consider a workflow that permits only approve and reject. It has no direct way to express “the evidence is incomplete,” “the documents conflict,” or “the policy does not cover this case.” Those are different situations. Collapsing them into rejection may inconvenience the wrong person; collapsing them into approval may authorise the wrong action.

Adding an uncertainty threshold does not repair an inadequate set of categories. It only changes when the system acts within them.

This is where the engineering becomes organisational. The definition of a label, the evidence required to apply it, and the route for an exception are decisions about how work should happen.

A question such as “Is this customer unreasonable?” hides a considerable amount of interpretation. “Does the customer request something excluded by this version of the policy?” is more inspectable, although the policy itself may still be unsuitable for the case.

The second question does not settle the customer’s claim. It identifies a specific relationship between a request and a supplied rule.

That is the level at which I would try to use bounded judgement: describe what the evidence supports, expose what is missing, and leave the consequence to an explicit process.

When an answer space becomes executable, its omissions become operational.

Cheap enough to ask more often

TypeSafe named Jev after William Stanley Jevons. The company’s stated expectation is that cheaper machine intelligence will expand demand and enable applications that were previously impractical. 1

That is a hypothesis about adoption, not an inevitable outcome. But it points to a useful question: what happens when the cost of a judgement falls below the point at which people bother to ration it?

One possibility is better checking. A writing system could assess a claim against its supplied source before moving to the next paragraph. A retrieval system could examine whether a passage answers the actual question before passing it onward. A workflow could look for missing evidence before asking a person to review an otherwise complete case.

These are proposed uses, not results I have obtained with Jev. Their attraction is that the comparison may be with an absent check, rather than an expert already examining every case.

The same economics could also encourage unnecessary judgement. A team might begin scoring every interaction because the API call costs almost nothing, without establishing what the score means or why it should affect anyone.

Low cost does not distinguish those applications.

At an assumed error rate of 0.1 per cent, one million judgements would contain 1,000 wrong answers. That is an illustration, not a Jev measurement. It could represent a substantial improvement over an existing process, or an unacceptable new exposure. The consequences and the comparison determine which.

The relevant cost includes preparing evidence, integrating the model, reviewing exceptions, monitoring changes, and correcting mistakes. Token prices are one part of that account.

The opportunity is to spend less on interpretation while improving the work. Merely increasing the number of automated decisions would not establish that improvement.

Audit the decision, not an invented explanation

Jev’s documentation says the model does not generate explanations of its reasoning. 2

I would not repair that absence by asking a second model to produce a plausible story about why the first one answered as it did. A readable account of the application’s decision should come from records the application actually possesses.

For the invoice workflow, those records would include the relevant source material, the exact question and allowed answers, the model identifier, its returned probabilities, the rule applied, and the action taken. A reviewer should be able to see that the application held the invoice because a particular condition crossed a documented threshold—not because an assistant later composed a convincing explanation.

This would not reveal the model’s internal causal process. It would make the surrounding decision inspectable.

I would also keep permission checks outside the semantic judgement. A model could recognise an apparent request to change an account without establishing that the sender is authorised to do so. The application should not turn confidence about intent into permission to execute it.

Even the evidence pipeline deserves separate scrutiny. A correctly implemented decision rule can still operate on the wrong attachment, an outdated policy, or a message detached from its context. Testing the model alone would miss those failures.

Data handling remains another independent question. TypeSafe’s published privacy policy says it will not train or fine-tune models on customer input. It also states that the services are hosted in the United States, and its retention language is purpose-based rather than a fixed zero-retention commitment. 25

Those provisions should be assessed on their own terms. A constrained output does not determine where the input travels or how long it remains there. For sensitive work, I would establish the applicable contractual and deployment arrangements before sending operational records.

A component can have a clean interface while still creating a dependency that needs managing.

What I would test after the waitlist

The first experiment I would run is close to this Library: compare claims with the passages cited in their support.

The task would be deliberately narrower than deciding whether a statement is true. Given a claim and a source passage, does the passage support it, support only a narrower version, contradict it, or leave it unestablished? Ambiguous cases should remain visible rather than be forced into reassuring agreement.

A claim can faithfully reflect an unreliable source. This test would assess the relationship between the two, not certify the world beyond them.

I would build a human-reviewed reference set, preserve genuine disagreements, and separate examples used to tune the questions and thresholds from a separate test set left untouched during tuning. English and German passages, missing qualifications, outdated evidence, and conflicting extracts would make the evaluation more relevant to the work I actually do.

The comparison should include an inexpensive structured-output LLM, a specialist classifier where appropriate, and a stronger reasoning model. Each should receive equivalent evidence and decision definitions. Comparing Jev with an unnecessarily verbose or expensive alternative would exaggerate what had been learned.

The most consequential error would be an unsupported claim incorrectly cleared as supported. I would measure that alongside missed valid support, the share of cases requiring review, and the quality of the probability estimates. Latency should include slow responses as well as the median, and cost should include retries and escalation—not only successful calls.

I would also test failure handling: remove the decisive sentence, introduce contradictory evidence, and put an instruction inside the source text that tries to influence the judgement. These are proposed tests, not allegations of demonstrated Jev vulnerabilities. A bounded output space does not, by itself, answer whether hostile input can push a model towards the wrong permitted choice.

Finally, I would test the whole workflow. Does the additional check reduce the editorial work and the number of unsupported claims that survive? Does it merely create another queue? Are the remaining mistakes easier to find and repair?

Those results would provide the substance for the follow-up volume. A successful demonstration would be a starting point, not its conclusion.

The model and the consequence

What interests me about Jev is the possibility of making judgement a smaller, more explicit part of software.

The question no longer has to be whether an agent can take over the process. It can be whether a particular interpretation is good enough, on known evidence, to support a particular next step.

That is a useful change in scale. It gives us somewhere concrete to test, compare, and intervene.

But the decision layer extends beyond the model. It includes the information supplied, the categories offered, the threshold chosen, and what happens when the case does not fit. Those choices remain even when the answer arrives almost immediately and costs very little.

The invoice at the beginning still needs an owner. Someone must decide what counts as evidence of an unresolved delivery, when the payment should remain on hold, and how the supplier can correct a misunderstanding.

Jev may make one part of that work much cheaper. The point of testing it is to discover how much—and under which conditions.

The model supplies a probability. The organisation still owns what happens next.

Sources

Sources were accessed on 16 September 2026. Vendor documentation establishes what a product claims or specifies; it is not independent verification of performance. The proposed experiments in this draft have not been run.

Footnotes

  1. TypeSafe, “Introducing System One Models & Jev” (15 September 2026). Product announcement, pricing qualifications, evaluation caveats, schema-matching claim, and naming. 2 3 4 5

  2. TypeSafe documentation, “System One.” Decision-oriented interface and its limits. 2

  3. TypeSafe documentation, “State.” Preparing the information supplied to a model.

  4. TypeSafe documentation, “Primitives (Questions).” Noul, Choice, Score, and answer-space design. 2

  5. TypeSafe documentation, “AI primer.” The company’s description of Reinforcement Learning for Calibrated Decisions. 2

  6. TypeSafe documentation, “Speculative fan-out.” Parallel questions and conditional use of results.

  7. TypeSafe documentation, “How to build with TypeSafe.” Narrow judgements inside explicit software workflows.

  8. TypeSafe homepage. Advertised input price and headline performance claims, accessed 16 September 2026. 2

  9. TypeSafe, “Workflow evals.” Four-workflow methodology, model-derived reference labels, and workflow-versus-prompt comparison. 2

  10. Mike Taylor, Every, “Mini-Vibe Check: TypeSafe’s Jev Judged Everything I’ve Written in 0.7 Seconds” (15 September 2026). Original hands-on reporting, including the 12-passage writing experiment.

  11. Stepanov et al., “GLiClass: Generalist Lightweight Model for Sequence Classification Tasks” (2025).

  12. Zaratiana et al., “GLiNER2: An Efficient Multi-Task Information Extraction System with Schema-Driven Interface” (2025).

  13. Fastino, “GLiNER2.5: Open-Source Information Extraction Model.” Current product capabilities and deployment information.

  14. Hugging Face, SetFit documentation. Efficient few-shot adaptation of sentence-transformer models.

  15. OpenAI, “Introducing Structured Outputs in the API” (6 August 2024). Constrained decoding and the distinction between schema compliance and correct values. 2

  16. Outlines documentation. Structured-generation interfaces and supported output specifications.

  17. Dong et al., “XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models” (2024; revised 2025).

  18. NuMind, NuExtract platform. NuExtract3, document extraction, and deployment options.

  19. Katanemo, Arch-Router-1.5B model card. Domain/action routing and generative-model interface.

  20. Khattab et al., “DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines” (2023).

  21. Guo et al., “On Calibration of Modern Neural Networks,” ICML / PMLR (2017).

  22. TypeSafe documentation, “Confidence.” The distribution-derived confidence statistic and its distinction from probabilities.

  23. Geifman and El-Yaniv, “Selective Classification for Deep Neural Networks” (2017). Coverage–risk trade-offs and rejection.

  24. Ovadia et al., “Can You Trust Your Model’s Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift,” NeurIPS (2019).

  25. TypeSafe privacy policy, last updated 19 November 2025, accessed 16 September 2026. Customer-input training commitment, retention, and US hosting.