For two years every frontier lab has been pushing in the same direction: reasoning. Longer chains of thought, bigger thinking budgets, models that will happily sit there for minutes before answering — and won't show you the chain of thought you paid for.
That's System 2 thinking, in Kahneman's terms. Slow, deliberate, effortful. But most decisions that actually sit inside software aren't System 2 problems. What kind of support ticket is this? Is this urgent? Did the agent's output break a rule? Those are gut calls. You shouldn't need 30 seconds for them, let alone two minutes.
A lab called TypeSafe AI just came out of stealth going the opposite way, with System One models and a model called Jev. You can't chat with it at all. It doesn't generate text. The founder, Diogo Almeida, was a lead author on the InstructGPT paper that made models good at talking to people, and his argument now is that chat is the wrong interface for software. Software doesn't want a paragraph. It wants a value it can use.
So you pass in a state — a ticket, a log, an agent trace — plus typed questions. Only three kinds: choice (pick one of these options), score (rate on my scale), and noul (yes/no, with a probability). What comes back is typed answers with real probabilities, in 70–500ms. Output tokens are free; input is four cents per million. Think of it as an if statement that understands language.
The honest caveats: there's no paper and no architecture diagram — just three hints (new architecture, parallel sampler, and RLCD, reinforcement learning for calibrated decisions). "Can't hallucinate" really means it can't break your schema. It can still be wrong.
Then the interesting part. Within 24 hours of that video, open replications started appearing — now 20 to 30 of them, and some are close. On JevBench, Jev scores 75.3 and SemIf — a frozen Qwen 3.5 4B with no training at all — sits right behind it. Everyone converged on the same trick: read the logits over the answer tokens and softmax, no sampling.
The gap is still real on hard, multi-hop work. The move there is a cascade — fast model first, escalate only when confidence drops.
No comments:
Post a Comment