113 Decision Models in 3 Weeks (Mostly Qwen and Gemma Fine-Tunes): A Deep Dive
>**Personal Note: I really dug into the ins and outs of Jev, Laya and the other decision models that have shown up in the last three weeks. I used Claude to do the research and prepare this article. Then I spent a few hours of my own time putting it all together, so it's not a boilerplate AI piece. I hope you enjoy it!**
>**TL;DR**
* A decision model takes some evidence plus closed questions and returns typed answers with probabilities. It writes no prose. A decision costs a tiny fraction of a cent and comes back in tens to hundreds of milliseconds. * One request can carry many questions. They run in parallel and independently, so nothing chains inside a call. * "113 entries" overstates the variety. 70 of the 112 open entries are built on Qwen, 18 on Gemma 4, and 20 are stock models with a decoding trick and no new weights. * On the independent Decision Index, Perplexity Decider v1.1 ranks first on its own, and Fastino GLiDE, Jev and Torchcast tie for second. Calibration, price and where you can run it separate the leaders more than accuracy does. * Measured fairly, the 27B models answer in 0.10 to 0.14 s on one local GPU, and hosted APIs timed by independent testers mostly land between 0.1 and 0.6 s. * Laya is one of the weakest open options. Every hardware tier, down to a laptop, has open models scoring 6x to 14x higher. * My proposed inbox setup: one script polls, filters, asks for four facts per email and applies rules, and the LLM runs only for mail that needs writing. Estimated $353 a month down to $28. It isn't running yet; real numbers in a few days.
# 1. What a decision model is
Think of it as a semantic `if` statement you can afford to call thousands of times. You send the evidence (an email, a ticket, a log, a screenshot) and closed questions with every allowed answer spelled out. You get back one typed answer per question, in three shapes every vendor has converged on:
|Shape|Jev name|OpenAI name|Returns| |:-|:-|:-|:-| |Yes/no|Noul|predicate|probability 0 to 1| |Pick one|Choice|choice|the pick, a probability per option, a confidence| |Rate|Score|score|a probability-weighted position on your ordered scale|
Most of these models generate no text. They read the evidence once and score your allowed options directly, which is why they're fast and why they can't answer outside your menu. OpenAI's Decisions API is the exception: it points GPT-6 Luna, a reasoning model, at the same question format.
TypeSafe launched the category with Jev on Sep 15. Within three weeks Cloudflare, Perplexity, Liquid, Fastino and OpenAI had their own, and Hugging Face had a public leaderboard with over a hundred entries.
# 2. How questions in one call behave
Every option takes several questions per request: Clef up to 64, Perplexity up to 128, OpenAI up to 200 on its OpenRouter listing. The evidence is sent once, so an extra question costs little.
The part that's easy to miss: the questions run concurrently and independently. Each one sees only the evidence, never the other answers. If question B depends on question A, your code makes a second call and passes A's answer in.
That changes how you design questions. If you ask "which lane?" next to "who sent it?", the lane question quietly judges the sender again inside its own criteria. Ask for small facts in one call and let code decide the action.
One more useful detail: Jev's `/v1/systemone` request shape is now spoken by Clef, Laya, Kev and SGLang, which also added a native `/v1/decisions` endpoint so any open model can serve as a decision model. Swapping providers is close to a config change.
# 3. The field, and why 113 is fewer than it sounds
At a higher level the field groups like this:
* **Purpose-built, closed:** Jev and Liquid d1. OpenAI's Decisions API also belongs here, though it's a general model behind a decision interface. * **Built on Qwen (70, 59 of them fine-tunes):** Perplexity Decider, Clef and Clef-flash, Torchcast, Kev, the vLLM-SR Decision 2.0 family, Intern-Decision, Bespoke Nimble and most of the long tail. The top four open entries all start from Qwen3.8-27B. * **Built on Gemma 4 (18, 11 of them fine-tunes):** Surogate Rune, Blink, GEV-26B, Xor, Winnow and Cygnet. * **Small encoders (16):** Laya, Bekko, GLiNER2.5-Decide and other BERT-style models under 1B parameters. * **Decoding tricks on stock models (20, counted inside the families above):** SGLang's endpoint, diffusion Gemma "Jev mode" and similar runs. * **Other bases (8):** Mistral, EXAONE, K2 and Liquid LFM fine-tunes, plus three with an undisclosed base, including Fastino GLiDE.
Many entries are size variants of one project (vLLM-SR alone has six). The board names 28 organizations; the other 68 entries come from individuals.
|Option|Where you run it|Open weights|Images|Hosted $/1M input| |:-|:-|:-|:-|:-| |Perplexity Decider v1.1 (27B)|Perplexity API, OpenRouter, self-host|Yes, on request|Yes|$0.02| |Fastino GLiDE (28B)|Fastino API|Coming soon|Not stated|Unclear| |Jev 1.13.0|TypeSafe API, OpenRouter, Vercel|No|No|$0.042| |Torchcast Decision 27B|Self-host|Yes|Not stated|n/a| |Kev (4B to 27B)|Self-host|Yes, Apache 2.0|No|$0| |Clef (27B) and Clef-flash (9B)|Workers AI, self-host|Yes, Apache 2.0|Images and video|$0.24 and $0.09| |vLLM-SR Decision 2.0 (0.6B to 27B)|Self-host|Yes|Not stated|$0| |Intern-Decision (0.8B to 4B)|Self-host|Yes, Apache 2.0|Yes|$0| |Laya (421M)|Self-host, even on CPU|Yes, Apache 2.0|No|$0| |Liquid d1|Liquid API, OpenRouter|Promised|Not stated|$0.04| |OpenAI Decisions API|OpenAI API|No|Yes|$0.10|
# 4. Which benchmarks to believe
I leaned on the boards that test many models the same way.
The Decision Index 0.3 on Hugging Face runs every open entry on the same 110,201 requests across 42 benchmarks, on the same GPU. 80% of its headline score comes from private tests nobody has seen, including new domains, so tuning to the public tests doesn't pay. Scores are chance-corrected, unanswered requests count as wrong, and it publishes calibration and latency for each entry. It also marks statistical ties instead of claiming a strict order, and all the data is downloadable.
Its limits are real. It's an unofficial board run by one person, and nobody outside can check the private tests. The area weights are the maintainer's choice. It changed three times in three weeks, so numbers from different versions don't compare. Contamination on the public tests relies on entrants declaring it. OpenAI's Decisions API and Liquid d1 aren't on it yet.
The other sources, briefly:
* **JevBench** scores intelligence, calibration, speed and cost in one composite. Two mirrors carry different versions and don't match: BenchLM has Cygnet, Winnow-12B and Jev on top, and Made By Agents has Mapika's decider-4b v2, Jev and Cygnet. * **AIMultiple's System One Index** tested 10 models on 50 browser tasks and 243 database routing questions. Kev 27B topped the decision tasks. * **OpenRouter** model pages give live latency for hosted APIs, and single-team studies (Trioma, AY Automate, OrcaRouter, Context Studios) each test one task. * **Vendor panels** from Cloudflare, Perplexity, TypeSafe and Fastino favor the vendor, as you'd expect.
Where they agree: Jev lands in the top three on the Decision Index and both JevBench versions, Kev 27B does well on both boards that include it, and Laya is last on quality everywhere while being fastest and cheapest everywhere.
# 5. Quality: no single winner
|Model|Full score|Public tests only| |:-|:-|:-| |Perplexity Decider v1.1|62.8|62.3| |Fastino GLiDE|60.2|59.1| |Jev|60.1|58.0| |Torchcast Decision 27B|59.9|65.1| |Kev 27B|58.8|56.7| |Surogate Rune v3|57.4|58.3| |vLLM-SR Vega 27B|55.9|57.0| |Bespoke Nimble 9B|54.7|57.2| |Cloudflare Clef|53.1|61.7| |Winnow-12B|49.3|50.7| |Cloudflare Clef-flash|47.6|56.2| |Intern-Decision 4B|38.2|38.0| |Laya|4.4|6.2|
The full score mixes public, private and new-domain tests. The gap between it and the public-only score is the interesting part. Torchcast scores 65.1 on public tests and 59.9 overall, and Clef drops from 61.7 to 53.1. Both seem to fit the public suite better than unseen work. Perplexity Decider v1.1, Fastino GLiDE and Jev barely move.
# 6. Strengths by skill area
|Model|Tools|Retrieval|Language|Knowledge|Arts| |:-|:-|:-|:-|:-|:-| |Perplexity Decider v1.1|79|61|68|52|47| |Fastino GLiDE|84|58|60|46|48| |Jev|75|55|59|**54**|39| |Torchcast Decision 27B|**85**|**68**|**72**|47|**54**| |Kev 27B|73|56|63|46|43| |Surogate Rune v3|71|64|62|46|47| |vLLM-SR Vega 27B|74|61|59|46|42| |Bespoke Nimble 9B|84|56|61|41|44| |Cloudflare Clef|81|63|61|53|49| |Winnow-12B|71|54|57|35|31| |Cloudflare Clef-flash|82|52|47|53|48| |Intern-Decision 4B|56|40|43|23|28| |Laya|6|7|10|3|4|
Scores are 0 to 100. Bold is the best in each column.
Torchcast leads four of five areas and Jev leads knowledge and reasoning. For tool calls and routing, the closest match to email triage, most 27B options score 71 to 85 and the gaps are small. Knowledge and arts score lowest for most options, which matches the standing advice to keep math, dates and multi-step reasoning in code.
# 7. Calibration
|Model|Calibration error (lower is better)| |:-|:-| |Kev 27B|0.022| |Torchcast Decision 27B|0.024| |Cloudflare Clef-flash|0.025| |Intern-Decision 4B|0.028| |Cloudflare Clef|0.040| |Fastino GLiDE|0.040| |Perplexity Decider v1.1|0.071| |Jev|0.074| |vLLM-SR Vega 27B|0.086| |Surogate Rune v3|0.120| |Bespoke Nimble 9B|0.123| |Laya|0.140| |Winnow-12B|0.168|
The first six are under 0.05.
Calibration is the gap between what a model says its confidence is and how often it's right. For a script, it matters more than a point of accuracy. When a model's 90% means 90%, you can act on its confident answers and send only the unsure ones for a second look. Kev 27B, Torchcast, Clef-flash, Intern-Decision 4B, Clef and GLiDE keep the error under 0.05. Decider and Jev sit near 0.07.
# 8. Speed, measured two ways
Speed numbers only compare when they're taken the same way. Jev looked slow in Cloudflare's launch post (524 ms) because it was timed over the internet against models running locally. So there are two views.
Models you can run yourself, all timed on the same GPU, one request at a time:
|Model|Median ms per request| |:-|:-| |Laya|5.8| |Intern-Decision 4B|44.2| |Cloudflare Clef-flash|53.4| |Winnow-12B|72.5| |Bespoke Nimble 9B|73.9| |Fastino GLiDE|98.4| |Torchcast Decision 27B|99.9| |Cloudflare Clef|102.1| |Perplexity Decider v1.1|104.1| |vLLM-SR Vega 27B|119.6| |Surogate Rune v3|120.5| |Kev 27B|135.0|
Hosted APIs, every published timing I could find, with vendor claims kept separate:
|Hosted option|Median of independent timings|Timings|Independent range|Vendor claim| |:-|:-|:-|:-|:-| |OpenAI Decisions API|89 ms|1|89 ms|150 ms (DevDay slide)| |Jev (TypeSafe API)|236 ms|13|140 to 830 ms|100 ms| |Clef-flash (Workers AI)|205 ms|3|191 to 530 ms|39 ms| |Liquid d1|220 ms|2|220 to 1,160 ms|none| |Clef (Workers AI)|524 ms|2|524 to 726 ms|209 ms| |Fastino GLiDE (API)|1.4 s|1|1.4 s (before speed work)|none| |Perplexity Decider (API)|2.0 s|1|2.0 s (batch test)|none|
The spread comes from where the clock runs and what's sent. One test timed Jev at 0.14 s on the server and 0.83 s from a client, so the network added about 0.7 s. Short classification lands near the bottom of the range and long inputs near the top. Independent client tests put Clef-flash at about 200 ms, against Cloudflare's own 39 ms. The vendor's number was the fastest one for every API that published one. For a script polling every minute, any of these is fast enough.
# 9. Quality against speed
|Model|Full score|Median ms| |:-|:-|:-| |Perplexity Decider v1.1|62.8|104| |Fastino GLiDE|60.2|98| |Torchcast Decision 27B|59.9|100| |Kev 27B|58.8|135| |**Blink v0.3 26B-A4B**|**57.8**|**25**| |Bespoke Nimble 9B v3|54.7|74| |Cloudflare Clef|53.1|102| |vLLM-SR Lux 9B|48.2|37| |Cloudflare Clef-flash|47.6|53| |vLLM-SR Nox 4B|45.0|34| |Decider 4B (Mapika)|40.3|13| |Decider 2B (Mapika)|25.8|8| |Laya|4.4|6|
A selection of the 111 timed entries. Most of the top scores take about 100 ms; Blink gets close to them at a quarter of that.
Across 111 locally timed entries, quality mostly tracks size and size sets speed. Blink v0.3, a Gemma 4 mixture-of-experts fine-tune, is the outlier: 57.8 at 25 ms, close to the leaders at a quarter of their latency.
# 10. Other factors: JevBench
|Rank|Model|Overall|Intelligence|Calibration|Speed|Cost| |:-|:-|:-|:-|:-|:-|:-| |1|Cygnet|74|71|87|91|56| |2|Winnow-12B Q8|73|74|84|86|57| |3|Jev 1.13.0|72|72|88|84|55| |4|JevK5 v0.3 4B|72|56|88|94|63| |6|Jev-Omni|72|70|83|85|56| |17|Surogate Rune v3|66|70|88|86|49| |20|djev (diffusion Gemma)|64|72|80|91|48| |**34**|**GPT-6 Luna (plain, low effort)**|**40**|**95**|**95**|73|39| |38|kev 8B|34|48|71|84|40| |52|AutoJev-27B|20|73|88|88|29| |93|Laya|0|0|74|74|85|
Sub-scores 0 to 100, higher is better.