Jev 1.13 benchmark
The Jev version TypeSafe's jev-latest alias pointed to on 20 Oct 2026. Text and JSON states, choice, score and yes/no questions, a probability for every option, $0.042 per million input tokens. TypeSafe launched Jev, the first decision model, on 15 Sep 2026.
As of 20 Oct 2026, decidingbench has not published results for Jev 1.13. It is in the planned lineup.
Facts
- Maker
- TypeSafe
- Input
- Text only
- Weights and licence
- Proprietary
Providers each pair is benchmarked separately
- TypeSafe API serverless$0.042 per million input tokens, no output charge
- OpenRouter serverless$0.042 per million input tokens (to confirm)
Results by measurement
- Accuracy
- Accuracy
- Accuracy, yes/no
- Accuracy, choice
- Accuracy, score
- Confidence you can trust
- Right when 90% sure
- Decisions taken at 0.9
- Threshold honesty at 0.9
- Calibration error
- Brier score
- Order and wording
- Answers that change when options are reordered
- Answers that change when reworded
- Drop from 2 to 20 options
- Distractions and long states
- Drop with 16k tokens of distraction
- None of these
- Picks "None of these" when nothing fits
- Picks "None of these" wrongly
- Scores on a scale
- Accuracy, score
- Score within one level
- Score error in levels
- Consistency
- Answers that change on a rerun
- Safety
- Pushed by text in the state
- Images
- Accuracy with images
- Languages
- Non-English accuracy
- Speed and cost
- Latency, median
- Latency, p90
- Throughput
- Cold start
- Cost per 1,000 decisions
First results coming