H2O-Lightning-4B: Apache-2.0 4B Decision model, official #1 open model on JevBench (above Jev)

Disclosure: I work at H2O.ai. We released H2O-Lightning-4B, an open-weight (Apache-2.0) model for the "decisions API" style of inference that Jev made popular: you send a state plus typed questions (pick one / yes-no / score), and get calibrated probabilities back from a single forward pass. No generated tokens, so it's fast and cheap. Results (JevBench, public leaderboard): - Composite score 72.5, vs Jev 1.13 at 71.5; currently the top open model - Leaderboard: https://benchmarkheaven.com/jev-models Running it: - Base: Qwen3.5-4B, fine-tuned - Stock vLLM plus a small open shim (in the repo); ~30 ms per decision on an H100 - Your data stays local, no per-call fees Coming soon: 12B and 31B versions, which in our internal testing are considerably smarter than Jev, still open-weight and still one forward pass per decision. Demos (inbox triage of 1,000 insurance claims, a multi-browser web agent, DOOM on the decision clock): https://youtu.be/2Qp04Wu0A14 Weights, model card and serving instructions: https://huggingface.co/h2oai/h2o-lightning-4b Happy to answer questions about the setup and latency. submitted by /u/pseudotensor1234 [link] [comments]

Related

• Mica v0.1 4B: open Jev-style decision model (yes/no, choice, score) that runs on an 8 GB GPU — trained for under $30 of GPU time
• I turned Qwen3.8-27B Q2_64 + llama.cpp into a fully TypeSafe AI-compatible Jev-like system. OpenAI API still intact! World’s first Vision-enabled Jev-like model! <10 GB VRAM, 170 ms on an RTX 3090 and ~140 tok/s in chat. 76% vs. 88% Jev-1.13 Acc. on a diverse 22,000-request typed-decision benchmark
• CalDec v1 - Fully Open Decision Model for Personal Assistants
• Aplomb 1: open-weights 5.3B decision model, 1M context, text/image/video/audio in one request, #1 among 4B models on the Decision Index

Source: r/LocalLLaMA | 2026-10-09