Jev: A High-Speed AI Decision Engine for Classification
Greg Isenberggo watch the original →
the gist
Jev is a specialized AI classifier that takes input and an output schema to return probabilistic decisions in ~200ms, offering a cheap, type-safe alternative to LLMs for routing and triage tasks.
The Shift from Generative to Decisive AI
Ryan Vogel and Greg Isenberg introduce Jev, an AI model designed specifically for classification rather than text generation. Unlike LLMs that stream tokens and require complex prompting to extract structured data, Jev functions as a high-speed decision engine. By providing an input and a predefined output schema, users receive probabilistic scores for each category, allowing for immediate integration into codebases without additional parsing.
Performance and Economic Efficiency
Jev distinguishes itself through speed and cost. Vogel demonstrates this by processing 1,700 emails in a single batch, categorizing them by priority, spam score, and reply likelihood for a total cost of 18 cents. Each query executes in approximately 200 milliseconds, regardless of the input complexity. This efficiency makes it viable for high-volume, repetitive business tasks that would be prohibitively expensive or slow if handled by frontier LLMs.
Strategic Application in Business Workflows
Isenberg frames Jev as a "traffic cop" for incoming data. The core strategy is to identify business processes with expensive queues—such as lead scoring, support ticket routing, or customer inquiry triage—and place Jev at the front of the pipeline. By assigning a confidence score to incoming data, businesses can automate high-confidence actions while reserving human attention or more expensive LLMs for ambiguous or high-value cases.
Limitations and Proper Use Cases
While Jev excels at classification, it is not a replacement for reasoning models. Vogel notes that Jev performs poorly on tasks requiring complex cross-referencing or long-term planning, such as real-time financial trading. It is best utilized for routing-style decisions where the logic is binary or categorical. The model is currently accessible via the Vercel AI Gateway, with broader access managed through a waitlist.