This website uses cookies

Read our Privacy policy and Terms of use for more information.

Most small business automations don't break on the hard stuff. They break on the one fuzzy judgment call software can't make on its own: is this email a refund request, a sales lead, or spam? A new class of AI, led by TypeSafe's decision-only model Jev, is built specifically to answer that question in milliseconds for a fraction of a cent, without ever generating a word of customer-facing text.

The cost-quality bottleneck

Every automated workflow eventually hits the same wall. You either pay for a large, expensive model to sort routine decisions, or you let a cheap model hallucinate its way through customer-facing judgment calls. That trade-off is what's pushing a shift away from AI that talks and toward AI that decides.

DigitalOcean's own published architecture for this is called fallback routing: incoming requests default to a fast, cheap model, and only escalate to an expensive, highly capable model when confidence drops or the system detects a red flag like negative sentiment. It works, but it has a hidden cost: that first "cheap" model is still a generative model. It still has to predict and write tokens sequentially just to decide what to do next, which is where the latency and spend actually come from.

The third primitive: classification

For most of software's history, automation ran on two primitives: deterministic rules (basic if/then logic) and generation (an LLM writing prose). A new third primitive is emerging: classification, models that skip text generation entirely and just return a typed answer.

TypeSafe, founded by ex-OpenAI researcher Diogo Almeida, shipped exactly this on September 15, 2026: a "System One Model" called Jev. As Sam Witteveen and Greg Isenberg both put it in their breakdowns, Jev is a classifier at its truest: you send it a state (text or JSON) plus a typed question, and it returns a typed answer: a Choice (pick one of up to 255 options) or a Score (place the input on a defined scale). One commenter on Isenberg's video, @kraayenjon, summarized the pitch well: no generated prose, just typed answers a program can act on directly.

TypeSafe claims Jev runs 40-200x faster than frontier LLMs for these tasks, priced at $0.042 per million input tokens with $0 output cost. Output is free because there's no generated text to charge for. Per Sebastian Raschka's technical breakdown, the structural appeal is real: a model that can only emit typed outputs sidesteps the hallucination risk that comes with prompting a generative LLM to "behave" and hoping the JSON parses correctly.

The reality check on vendor accuracy claims

The harder question is whether any of this holds up under real-world testing. For most vendors, it doesn't. Twig's independent teardown of 10 AI ticket-routing tools found that only 3 actually hit 70% resolution, despite most vendors advertising 90%+ tagging accuracy. Fini Labs' own Zendesk benchmarking work points to a more honest metric than headline accuracy: misroute rate, the percentage of tickets that get reassigned after the initial auto-routing decision, since tag accuracy alone is easy to game with a favorable test set.

That gap between marketing and reality is why teams are converging on requiring a structured output (JSON or XML with a confidence score and a sources field), where an empty sources field triggers a refusal path in the application code instead of trusting the label outright. Per FutureAGI's hallucination mitigation guide, layered guardrails built this way (system prompt constraints, grounding, and monitoring together) cut hallucination rates 71-89% versus unguarded classification calls.

Build vs. decide

The build-it-yourself crowd hasn't disappeared, either. Easy Analysis' n8n walkthrough, "I Built an AI Email Classifier in n8n," is a straightforward example: no exotic dedicated classifier model, just a general-purpose LLM prompt structured to return a category for sales leads, complaints, and reviews. That's still the more common real-world pattern than a dedicated model like Jev. Most builders are prompting what they already have, not swapping in a new decision-only primitive.

Plain-language, no-code tools are also entering this space. Quickbase's app builder, Pave, lets non-programmers describe a workflow in plain language and get a deployable app with the logic, permissions, and governance built in, the same instinct as Jev, aimed at people who'd never touch a classifier model directly.

For a solo builder or small team, the real win is AI making the small, fuzzy calls that used to require a human. That's cheap, instant judgment that never talks to your customers directly, and it frees up your own time for the deep, deliberate thinking only you can do.

FAQ

What is an LLM classifier, and how is it different from a chatbot?
An LLM classifier returns a typed answer, a category choice or a numeric score, instead of generated text. It skips the sequential token-by-token generation step entirely, which is why models like Jev can respond in milliseconds for a fraction of a cent and never produce customer-facing prose.

How much does TypeSafe's Jev cost?
Jev prices input tokens at $0.042 per million, with no charge for output, since there's no generated text to bill for. TypeSafe claims it runs 40-200x faster than frontier LLMs on these decision tasks.

Do AI ticket-routing tools actually work as advertised?
Not consistently. Independent testing from Twig found only 3 of 10 AI ticket tools hit 70% resolution, despite most vendors advertising 90%+ tagging accuracy. Misroute rate (how often a ticket gets reassigned after initial routing) is emerging as the more honest metric to ask vendors for.

What is "fallback routing," and why doesn't it fully solve the cost problem?
Fallback routing (the pattern DigitalOcean publishes) sends requests to a cheap model by default and escalates to an expensive one only on low confidence or red flags. It helps, but the "cheap" model is still generating text token by token, which is exactly the cost and latency a non-generative classifier is designed to eliminate.

This piece is the companion writeup to the Daily AI Pulse episode "Only 3 of 10 AI Ticket Tools Actually Work (Here's What Does)."

More AI breakdowns for solo builders and small teams 👉 joebuildsai.com

Reply

Avatar

or to participate