Pular para o conteúdo
← Back to Skalablog

Published article

How To Use K2-Type-0.9B For Message Routing

Software Engineering

Twenty-seven milliseconds is the median response time the video reports for K2-Type-0.9B, a decision-only model released in early October 2026. That is fast enough to classify a support message, score its urgency, and detect anger in one pass. The model never generates prose. It reads a situation and a set of multiple-choice questions, then returns probabilities for each option.

What is K2-Type-0.9B?

K2-Type-0.9B is a decision-only AI model: it reads one situation and scores fixed answer choices instead of generating text. The video reporting its release says it comes from a group called IFM and was shared publicly around October 4-5, 2026.

The 0.9B in the name refers to roughly 900 million parameters, which is small compared with the chat models most people use daily. The video states the model is distributed under the Apache 2.0 license, the permissive open-source license documented at apache.org, so it can be downloaded and used commercially if that licensing holds in the official listing.

One caution applies throughout this article: the model, its maker, and its numbers come from a single video published on 2026-10-06, which references the model card on Hugging Face. Independent coverage and a verified model card should be checked before any production deployment, because the speaker himself notes that an official benchmark run was still pending.

How does K2-Type-0.9B answer without writing text?

K2-Type-0.9B scores multiple-choice questions against a shared situation instead of generating a response. The model card example shown in the video uses a customer message: "You charged me twice. Refund me or I'm canceling." From that one message, the model returns which team should handle it, whether the person is angry, and how urgent it is, all in one pass.

The video describes three question types you can pair with any state:

The three question types

  1. True or false. You ask whether a statement holds, and the model returns the probability that it is true.
  2. Best choice. You provide options, and it returns the best option, a confidence number, and probabilities for every other option.
  3. Score level. You define a scale such as low, medium, or high, and it returns the most likely level with the chance for each.

All questions share the same state, which the model card calls the facts on the table, but they cannot see each other. The video attributes this isolation to a block causal attention mask: each question stays in its own lane, so adding a fourth question later does not change the first three answers. That stability matters when you extend a routing workflow over time.

K2-Type-0.9B benchmark results: what the numbers show

On the public benchmark named Jeb Bench in the video, K2-Type-0.9B reportedly scored 176 of 231 correct, or 76.2% overall. The breakdown by difficulty shows where it belongs and where it does not.

DifficultyScoreReported result
Easy47 of 4897.9% correct
Standard66 of 7291.7% correct
Hard63 of 11156.8% correct

These figures are speaker-reported from the model card, not independently verified for this article. The pattern is consistent and useful: a 900-million-parameter decision model handles easy and standard classifications well but drops sharply on hard questions.

Jolin Chen, identified in the video as one of the people behind the model, said the 76.2% result was the best he knew of among open models at 2 billion parameters or smaller. He also said the official Jeb Bench run was still pending when he made that claim, so treat it as an early, self-reported statement rather than a confirmed leaderboard position.

The same model card reportedly lists another system, Jef 1.13.0, at 86.6%, which is higher. K2-Type-0.9B is therefore not the top-scoring decision system available. Its case rests on small size, an open license, fast answers, and a design built only for decisions.

How fast is it, and what does each decision cost?

The video reports a median response time of 27 milliseconds, with the 95th percentile around 60 milliseconds. Each decision consumes about 590 tokens of input on average. Those numbers are model-card figures relayed by the speaker; they describe this model and its test setup, not a general guarantee for any deployment.

For comparison, blinking takes roughly 100-400 milliseconds, which is the point the speaker makes: the model answers before a human finishes a blink. In practice, latency will also include network time, hosting hardware, and your own code, so end-to-end speed in your stack will differ from the reported median.

Where a decision-only model fits in a workflow

The strongest use shown in the video pairs K2-Type-0.9B with the tools you already run, using it as a fast classifier ahead of a writing model and an automation step. The speaker demonstrates six workflows built around his own community; two illustrate the pattern.

  1. Lead sorting. A visitor message such as "I run a salon and want more clients with AI" is scored on three questions: readiness (low/medium/high), what they want most (calls, tutorials, or roadmap), and reply timing (today, this week, or later). The reported result gave high readiness at 91%, tutorials at 84%, and reply today at 88%, so the team contacts that visitor first.
  2. Content picking. Given a state describing the audience and four video options, the model returns a probability per idea. The winner, lead sorting at 62%, is then passed to a writing model that drafts the script.

The general recipe transfers to any repeated small decision: message triage, ticket routing, priority scoring, or follow-up timing. Write the state, define three questions with fixed choices, run a batch, and check the outputs against your own judgment before trusting the model.

What to verify before you deploy it

Every number in this article traces to one video dated 2026-10-06 and the model card it shows. Before production use, confirm on the official Hugging Face listing that the model exists under its exact name, that the license is Apache 2.0 as claimed, and that the benchmark results match the card. The speaker himself flags that the official Jeb Bench run was pending.

Two limits deserve weight in any decision. First, hard-question accuracy of roughly 57% means the model should not make consequential judgments without a human check. Second, a higher-scoring system, Jef 1.13.0 at 86.6% per the same card, exists when accuracy matters more than size and speed. Choosing K2-Type-0.9B is a trade of some accuracy for a 900-million-parameter footprint, permissive licensing, and millisecond latency.

FAQ

  • What is K2-Type-0.9B? It is a decision-only AI model of about 900 million parameters that scores multiple-choice questions against a shared situation instead of generating text. The video reports an IFM release around October 4-5, 2026 under the Apache 2.0 license.
  • How accurate is K2-Type-0.9B? The video reports 76.2% overall on Jeb Bench: 47 of 48 on easy, 66 of 72 on standard, and 63 of 111 on hard questions. These are model-card figures with the official run still pending, and a system named Jef 1.13.0 reportedly scores higher at 86.6%.
  • How fast does K2-Type-0.9B respond? The reported median response time is 27 milliseconds with a 95th percentile around 60 milliseconds, using about 590 input tokens per decision. Real-world latency in your own deployment will add network and hosting overhead.
  • Can K2-Type-0.9B write text or chat? No. By design it only scores provided answer choices and returns probabilities. Pair it with a separate writing model when a drafted response is needed.
  • Is K2-Type-0.9B free to use commercially? The video states it uses the Apache 2.0 license, which generally permits commercial use. Verify the license field on the official model card before shipping, since this article could not independently confirm the listing.

Source video