Skip output decoding.
The model reads the input in a forward pass. It does not spend additional decoding steps writing an answer token by token.
Introducing decision-machine-1, a language model for making decisions when speed matters.
In software, an AI response often becomes a branch, a field, or a score. The application needs the value to take its next step.
decision-machine-1 scores labels and extracts values directly from text. For these bounded tasks, it skips the token-by-token generation an LLM uses—even with structured outputs.
Read the model rationale“Losing sales,
fix this today.”
Is the customer expressing urgency?
Probability of urgency 1.00
/yes-no response. Your code can use the boolean to raise a ticket’s priority.The model reads the input in a forward pass. It does not spend additional decoding steps writing an answer token by token.
Supply labels to choose between, questions to answer from the source, or fields to extract.
A classification includes the full score distribution and confidence. Your code can see when two labels compete, instead of treating every winner alike.
Choose the labels, questions, or fields your application needs.
Flag messages that need a faster response.
Use this flag to raise the ticket’s priority.
{ "answer": true, "probability": 1 }Choose a destination from your support queues.
Use the label to select the billing queue.
{
"label": "billing",
"probability": 0.74,
"confidence": 0.555,
"scores": {
"billing": 0.74,
"shipping": 0.001,
"technical": 0.008,
"other": 0.25
}
}Turn customer frustration into a sortable score.
Nearly tied levels signal uncertainty. Keep it visible when ranking the queue.
{
"score": 1.998,
"level": 1,
"confidence": 0.208,
"scores": [0, 0.334, 0.334, 0.332]
}Locate the shipment destination in a status update.
Source offsets let your application show where the answer came from.
{
"results": [
{
"answer": "Halifax warehouse",
"probability": 0.992,
"start": 25,
"end": 42
}
]
}Map invoice text to the fields in your records.
Invoice fields ready for validation before writing a record.
{
"data": {
"invoice_number": "A-1042",
"vendor": "Nordik Supply",
"total": 4250,
"currency": "CAD"
}
}Identify people, organizations, and references in a claim note.
Typed values for search and record matching.
{
"entities": [
{ "type": "person", "text": "Marie Tremblay", "probability": 0.999 },
{
"type": "organization",
"text": "Desjardins",
"probability": 0.997
},
{ "type": "claim_id", "text": "claim 44812", "probability": 0.714 },
{ "type": "date", "text": "March 3", "probability": 0.997 }
]
}Check a proposed deductible against the policy text.
The source says $500. The proposed value is $1,000.
{ "matches": false, "probability": 0, "found": ["$500"] }Use a decision call first, then accept results that meet your thresholds, and send ambiguous cases to an LLM or a person.
That can reduce large-model calls. It also adds a first step, so measure the cost and latency of the whole path on your traffic.
Build an LLM cascadeprobability >= 0.90
confidence >= 0.70Screen incoming messages. Check extracted fields. Cost follows the text you send, with no output-token charge.
Get a free API keyper million input tokens
The free plan includes 125 million input tokens each month. After that, 100 million input tokens cost $4. Each call bills its input, including repeated text.
Try a classification or extraction call you already send to an LLM. Compare accuracy, latency, and cost on representative inputs.
Use plain HTTP, or reuse your OpenAI client for supported structured-output and tool-call requests.
Create a free accountcurl https://api.milliseconds.ai/v1/decision-machine-1/yes-no \
-H "Authorization: Bearer $MILLISECONDS_API_KEY" \
-H "Content-Type: application/json" \
-d '{"text":"Losing sales, fix this today.",
"statement":"The customer expresses urgency."}'{ "answer": true, "probability": 1 }Keys come from the developer console. The free plan includes 125M tokens per month; usage pricing applies after.
No. A well-formed response can still contain a wrong value. Evaluate on your own data, validate business rules, and review consequential or ambiguous results. Verification can check a value against the source; it is not a guarantee of correctness.
Use an LLM for writing, conversation, multi-step reasoning, or judgments that need knowledge beyond the supplied text. Use milliseconds when the task has defined labels, questions, or fields.
For classification, probability is the winning label’s share of the scores. Confidence describes how concentrated the whole distribution is. Neither is a guarantee that the answer is right. Other capabilities return different scoring fields; tune thresholds for the task and the cost of a mistake.
Yes, for JSON-schema extraction and tool calls. Set the base URL to https://api.milliseconds.ai/v1 and select decision-machine-1. This is not a drop-in chat model: plain chat is unsupported, and the compatibility layer reads user turns only.