Skip to content

P3-9.8 What Does One Prediction Actually Decide, and Why Are Scores and Policy Different

Section ID: P3-9.8 Version: v2026.07.20

Even after inputs and results are defined, a prediction problem is still only half closed. Even the same review_needed prediction can mean different things depending on whether it raises one operating event into a review queue or adjusts the warning strength of an entire recent window. In addition, the score output by a model and the policy that turns that score into real action are not the same thing.

One predicted value needs to be written together with the unit of action it connects to, and model scores need to be read separately from operating policy.

Category Question
Unit targeted by one prediction Does this one value refer to one run, one recent window, or the next single case?
Model output Does the model emit a score, a 0/1 value, or a ranking?
Policy rule By what rule is that output turned into action?
Real action Does it register a review queue entry, hold back, or trigger automatic action?
Level Example
Model output 0.82, warning_score
Policy rule review if above 0.8, look only at the top 10%
Real action Register in review queue, adjust priority

Even with the same score, the action can change when the policy changes. Also, some problems use the score only for ranking, while others want to read the number itself almost like a probability. That difference also needs to be written down first. The meaning of one prediction is therefore not just producing one number. It includes the decision structure by which that number goes through a rule and leads to an action. More broadly, this section separates model output, decision rule, and real action as different levels, so that one predicted value is read inside an operational decision structure.

A Small Diagram

One prediction does not end with a score. It must be read all the way through the policy rule into the resulting action.

flowchart TD
    A[The model outputs one score or rank] --> B[Interpret the output type]
    B --> C[Apply the policy rule]
    C --> D{What action follows?}
    D --> E[Register in review queue]
    D --> F[Hold or defer]
    D --> G[Trigger automatic action]

Sources and References