Skip to main content
Richard Smith - Virginia

Self-directed playbook

Operational Intelligence Prototyping

Turn one operational question into something a team can inspect.

Use this before committing to a larger system change when the decision is clear enough to frame, but the operational effect is still difficult to see.

Make the decision inspectable

  1. InputWhat is known now?
  2. ChangeWhat are we proposing?
  3. EffectWhat would the model expose?
  4. ChoiceWhat should happen next?

The prototype is useful only when reviewing it can change a real choice.

Working boundary: This is a learning tool, not a production system, reporting dashboard, open-ended discovery program, or guaranteed improvement.

Know when to use it

Does a prototype change the choice?

Use a prototype when the operating question is clear but the effect of a change is not.

Use itWhen people can inspect the same question together

Existing schedules, workflow artifacts, rules, and domain knowledge are available, but they do not yet show how one proposed change affects the decision.

Skip itWhen another build would not change the choice

Use existing evidence when it already answers the question. Stop when no credible prototype result would change the commitment.

Operating guardrails

People involved
The decision owner, people who understand the operation, technical reviewers, and people affected by the change.
What to protect
Operational safety, customer outcomes, trustworthy interpretation, and the team's limited review capacity.
Smallest useful scope
One decision, one proposed change, one inspectable model or workflow, and one evidence gate.
Stop condition
Stop when the selected uncertainty has been encountered, when new detail no longer changes the options, or when access limits would make the result misleading.

Worked example

Rail equipment demand

How could a proposed change in service schedule affect equipment demand and which assumptions were driving the answer?

The planning context I inherited lived across schedules, equipment definitions, spreadsheets, timing assumptions, and operational knowledge. I translated that material into an editable scenario so the basis of equipment demand could be reviewed instead of arriving as another unexplained total.

My firsthand account places the original decision against known historical active and shop counts. The prototype repository demonstrates related modeling practice; it is not a complete archive of that engagement or its historical comparison.

  1. 01

    Can planners structure the operating scenario?

    Make the inputs editable

    I brought service lines, schedules, equipment requirements, and equipment types into one reviewable scenario instead of leaving them as scattered assumptions.

    Review exposed: I could not use entered counts alone to explain when the same equipment might serve another departure.

  2. 02

    When can equipment be used again?

    Show reuse before added demand

    I used location, timing, operating status, and equipment type to test reuse before showing where another unit was needed.

    Review exposed: I found that one departure trace was useful, but recurring service required a wider circulation view.

  3. 03

    What changes across a bounded schedule?

    Test seasonal circulation

    I used recurring departures to make minimum train-set demand, spare allowance, and assigned context visible without collapsing them into one number.

    Review exposed: I needed to treat equipment that changed along a route more faithfully.

  4. 04

    Where does route detail change the result?

    Add only the fidelity the decision needs

    I added segment-aware assumptions to separate equipment that stayed with the service from equipment needed only on part of the route.

    Decision value: I gave stakeholders a way to correct assumptions and judge whether another increment or a larger handoff was warranted.

What the proof of concept achieved: I made the basis of equipment demand reviewable so stakeholders could inspect assumptions, correct gaps, and improve the next decision.

Proof-of-concept boundary: I did not build a production deployment or establish fleet sufficiency, shop capacity, service improvement, or financial savings. I have not reproduced any private fixture, formula, or client value here.

A reusable method

Use six moves to buy the right learning.

Treat each prototype increment as a learning investment. Spend a bounded amount of time, data, build effort, and review to expose one decision-relevant uncertainty, then turn what you learn into concrete options before you spend again.

  1. Frame

    Name the uncertainty worth reducing.

    Ask
    Which decision is in front of us, and which uncertainty keeps its options from being concrete?
    Record
    The current baseline, proposed change, decision owner, protected outcome, and uncertainty selected for this increment.
    Stop if
    There is no accountable choice, or reducing this uncertainty would not change the available options.
  2. Model

    Choose the smallest learning investment.

    Ask
    What is the smallest calculation, workflow, or view that can make this uncertainty inspectable?
    Record
    The bounded scope, inputs, rules, assumptions, exceptions, known limits, and effort boundary for this increment.
    Stop if
    Existing evidence can answer the question without another prototype, or a bounded model could not represent it credibly.
  3. Test

    Define what the investment must reveal.

    Ask
    What focused test would produce enough evidence to distinguish between the options?
    Record
    What was observed, which options the evidence supports or weakens, disputed interpretations, and excluded evidence.
    Stop if
    Access or safety limits would make the result misleading, or no credible result would change the options.
  4. Review

    Let informed review change the options.

    Ask
    What do operators, domain owners, and technical reviewers correct and how do those corrections change the available options?
    Record
    Confirmed learning, unresolved disagreement, remaining uncertainty, the consequence of being wrong, and the options now supported by the evidence.
    Stop when
    The agreed evidence threshold has been reached. Carry the learning into a choice instead of adding detail by default.
  5. Refine

    Spend only on decision-changing fidelity.

    Ask
    Which remaining uncertainty is material enough to justify one more bounded increment?
    Record
    The next increment, the learning it must purchase, its effort boundary, and the option that learning could change.
    Stop if
    More detail would repeat what is already known or require more effort than the decision warrants.
  6. Decide

    Convert the learning into concrete options.

    Ask
    Which next path does the evidence now support: refine, hand off or proceed, investigate further, or stop?
    Record
    The credible options and their trade-offs, the selected path, supporting evidence, accepted uncertainty, accountable owner, and review trigger.
    Stop when
    The prototype has made the options concrete enough for an accountable choice, or further learning no longer justifies the spend.

Your working artifact

Build the record your team can revisit.

Keep the prototype smaller than the system it is helping you consider. The prompts below are complete without an account or download.

Private by design: Entries stay in this page only. They are not saved or sent.

What choice must this prototype help someone make?

What is known now, and where did it come from?

What input, rule, demand, or workflow state is changing?

What calculation, interaction, or view would make the effect inspectable?

What could make the result incomplete or misleading?

What would support, weaken, or change the proposed direction?

Who understands the operation, and who is authorized to choose?

When has the prototype learned enough?

09 Next choice

Choose after review. No outcome is automatically preferred.

Clearing or reloading the page removes your entries.

The decision gate

Let evidence decide how far to go.

A successful prototype does not always produce a larger build. It produces a clearer next choice and a record of why that choice is responsible.

01

Refine the prototype

Use one more increment when a specific fidelity gap could materially change the decision.

02

Hand off or proceed

Move forward when the evidence is sufficient, ownership is clear, and remaining uncertainty is explicitly accepted.

03

Investigate further

Pause the prototype when a missing source, access constraint, or disputed assumption must be resolved first.

04

Stop here

End the work when the direction is not worth pursuing or another increment would not change the choice.

Stopping is evidence, too. Record what was learned, what remains uncertain, and what event would justify reopening the decision.