Trial run

Added · Last updated · Seed

… the actor has configured a bulk edit, a standing rule in rule composition, or an agent set to start by itself under bounded autonomy. It may also be a step inside a workflow. Unlike a live filter over a visible list, a rule, batch operation, or background agent shows no result while it is being configured, and the items it will act on may be out of view or have not arrived yet.

Problem

When an actor configures a rule, a bulk edit, or an agent, reading the configuration rarely reveals how it will behave across real cases. If the only way to see what it does is to run it live, any mistake in the conditions or actions takes effect across every item at once or while nobody is watching.

Whether an action needs a trial depends on its action consequences: easily reversible edits on a single item do not need a rehearsal, whereas batch modifications, standing rules, and agents working under delegation are hard to unwind once they fire. A trial run closes the gap between writing a configuration and trusting it by executing the logic safely and showing the resulting matches, changes, or actions alongside the reasons behind them.

Because interfaces often label every test button the same way, the actor cannot tell whether clicking “Test” previews changes without saving, runs in a sandbox, or fires a real action on one sample item unless the artifact states what the test will do.

Solution

Before a rule, bulk operation, or agent runs live, let the actor test it against real or representative cases and inspect what it did to each item and why. State clearly whether the trial withholds side effects, runs against sandboxed stand-ins, or executes live on a single sample item. Keep the configuration and the trial results side by side so the actor can edit and re-run immediately, and make activating the live version a separate, explicit action.

A trial only shows how the setup behaves on the cases tested. When the sample is small or historical data is sparse, state the sample size rather than presenting the trial as a complete check.

Continuation

The actor can evaluate the configuration by inspecting its actual output rather than guessing from its syntax. Where the trial previews edits to existing items, change review lets the actor inspect and accept or reject individual changes before committing the batch. Each trial result can include an explanation of which condition matched, so the actor can spot a right outcome reached for the wrong reason. For rules and agents that filter or select, the trial can also show the cases that narrowly missed. Because a rehearsal over sample data cannot cover every future input, live runs still rely on case correction when an unanticipated case misfires. Plan preview solves the adjacent problem where an agent presents its own intended steps before acting, rather than testing a configuration the actor set up…

All connections
Precedes
Case correction — Because a rehearsal over sample data cannot cover every future input, live runs still rely on case correction when an unanticipated case misfires.
Change review — Where the trial previews edits to existing items, change review lets the actor inspect and accept or reject individual changes before committing the batch.
Enables
Workflow — It may also be a step inside a workflow.
Serves
Delegation — covers the test-drive touchpoint of delegation's set-up stage
Enacts
Agency — the actor commits based on observed behaviour rather than on reading a configuration
Complements
Plan preview — Plan preview solves the adjacent problem where an agent presents its own intended steps before acting, rather than testing a configuration the actor set up
Related to
Action consequences — a severity reducer for many-case actions: the review step before a rule, replace-all or bulk edit commits across its whole scope
Standing instructions — “Reading it does not say what it will do, which is the gap a trial run fills where the effect can be rehearsed.”
Preceded by
Bounded autonomy — a trial run tests the agent inside the limits bounded autonomy sets before those limits apply to live work
Tuning by demonstration — “Because a single demonstration fits many generalisations, a trial run over new cases lets the actor see which interpretation the system took before relying on it”
Rule composition — “reading the statement does not tell the actor what it matches or does; a selecting rule shows its result on the collection at once, an acting rule shows nothing until it fires”
Enabled by
Explanation — Each trial result can include an explanation of which condition matched, so the actor can spot a right outcome reached for the wrong reason.
Appears in
Delegating standing work: Setting it going, step 2; Putting it right, step 4

In practice

Trial modes

  • Dry run (withholding side effects) — runs the logic against target or historical items and previews what would match or change without committing. Fits find-and-replace, batch renames, rule matching, and backtests where outcomes can be calculated without external side effects.
  • Sandbox (stand-in environment) — executes the full procedure against isolated test data, simulated accounts, or a test recipient. Needed when later steps depend on the effects of earlier ones. When promoting to live, state clearly that only the configuration carries over, not the sandbox data.
  • Single-item live run — executes the action for real on one sample item while the actor watches (such as “Test this step” in an automation builder). Lowest cost to offer, but must warn the actor before firing that a real message or change will occur.

Choosing test cases

  • Known items in view — for a one-off bulk edit, run the preview across the entire target set so the actor can scan the full before-and-after.
  • Historical replay and existing rules — for a standing rule or agent whose targets arrive later, replay the rule over recent past items and evaluate it alongside existing active rules so conflicts, overrides, and missed cases surface before launch. Let the actor supply custom test cases for specific edge conditions.
  • On-demand triggers — where work waits on a schedule or rare event, let the actor fire the trigger manually during testing rather than waiting for the condition to occur naturally.

Resources & references