Autonomous exploration vehicles following a defined route toward a distant research station under human oversight
← All insights

Production AI agents

AI Agents Need an Operating Contract

Tool use, memory and autonomy become enterprise capabilities only when identity, permissions, evidence and interruption are designed together.Field note

Point of view

A useful agent does more than answer. It observes, plans and acts. That changes the design problem from conversation quality to operational authority.

Every production agent needs an explicit contract for what it may know, what it may do, what evidence it must leave and how a person can stop it.

Authority boundary

An agent earns limited authority through an operating contract.

Use the model to connect the decisions, controls and evidence described below.
Agent identity
  1. 01
    Approved contextWhat the agent may know
  2. 02
    ToolsWhat the agent may invoke
  3. 03
    PermissionsWhat each tool may change
  4. 04
    Human gateWhere approval is mandatory
  5. 05
    Evidence trailWhat must be recorded
  6. 06
    RevocationHow authority stops

Establish identity

Give each agent its own limited identity.

Give the agent a distinct, narrow and auditable identity with short-lived credentials. Permissions should reflect its job, environment and current task.

Identity makes revocation, attribution and least privilege possible when actions span systems.

Intercept action

Guardrails belong at the tool boundary.

Inspect requests and proposed actions for prompt injection, sensitive data, policy violations and business limits before execution. High-consequence actions should pause for approval.

Output filtering alone is insufficient when an agent can write, deploy, purchase, message or delete.

Operate the agent

Observe goals, tools, state and outcomes.

Record plans, tool calls, approvals, failures and outcomes in a privacy-conscious trace. Evaluate task completion alongside safety, cost, latency and human intervention.

Provide a kill switch, graceful degradation and a clear human escalation path.

Design principles

Keep the operating logic visible.

  1. 01One agent, one limited identity.
  2. 02Intercept before tools execute.
  3. 03Require approval for important actions.
  4. 04Design revocation, escalation and audit from the start.

What changes Monday

Turn the perspective into a focused next move.

  1. 01

    Inventory every tool an agent can invoke.

  2. 02

    Replace inherited credentials with task-scoped access.

  3. 03

    Define approval thresholds and a kill path.

  4. 04

    Run adversarial scenarios before granting production authority.

AI agents become trustworthy when the system makes authority visible, limited and reversible.

Discuss this perspective