The Operations Loop Defined: Five Functions, Autonomy Budget and Observer Principle

All courses / AI Operations / Module 1 / Chapter 4

Learning objectives

After the lesson the participant can:

• Define each of the five operations functions by its input, its output and where it ends
• Set a ceiling for an action class from reversibility, blast radius, evidence and window
• Calculate the consumption of an autonomy budget and state what happens at 70 and 100 per cent
• Draft a delegation profile for one agent and one service, with observer and stop holders

Key concepts

Action class

A kind of effect on the estate, not a tool. The book names eleven, from read and annotate to delete and restore-overwrite; a runbook step belongs to exactly one, and any class not listed in a delegation profile is undelegated.

Autonomy budget

A tolerance for faulty actions that each Level 3 class carries per window, 28 days by default. Errors counted by the observer consume it; a review is held at 70 per cent, and at 100 per cent the class falls to Level 2 until a named authority decides otherwise.

Autonomy error

An action that had to be reversed, whose intended effect the independent observer did not find or found with the service worse, that the policy decision point refused as outside the mandate, or that had a customer-visible or regulator-visible effect, which consumes the whole tolerance at once.

Observer principle

Three tests: the verification does not share its failure modes with the action (independence in model, data, authorship, vendor and time), the observer does not depend on the system it observes, and the stop path works when the platform does not.

Resilience as a claim

A statement of recoverability with a scope, an objective, a measurement, a date and a result. Its status is derived by rule, only a verified claim may be called recoverable, and evidence expires by clock, 180 days by default for a Tier 1 restore or failover test, or on substantive change.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Teaching plan

Discussion

1. The chapter says raising a level is a recorded decision by a named authority while lowering one is immediate and needs no approval. What does that asymmetry protect, and who in your organisation would hold each right?
2. A budget never touched in a year is called a signal. What are the two explanations the chapter offers, and how would you tell them apart?
3. Why does the book treat a Level 3 runbook that deletes production data by a catalogued step as breaking the same rule as Level 4, in a weaker costume?

Written exercise

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

1. What is the book's default ceiling for the action class restore-overwrite?

   1. Level 3 Bounded, provided the runbook has a tested rollback step
   2. Level 2 Supervised, with approval by the incident commander
   3. Level 0 Advisory, because it changes an alert or a monitor
   4. Level 1, with a named person executing after a restore into a separate target is compared
   Show the answer

   D. Level 1, with a named person executing after a restore into a separate target is compared
   Restore-overwrite is irreversible for what is overwritten, so the table caps it at Level 1: a named person executes after a restore into a separate target has been compared.

2. An agent's request is refused by the policy decision point as outside its mandate, and nothing happens in production. How does the autonomy budget treat this?

   1. It counts as an autonomy error, because an attempt costs even though nothing happened
   2. It is ignored, because the refusal shows the control is working as designed
   3. It consumes the whole tolerance at once, as a customer-visible effect does
   4. It is recorded by the agent itself and reviewed only when the 28-day window has closed without a reversal
   Show the answer

   A. It counts as an autonomy error, because an attempt costs even though nothing happened
   A refused attempt is one of the four conditions of an autonomy error and counts once. Only a customer-visible or regulator-visible effect consumes the whole tolerance, and the observer counts the errors, not the agent.

3. Which of these does the dependence test of the observer principle ask?

   1. Whether the verification shares its model, data, authorship or vendor with the action that it verifies
   2. Whether the observer depends on the system it observes and so goes silent when it fails
   3. Whether the stop holder can act without the agent's platform or identity provider
   4. Whether the evidence for a recovery claim is still inside its clock of 180 days
   Show the answer

   B. Whether the observer depends on the system it observes and so goes silent when it fails
   The dependence test asks whether the observer can still report when the platform it watches has failed; a monitoring stack on the cluster it monitors goes silent, and silence reads as health. The other options describe the independence test, the stop test and evidence expiry.