AI Operations · Module 7 · Experience and Conclusions

Conclusion: Operations with AI

The lesson judges the five-part thesis against the evidence of the whole book and concerns all five functions. Participants learn the three limits that apply to every verdict, the verdict on each part with its observable core and open edge, why the observer principle is the book's most transferable rule, which questions remain open, what would show the thesis wrong, and five things to do on Monday.

Lesson 31 of 31Chapter 3190 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Operations / Module 7 / Chapter 31

Learning objectives

After the lesson the participant can:

Key concepts

Verdicts of unequal strength
The observer principle and the first half of resilience as a claim rest on documented failures; matching autonomy to reversibility is observable in practice, while the autonomy budget is the book's own proposal without outcome data; the decay of manual skill is the weakest in direct evidence.
Designs, not findings
One of three limits on every verdict: the book's mechanisms, such as the budget, the observer manifest and the register, are designs and not findings, the evidence is of unequal strength, and the two organisations are fictional illustrations.
The observer principle as the central rule
The rule that carries the thesis and its most transferable contribution: it is graded by action class so its cost falls where the risk is, yet it does not make a loop safe, and an independent observer can also be wrong.
What would show the thesis wrong
Independent incident data over several years in which autonomous remediation without independent verification and without practised manual operation did better than a loop that keeps both, or operators who do not practise manual recovery handling novel failures as well as those who do.
Five things on Monday
Write the loop of one Tier 1 service on one page; set the ceiling per action class and name who can stop; list the identities that can change production; ask what verifies the last automatic repair and what it shares with it; write the six parts of the oldest recoverable claim and schedule a manual drill.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Match

The observable core of each part

Match each part of the thesis with the observable core that the chapter's table gives it.

Interactive exercise 2 · Sort

Recommended ceilings to start from

Sort each action class by the ceiling the author recommends as a starting point in the chapter's closing table.

Teaching plan

15 minThe teacher presents the table of the five parts with observable core and open edge, and the three limits on how to read the verdicts.
20 minFive groups each take one part of the thesis and argue the verdict: what is observable, what is expected, what is speculation and what the evidence does not show.
10 minDiscussion of the open questions and of the thresholds that would change the author's labelled projections.
35 minExercise: participants produce the five Monday records for one Tier 1 service.
10 minClosing round: each participant names the record with the most blanks and what they will do about it in the first week.

Discussion

  1. The autonomy budget is the book's own proposal without outcome data. What would you record in your own organisation over two years to give it some?
  2. The observer principle does not make a loop safe, and an independent observer can also be wrong. What, then, does independence buy?
  3. Of the open questions the book leaves, such as how much manual practice is the minimum, which could your organisation help to answer by recording its own tests?

Written exercise

Exercise · 35 minutes

Five records for the first week

For one Tier 1 service, yours or Nordvik Region's portal under the charter CHR-NR-OPS-01, write five short records from what you already have. First, the loop on one page: service owner, objective, who observes, diagnoses, changes, restores and sustains. Second, the ceiling for each action class and who can stop, outside the platform. Third, the identities that can change production, marking those that are standing or shared. Fourth, what verified the last automatic repair and whether it shared a model, a signal, a credential or a failure domain with the actor. Fifth, the six parts of the oldest recoverable claim with its derived status, and a date for a manual drill with the agent off. Write unknown wherever you do not know.

Deliverable: Five one-page records for one service, each with an owner and a date, and a list of the unknowns to resolve in the first week.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. How does the chapter judge the autonomy budget, as distinct from the matching of autonomy to reversibility?

    Show the answer

    B. The matching is observable; the budget is the book's own proposal without outcome data
    Matching delegation to reversibility is observable in practice and in the cases. No source reports an organisation that counted autonomy errors against a budget, so the budget remains a design proposed by the book.

  2. What does the table of the five parts give as the open edge of the observer principle?

    Show the answer

    D. Speculation: that a model verifier is enough
    The observable core of part 4 is the shared-fate failures in the public reports. Its open edge is the speculation that a second model as verifier would suffice, which the evidence on correlated model errors does not support.

  3. Which of the five things to do on Monday answers the part of the thesis on the observer principle?

    Show the answer

    A. Ask what verifies the last automatic repair and whether it shares anything with it
    Each action answers one part: the loop on a page for part 1, ceilings and the stop for part 2, identities for part 3, the verification of the last automatic repair for part 4, and the oldest recoverable claim with a manual drill for part 5.