Tools · Module 4 · Securing and Testing

Response, Recovery and Resilience Tools

The lesson covers the records that carry an incident from declaration to review and the tools that prove recovery: the incident record and its AI variants, the clock sheet and incident clock, the recovery plan as code, the degradation-mode definition, the restore-test record with its five kinds of test, the post-incident reviews of AI Operations and AI Blue, and the resilience register. The thread is the chapter's conclusion that the age of a proof is part of the proof.

Lesson 13 of 25Chapter 13105 minutes

Read the chapterThe whitepaperThe slides

All courses / Tools / Module 4 / Chapter 13

Learning objectives

After the lesson the participant can:

Key concepts

Incident record
The single account of an incident, family INC, from AI Operations: clocks, timeline, hypotheses by author, the assistant's contributions and the decisions with their holders. It must never contain a cause written by the assistant and stated as fact.
Clock sheet and incident clock
Complements. The clock sheet is written once per service before any incident and says which reporting clocks could open and who owns each; the incident clock, family CLK, is created per incident and opens the clocks from the moment of awareness.
Recoverability claim
A claim defined in AI Operations, Chapter 19, by six parts: subject, scenario, objective, result, date and expiry. A claim that lacks one is an assertion, and the test clock stops when an independent probe confirms an acceptable state.
Resilience register
A register of every recoverability claim, one row per claim, with six statuses derived from the latest test record and never edited. Its denominator includes untested and asserted claims.
Degradation-mode definition
An artefact of AI Red Team on the rule lose speed, never lose the defence: named modes from normal to manual with entry conditions. The monitor runs outside the agent's runtime, and the agent never chooses its own mode.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Sort

Clock sheet or incident clock?

The two records are complements. Sort each statement to the record it describes in Chapter 13.

Interactive exercise 2 · Scenario

The assistant's top-ranked cause

Choose what the incident commander should do, following the rules of the incident record in AI Operations.

Teaching plan

15 minPresent Figure 13.1 and the incident records. Explain the four classes of AI incident in AI Operations and the rule that every time is written by a system or a named role.
20 minRead the Hansa Mutual clock sheet for underwriting support and compare it with the incident clock of AI Blue. Participants explain the awareness rule and the date the instruments were read.
20 minTeach recovery: the recovery plan whose restore point is defined relative to the earliest indicator of compromise, the five kinds of restore test with default clocks, and the failed record RST-HM-2027-004.
10 minTeach review and register: the two post-incident reviews, the action closure rule, the six statuses and the quarterly review checklist.
30 minExercise: participants write recoverability claims and a register extract for one service and plan the next test.
10 minDebrief: how many claims were verified, asserted or untested, and what the board would be told.

Discussion

  1. The restore test clock stops when an independent probe confirms an acceptable state, never when the restore command returns. What changes in a team's reported recovery times when this rule is applied?
  2. In the review example an action stays open because the re-test took 14 minutes against a 10-minute target. What pressure does a closure rule of this kind put on an organisation, and is it healthy?
  3. The chapter says a register with every claim in the denominator gives a board a smaller and more honest number. How would you introduce that number to a board used to a list of passed tests?

Written exercise

Exercise · 30 minutes

Recoverability claims and a register extract

Take one Tier 1 service of your organisation, or the claims core system of Hansa Mutual. Write three recoverability claims for it, each with the six parts: subject, scenario, objective, result, date and expiry. For each claim choose the kind of restore test that would prove it (restore from backup into a segregated environment, failover, rebuild from code, degraded or manual mode, restore at scale) and note the default clock. Then build a register extract of three rows giving the latest record, its age and a status. Where no test exists, say so. Finish by naming the next test to schedule, the independent probe and the attester.

Deliverable: Three six-part claims, a three-row register extract with status and evidence age, and a scheduled next test with probe and attester named.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. Which default clock does AI Operations propose for a rebuild-from-code test of a Tier 1 service?

    Show the answer

    B. 90 days
    The table of five test kinds gives 180 days for restore from backup and failover, 90 days for rebuild from code and 365 days for degraded mode and restore at scale. Tier 2 clocks double.

  2. How is the restore point defined in the recovery plan as code of AI Red Team?

    Show the answer

    D. Relative to the earliest indicator of compromise
    The restore point is defined relative to the earliest indicator of compromise, not as the latest backup, because the latest backup may already contain the adversary's changes.

  3. What happens to a failed restore-test result when the test is later repeated and passes?

    Show the answer

    C. The failed result is never overwritten; the later passing record supersedes it
    The chapter states that a failed result is never overwritten and that a later passing record supersedes it. A failed result withdraws the claim and opens a problem record in the meantime.