AI Purple · Module 5 · The Loop in the Organisation

Coverage as a Claim: Technique Maps, Evidence Age and Detection Decay

The lesson examines the word covered. Participants learn that a coverage claim has five parts, a technique, an environment, a result at a named layer, a date and an expiry, and that a heat map with no age is not a coverage statement. They build coverage records whose status is computed by rule into six values, handle decay, environments and variants, keep not tested honest, and report by denominator, reason and age.

Lesson 17 of 29Chapter 1790 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Purple / Module 5 / Chapter 17

Learning objectives

After the lesson the participant can:

Key concepts

Coverage claim
A statement that a specified technique was exercised in a specified environment inside a window of time, with a result at a named layer, a date and an expiry. A claim that lacks one of the five parts is not a coverage statement.
Six statuses
Verified, expired, implemented-unverified, failed, asserted and untested. The status is derived by a deterministic rule from the evidence; a person does not edit it, and only verified counts as covered.
Tested versus asserted
A test is an exercise the organisation or an independent party ran and whose result it holds. An assertion is a statement by a provider, vendor or owner. An assertion repeated in four documents is still one assertion.
Decay
The process by which a detection that worked when tested stops describing the estate, through change in the estate or in the adversary and the variant. The record guards against it with a clock and with conditions that end the evidence early.
Declaration
The act of a named person who declares a technique covered, with a date. The field is empty unless the status is verified; AI compiles and proposes, the rule decides the status, and a person declares.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Put in order

The status rule: first match wins

The status rule tests its conditions in a fixed order and the first match wins. Put the conditions in the order in which the rule evaluates them.

Interactive exercise 2 · Scenario

Activity or coverage

Apply the chapter's definition of covered to a request at Hansa Mutual.

Teaching plan

15 minThe teacher shows a green heat map and asks what each cell proves, then names the three failures: it rewards the last pass, hides the denominator and merges unlike things.
15 minParticipants apply the status rule by hand to ten short record descriptions, first match wins, and compare the result with the colours of the map.
35 minExercise: convert a heat map for a priority list into coverage records and a coverage page.
15 minReading of Nordvik Region's page of 2028-04-26: nine techniques in three states, and of Hansa Mutual's conversion that reproduced 25 of 34 and showed what the colours hid.
10 minPlenary on reporting to three readers and on why the pipeline's 31 of 34 techniques exercised within 30 days is activity and not coverage.

Discussion

  1. The most valuable line on a coverage page is the one that says not tested, because it is the hardest to write. What makes it hard in your organisation?
  2. Nordvik Region's risk is a page that is accurate on the day and not refreshed; Hansa Mutual's is a page refreshed so often that nobody reads its age. Which guard fits which risk?
  3. A risk-accepted finding keeps its technique at failed. What would a board conclude wrongly if accepted gaps were shown as covered?

Written exercise

Exercise · 35 minutes

From heat map to coverage records

Take a technique heat map from your own organisation, or the nine priority techniques of Nordvik Region's benefits-triage service. Following the practical guide, create one record per technique and environment. For each green cell look for the evidence: the scenario, the last run, the result at a named layer and the manifest; where none can be linked, mark the cell asserted or untested. Set the clock, 90 days for priority techniques and 180 for the rest or your own figures, and list the conditions that end the evidence early. Apply the status rule in order and write the coverage page: verified out of all priority techniques, the others by reason, the age distribution, and the oldest unexpired and oldest expired claims.

Deliverable: A set of coverage records with computed statuses and a one-page coverage page with denominator, reasons, age distribution and a named declarer.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. A provider states in its runbook that it handles a priority technique, and the organisation has run no test. Which coverage status applies?

    Show the answer

    D. Asserted, which does not count as covered.
    Asserted means no test by the organisation or an independent party, only a statement by a provider, vendor or owner. It does not count as covered; it becomes evidence when a test, such as an injected test, is seen.

  2. Who sets the status of a coverage record, according to the chapter?

    Show the answer

    B. A deterministic rule applied to the records; nobody sets it by hand.
    The record is derived and rebuilt whenever a regression case, an evidence manifest or an assertion changes. The status is computed by a deterministic rule, so an agent cannot raise a technique to verified, and a person only declares.

  3. What did Hansa Mutual's conversion of its 34-technique heat map show that the colours had hidden?

    Show the answer

    A. Four cells were green although their evidence was past its expiry, because the map had no age.
    The conversion reproduced 25 verified of 34. Four of the nine not verified had been green on the old map because their last result was a pass and the map had no age; the other five were already visible as failed or never tested.