AI Red Team · Module 8 · Verification, Improvement and Conclusions

Nordvik Region and Hansa Mutual: Cyber Defence Conclusions

The lesson compares how Nordvik Region and Hansa Mutual applied the book across the six CSF Functions: their starting points, decisions, what worked, what was hard and their plans for the next 24 months. Participants read the two CSF profiles as code side by side and apply the three tests the comparison yields, the mandate test, the inventory test and the evidence test, to their own organisation.

Lesson 27 of 28Chapter 2760 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Red Team / Module 8 / Chapter 27

Learning objectives

After the lesson the participant can:

Key concepts

Mandate before tools
Nordvik Region built the mandate first, because a public authority must be able to explain to its board, its auditors and its residents why it lets AI touch security work at all. Its charter caps security AI at Mode 4, offensive work at Level 2 and irreversible actions at Level 1.
Separating identity from capability
Once Hansa Mutual's investigation agent had its own identity and permission manifest, the board could debate specific actions and not the agent as a whole, and approved Level 3 Bounded for two of them.
The shared blind spot
Both organisations found that vendor AI already acted automatically without anyone having decided it. At Nordvik, vendor features quarantined mail and blocked processes at what amounted to Level 3.
Three tests
The mandate test: can the organisation state on one page its ceilings, who may change them and who holds the stop path? The inventory test: does it know which vendor features act automatically and at what effective autonomy? The evidence test: when was its most relied-upon control last tested?

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Sort

Nordvik Region or Hansa Mutual

Sort each fact under the organisation it describes at the end of the book.

Interactive exercise 2 · Scenario

Which test fails first?

Apply the three tests of Chapter 27 to an organisation like yours.

Teaching plan

15 minThe teacher summarises the two starting points and the decisions per Function, using the comparison table of starting point, legal frame, highest autonomy, first investment and binding constraint.
10 minParticipants read the two profile summaries and explain why Nordvik is strongest in Recover and Hansa in Detect.
25 minExercise: individuals apply the three tests to their own organisation and draft a prioritised 24-month plan.
10 minPairs exchange plans and check the order: mandate before capability, inventory before extending autonomy, evidence before claiming maturity.

Discussion

  1. Hansa Mutual's Level 3 decision remains contested between business owners who would accept more automation and a chief risk officer who insists every extension passes the board. Which side would you take, and on what evidence?
  2. Works-council consultation slowed Hansa Mutual's rollout but improved the design. What might that improvement have consisted of?
  3. What can a large organisation with a mature SOC learn from a regional authority with six analysts, and the reverse?

Written exercise

Exercise · 25 minutes

Apply the three tests and draft a 24-month plan

Apply the three tests to your own organisation and record a pass or fail for each with the evidence you would show: the one-page statement of the highest usage mode and autonomy level, who may change them and who holds the stop path; the list of vendor features that act automatically with their effective autonomy; and the date and result of the last test of the control you rely on most. Then write a prioritised plan of five items across 0 to 24 months, modelled on the two plans in the chapter. At least one item must address Mode 0, and any item that extends autonomy must state the evidence required and the forum that decides.

Deliverable: A three-test assessment with evidence for each answer and a five-item prioritised 24-month plan with time bands and decision forums.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. What did Hansa Mutual build first?

    Show the answer

    A. Control around the AI it already had: an identity, a permission manifest and a stop path for its agent
    Hansa built control around the existing agent before adding more, because the July 2026 incident showed how a capable agent in a security context can exceed its mandate; only then did the board consider bounded autonomy.

  2. What did Nordvik Region's restore drills find that no audit had found?

    Show the answer

    D. Two services whose recovery depended on an undocumented supplier step
    The drills found two services whose recovery depended on an undocumented supplier step. The silent log source was found by Hansa Mutual's chaos experiments, and the token finding came from Nordvik's threat-led exercise.

  3. Which of the three tests did both organisations fail at first?

    Show the answer

    B. The inventory test
    Both failed the inventory test at first, not knowing which vendor features already acted automatically and at what effective autonomy, which is why Mode 0 heads each plan.