Keeping the Craft: Deskilling, Judgement and the Architect Who Still Can

All courses / The Transformed Security Architect / Module 3 / Chapter 15

Learning objectives

After the lesson the participant can:

• Explain three reasons why Bainbridge's ironies of automation take a sharper form for the security architect.
• Distinguish what the evidence on deskilling shows as observable from what the chapter labels expected.
• Design a quarterly craft-keeping programme with protected time, unassisted work, seeded-error drills and a degraded-mode exercise.
• Apply the gate that keeps an action at Level 3 Bounded only while the skills to supervise it exist.

Key concepts

Judgement in three parts

Recognising what matters, including what is missing; weighing options whose costs and risks are not commensurable against a risk appetite with incomplete information; and answering for the decision to a board, a supervisor, an auditor or a court.

Craft-critical capabilities

The set of capabilities without which AI output cannot be checked, such as drawing trust boundaries, deriving threats no catalogue suggests, writing a policy rule and its tests, finding excess authority in a manifest, re-deriving a requirement from its legal article and designing a stop path.

Deliberate practice

Activities designed specifically to improve performance, requiring effort and giving feedback. Ordinary work does not count. Its three forms are unassisted design work, drafting first, and review without the assistant.

Seeded-error drill

Known design flaws placed in proposals in a drill channel behind a merge guard, at a limited rate, revealed to the reviewer within one working day and measured per capability at team level. The flaws are mistakes an architect must catch, not attacker techniques.

Unaided-competence gate

An action may be raised to or kept at Level 3 Bounded only while at least two named architects hold current evidence of writing and testing its playbook unaided and the detection rate for related seeds stays above threshold; otherwise it returns to Level 2 Supervised.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Teaching plan

Discussion

1. The chapter says the architect's estimate of what they could still do unaided is checked against nothing. How would you check it in your own case without turning the check into surveillance?
2. Automation removes the periphery where newcomers used to learn. Which junior architecture tasks would you reserve for unaided work, and what would that cost in the first year?
3. For a single post, team-level reporting is individual reporting. How does Nordvik's architect resolve this, and what would you do differently?

Written exercise

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

1. What did the study in four Polish endoscopy centres find after AI-assisted colonoscopy was introduced?

   1. Novices improved their detection rate while experts stayed level
   2. Detection in AI-assisted colonoscopies rose from about 22 per cent to about 28 per cent within a few months
   3. Experienced endoscopists refused to work without the AI after six months
   4. Experienced endoscopists' unassisted adenoma detection rate fell from about 28 to about 22 per cent
   Show the answer

   D. Experienced endoscopists' unassisted adenoma detection rate fell from about 28 to about 22 per cent
   The adenoma detection rate of experienced endoscopists in standard colonoscopies without AI fell from about 28 per cent to about 22 per cent. The chapter notes it is a single observational study but the first clinical evidence of its kind.

2. What protected practice time does the chapter's quarterly craft-keeping programme set as a default?

   1. One hour per architect per week, taken from review time
   2. Half a day per architect per fortnight, about five per cent of working time
   3. Two full days per architect per quarter, taken outside working hours and recorded by HR
   4. Twelve days per team per year, shared among the architects
   Show the answer

   B. Half a day per architect per fortnight, about five per cent of working time
   The default is half a day per architect per fortnight, about five per cent of working time, reduced only by a recorded decision, because the assisted path is always faster that week.

3. What happens to an action at Level 3 Bounded if fewer than two named architects hold current evidence of writing its playbook unaided?

   1. It continues, provided the agents' acceptance rate stays high
   2. It is suspended pending works-council consultation
   3. It returns to Level 2 Supervised until the gate is met
   4. It is escalated to the management body for risk acceptance
   Show the answer

   C. It returns to Level 2 Supervised until the gate is met
   If either condition of the gate fails, the two-architect evidence or the seeded-error detection threshold, the action returns to Level 2 Supervised, so autonomy rises only as fast as the capacity to supervise it.