All courses / AI Threat / Module 3 / Chapter 14
Learning objectives
After the lesson the participant can:
- Explain what exposure indices measure and why they do not measure jobs lost.
- Describe the four ironies of automation and their counterparts in AI-assisted knowledge work.
- Design measures that break the automation spiral: rotation, seeded-error drills, a tested manual fallback and meaningful tasks.
- Define an oversight-quality metric in which no single signal decides and results are reported at team level only.
Key concepts
- Exposure is not replacement
- Exposure indices measure where the technology could touch work, not what employers will do. They show reliably where change will concentrate: cognitive, office and clerical work, disproportionately at the start of a career.
- The automation spiral
- The system takes over routine work, the human role shrinks, practice falls, skills erode and the case for more automation grows. Each turn is reasonable on its own, so it has to be interrupted by design.
- Rubber-stamping
- Approval rates rise and time per approval falls until the approval records that a person was present, not that a person judged. It is the expected end state of oversight not designed to keep the overseer practised.
- Seeded-error drill
- Known-wrong synthetic proposals inserted among those reviewed, never executed and revealed afterwards with feedback, as airport security does to keep baggage screeners alert. The guide's default is one in 250.
- So-so automation
- Acemoglu and Johnson's term for technology chosen mainly to cut labour costs, which displaces workers without large productivity gains. It is why the people who do the work should take part in its redesign.
Interactive exercises
Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.
Interactive exercise 1 · Put in order
The automation spiral
Put the turns of the automation spiral in the order in which the chapter's figure connects them.
Interactive exercise 2 · Scenario
An override ratio that is too high
Apply the oversight-quality metric for Hansa Mutual's claims-triage agent.
Teaching plan
| 15 min | The teacher presents the exposure estimates and the productivity evidence; participants restate each headline number as what it measures and what it does not. |
| 15 min | Walk through the four ironies and Figure 14.1; participants locate a team they know on the spiral and say which turn it has reached. |
| 15 min | Present the four principles for redesigning work and the nine-step guide, including why a metric that observes approvals is itself a monitoring system needing consultation. |
| 35 min | Exercise in groups: define an oversight-quality metric for one human-in-the-loop process modelled on OQM-HM-CLM-01, with signals, a combination rule, privacy rules and responses. |
| 10 min | Stage the debate between obsolescence and adaptation and review the three-part verdict on T8 at the scale of work. |
Discussion
- In the customer-support study those whose practices were captured received little of the benefit. What would a fair arrangement look like for experienced staff whose know-how an assistant spreads to others?
- Approval time alone is a poor signal, since a quick approval of an obvious case is good practice. Which combination of signals would convince you that a team has stopped judging?
- The guide says a cause in workload or targets is a management finding, not a training need. Why does that distinction matter for whether staff will trust the metric?
Written exercise
Exercise · 35 minutes
An oversight-quality metric that detects rubber-stamping
Choose a process in which people approve proposals from an AI system, in your organisation or Nordvik Region's benefits unit. First list the two to four oversight-critical skills and the cases where the system is known to be weak. Then define a metric with at least three signals, for example seeded detection rate, override-to-error ratio, fast-approval share and fallback-drill accuracy, each with an alert threshold. Write the rule that combines them so that no single signal decides. State the unit of analysis, the minimum group size, the prohibition on individual reporting and on use in performance evaluation, and which workers' representatives must be consulted before go-live. List the responses when rubber-stamping is suspected.
Deliverable: A metric definition with skills map, three or more signals with thresholds, a combination rule, privacy and consultation rules, and responses.
Self-test
Choose an answer to see whether it is right, or open the answer below each question.
What did IMF staff estimate about exposed jobs in advanced economies?
Show the answer
D. Roughly half are likely to be complemented by AI and half more likely to be substituted
Around 60 per cent of employment in advanced economies is exposed, but about half of that is likely to be complemented because the work involves responsibility, physical presence or high stakes.In Hansa's metric OQM-HM-CLM-01, when is rubber-stamping suspected?
Show the answer
A. When fast approvals are high and the team also misses seeded errors or overrides too seldom
No single signal decides: a fast approval is suspicious only in combination with weak seeded detection or a low override-to-error ratio, measured at team level over one calendar month.How does the verdict grade the claim that AI will make human work obsolete?
Show the answer
C. It rests on argument and exposure estimates; mass obsolescence is speculation
Skill erosion is a pattern at scale for ordinary automation and at most a laboratory demonstration for generative AI; measured employment effects are limited, so obsolescence stays speculation.