AI Threat · Module 3 · Society and Truth

Work, Skills and the Ironies of Automation

The lesson tests T8 at the scale of work. Participants separate exposure from replacement, read the productivity evidence with its unevenness, and learn Bainbridge's four ironies of automation and how generative AI sharpens them. They see why rubber-stamping is the expected end state of oversight that does not keep the overseer practised, learn four principles for redesigning work, and define a team-level oversight-quality metric that respects consultation rights.

Lesson 14 of 35Chapter 1490 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Threat / Module 3 / Chapter 14

Learning objectives

After the lesson the participant can:

Key concepts

Exposure is not replacement
Exposure indices measure where the technology could touch work, not what employers will do. They show reliably where change will concentrate: cognitive, office and clerical work, disproportionately at the start of a career.
The automation spiral
The system takes over routine work, the human role shrinks, practice falls, skills erode and the case for more automation grows. Each turn is reasonable on its own, so it has to be interrupted by design.
Rubber-stamping
Approval rates rise and time per approval falls until the approval records that a person was present, not that a person judged. It is the expected end state of oversight not designed to keep the overseer practised.
Seeded-error drill
Known-wrong synthetic proposals inserted among those reviewed, never executed and revealed afterwards with feedback, as airport security does to keep baggage screeners alert. The guide's default is one in 250.
So-so automation
Acemoglu and Johnson's term for technology chosen mainly to cut labour costs, which displaces workers without large productivity gains. It is why the people who do the work should take part in its redesign.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Put in order

The automation spiral

Put the turns of the automation spiral in the order in which the chapter's figure connects them.

Interactive exercise 2 · Scenario

An override ratio that is too high

Apply the oversight-quality metric for Hansa Mutual's claims-triage agent.

Teaching plan

15 minThe teacher presents the exposure estimates and the productivity evidence; participants restate each headline number as what it measures and what it does not.
15 minWalk through the four ironies and Figure 14.1; participants locate a team they know on the spiral and say which turn it has reached.
15 minPresent the four principles for redesigning work and the nine-step guide, including why a metric that observes approvals is itself a monitoring system needing consultation.
35 minExercise in groups: define an oversight-quality metric for one human-in-the-loop process modelled on OQM-HM-CLM-01, with signals, a combination rule, privacy rules and responses.
10 minStage the debate between obsolescence and adaptation and review the three-part verdict on T8 at the scale of work.

Discussion

  1. In the customer-support study those whose practices were captured received little of the benefit. What would a fair arrangement look like for experienced staff whose know-how an assistant spreads to others?
  2. Approval time alone is a poor signal, since a quick approval of an obvious case is good practice. Which combination of signals would convince you that a team has stopped judging?
  3. The guide says a cause in workload or targets is a management finding, not a training need. Why does that distinction matter for whether staff will trust the metric?

Written exercise

Exercise · 35 minutes

An oversight-quality metric that detects rubber-stamping

Choose a process in which people approve proposals from an AI system, in your organisation or Nordvik Region's benefits unit. First list the two to four oversight-critical skills and the cases where the system is known to be weak. Then define a metric with at least three signals, for example seeded detection rate, override-to-error ratio, fast-approval share and fallback-drill accuracy, each with an alert threshold. Write the rule that combines them so that no single signal decides. State the unit of analysis, the minimum group size, the prohibition on individual reporting and on use in performance evaluation, and which workers' representatives must be consulted before go-live. List the responses when rubber-stamping is suspected.

Deliverable: A metric definition with skills map, three or more signals with thresholds, a combination rule, privacy and consultation rules, and responses.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. What did IMF staff estimate about exposed jobs in advanced economies?

    Show the answer

    D. Roughly half are likely to be complemented by AI and half more likely to be substituted
    Around 60 per cent of employment in advanced economies is exposed, but about half of that is likely to be complemented because the work involves responsibility, physical presence or high stakes.

  2. In Hansa's metric OQM-HM-CLM-01, when is rubber-stamping suspected?

    Show the answer

    A. When fast approvals are high and the team also misses seeded errors or overrides too seldom
    No single signal decides: a fast approval is suspicious only in combination with weak seeded detection or a low override-to-error ratio, measured at team level over one calendar month.

  3. How does the verdict grade the claim that AI will make human work obsolete?

    Show the answer

    C. It rests on argument and exposure estimates; mass obsolescence is speculation
    Skill erosion is a pattern at scale for ordinary automation and at most a laboratory demonstration for generative AI; measured employment effects are limited, so obsolescence stays speculation.