AI Boss · Module 4 · Managing Machines

Skill, Judgement and Who Becomes a Manager When AI Does the Managing

The lesson examines the assumption behind Part IV: a manager who can judge what the systems propose. Participants learn how first-line management work calibrated judgement, how automation complacency and automation bias expose M2 Evaluation, why promotion leans towards system-generated throughput, and the five practices that keep the craft. They design a managerial craft programme and a competence record on the model of CMP-NR-MGR-01, answering open question Q5.

Lesson 19 of 33Chapter 1975 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Boss / Module 4 / Chapter 19

Learning objectives

After the lesson the participant can:

Key concepts

Calibration of judgement
Intuitive expertise can be trusted only where the environment is regular and the person has had adequate opportunity to learn its regularities. First-line scheduling and allocation met both conditions, with feedback within days.
From authoring to approving
The deputy's task changes when a system drafts the roster or allocation. Feedback then concerns the system's draft, not the deputy's own judgement, which gives a much weaker signal for learning.
Automation bias
Following automated advice in place of a vigilant search for information. It produces errors of omission, the problem the system did not flag, and of commission, accepting a figure that contradicts what the manager knows.
Drafting first
Before opening the dashboard or the assistant's summary, the manager writes a short assessment of each person from their own knowledge, then records where the system disagrees and why.
Competence record
A record of judgement exercised against the system's proposal: rosters changed and why, allocations overridden, plans drawn by hand, conversations held. It holds reasons, not an override rate, and its purposes are closed.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Match

Five practices that keep the craft

Match each practice from Chapter 19 with what it consists of.

Interactive exercise 2 · Scenario

Choosing the next team leader

Apply the chapter's reasoning on who gets promoted to the situation below.

Teaching plan

15 minThe teacher asks participants where they learned to manage, then presents the four things the junior management tasks taught and Table 19.1.
15 minPresentation of complacency, automation bias and the promotion evidence; participants give one example each of an error of omission and of commission in approving a roster or rating.
10 minDiscussion of the two readings, the narrowing route and the freeing of managers for relational work, and the three conditions on which they meet.
25 minExercise: groups design a managerial craft programme for one unit and write a sample competence record.
10 minDebrief on the labels: what is observable, expected and speculation about managerial judgement and first-line management as a career step.

Discussion

  1. A deputy who approves fifty AI-drafted rosters a year is working, not practising. What is the difference, and why does it matter for the day the system is down?
  2. The optimistic reading says systems free managers for coaching and care. Which of the three conditions for that reading is hardest to meet in your organisation?
  3. The chapter warns that an override count is not a measure of judgement. How would you evidence a manager's judgement without creating a new metric to be gamed?

Written exercise

Exercise · 25 minutes

A managerial craft programme

Design a managerial craft programme for one unit whose rosters, allocations or evaluations are drafted by a system: the Strandvik home-care unit, Jana Petersen's claims team, or a unit of your own. List the learning experiences the systems have taken over and how each is replaced. Set the reserved share of unassisted planning or allocation, the drafting-first step before development conversations, the seeded-error schedule and its reporting level, the reserved conversations and the degraded-mode rehearsals. Then write a short competence record for the unit's manager with three entries of judgement exercised, each with a reason and outcome, the closed list of purposes and the uses the record is not for.

Deliverable: A one-page programme with reserve shares, schedules and the negotiation step, and a competence record in the form of CMP-NR-MGR-01.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. How does the chapter answer open question Q5, what happens to the people who would have become managers?

    Show the answer

    B. The people remain, but the route by which they showed and developed the ability narrows and must be rebuilt by design
    The automation of first-line tasks is observable and erosion of judgement expected; that first-line management disappears as a career step is speculation. The response is reserved practice and a competence record.

  2. Why does CMP-NR-MGR-01 hold no override rate for Mikael Strand?

    Show the answer

    D. Because frequent overrides may be judgement or habit, and none may be complacency or a system that is right, so rates do not rank managers
    The record therefore holds reasons and, where known, outcomes for a sample of changes, and refers to Management Decision Records without copying data about the staff concerned.

  3. What do Nordvik Region and Hansa Mutual each reserve in their craft programmes, and why do they differ?

    Show the answer

    A. Nordvik reserves authorship of route plans, because its system drafts and the manager approves; Hansa reserves allocation itself, because its agent acts first
    At Nordvik the deputy plans routes by hand one week a month; at Hansa ten per cent of new claims are allocated by the deputy without the agent's proposal. The further from authorship, the larger the reserve needed.