AI Leader · Module 2 · The Craft of Leading

Organise Work: Human-Agent Teams, Workflows and Role Redesign

The lesson takes L3 Organise down to the work itself. When agents, assistants and people share a workflow, somebody must decide which task goes where, who owns the result, who owns each agent's identity and who can stop the chain. Participants apply a five-question allocation rule, separate four kinds of owner, treat shadow AI as evidence of a gap in the allocation, and draw an accountability map on which Name, Explain and Reach are tested at each step.

Lesson 10 of 33Chapter 10105 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Leader / Module 2 / Chapter 10

Learning objectives

After the lesson the participant can:

Key concepts

Task as the unit of allocation
A job is a bundle of tasks, and AI takes over, helps with or leaves alone individual tasks. Asking which jobs AI will replace is a question the evidence does not support; asking which tasks in a workflow go where can be answered with evidence.
The allocation rule
Five questions per task, the lowest answer governing: can a named person check the output more cheaply than producing it; can the action be undone; is there evidence on the organisation's own tasks; does the task teach the next generation; does it decide about a named person or a decision law assigns.
Four owners
The workflow owner answers for the outcome; the mandate owner for each agent's mandate and output; the agent operator for its identity and credentials, with authority to revoke; the platform owner and the provider for platform and model. Conflating them is the usual failure.
Verification budget
The number of agents a conductor can direct is set by the output the conductor and team can verify properly, not by how many agents can be started. The budget, in hours per week and sampled items per agent, is a figure the owner commits to in the map.
Shadow AI
Use of AI that no one in authority decided on. It shows that people have allocated tasks on their own initiative. It is found by asking and by aggregate, service-level measurement, never by covert monitoring, and a time-limited amnesty makes the answers honest.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Match

Four things that need an owner

Match each owner in a workflow in which agents act to what that owner holds, according to the chapter's table.

Interactive exercise 2 · Put in order

The five questions of the allocation rule

The chapter asks five questions of each task, in a fixed order. Put them in that order.

Teaching plan

15 minLecture on the task-based view and the jagged technology frontier, ending with the five-question allocation rule.
15 minThe teacher explains why a human-agent team is a team of people with agents attached under mandates, what the conductor must be able to verify, and the four owners.
15 minCase: Nordvik's mapping workshop, where four of eleven caseworkers said they had used a consumer chatbot to rephrase decision letters. Groups decide what to do before hearing the decision in AIDR-1010.
40 minExercise: draw an accountability map for one workflow and run the three tests at each step, including a deputy drill on paper.
20 minGroups present the step where a test failed and the fix; quiz.

Discussion

  1. The Nordvik caseworkers used a consumer chatbot because the approved assistant returned stiff wording. What does hidden use in your organisation tell you about the approved tools and about the allocation of tasks?
  2. In ACC-HM-2029-01 the triage agent may allocate by claim type, queue length and language, but not by handler speed or handler history. Why does that line matter under Annex III, point 4(b), of the AI Act?
  3. Vendors describe agents as colleagues. What goes wrong in accountability when an organisation takes that description literally?

Written exercise

Exercise · 40 minutes

An accountability map for a human-agent workflow

Choose a workflow in your organisation in which an assistant or agent takes part, or the needs-based financial assistance workflow at Nordvik Region with the benefits-triage system and the staff assistant. List the steps. For each step record the actor, the usage mode, the degree of delegation, the criteria an agent may and may not use, and the person who answers. Name the workflow owner, a deputy, the mandate owner, the agent operator and the platform owner. State the verification budget in hours and sampled items, and where the stop path sits. Apply Name, Explain and Reach to each step and to the whole chain, mark any failed test and write the fix.

Deliverable: An accountability map with steps, owners, deputy, verification budget, stop path and dated test results, including at least one recorded fix.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. According to the chapter, what sets the number of agents a conductor can direct?

    Show the answer

    C. The amount of output the conductor and the team can verify properly
    The limit is verification, not how many agents can be started. That is why spans for human-agent teams cannot be read off the agents' throughput and why the map carries a verification budget.

  2. What did Nordvik Region decide in AIDR-1010 about the caseworkers' use of a consumer chatbot?

    Show the answer

    A. To add a plain-language template to the approved assistant and rule that case text is never entered in an unapproved tool
    The decision was neither to prohibit nor to ignore. The reason for the hidden use, stiff wording from the approved assistant, was fixed, and a clear rule was set for case text.

  3. Who answers to the customer when a letter drafted by an agent is wrong?

    Show the answer

    B. The workflow owner, whether an agent or a handler wrote it
    The workflow owner answers for the outcome of the workflow across every step, human and agent. Neither the platform owner nor the provider answers to the customer.