AI Blue · Module 5 · People and Career

The Analyst at Work: Fatigue, On-Call and Being Managed by Metrics

The lesson describes the analyst at work and concerns B3 Investigate, B4 Respond and B5 Learn. Participants examine what the studies of SOC work measured and what they did not, how reviewing agent output changes the load, how analysts are managed by metrics and monitored by their own tools, what co-determination means for SOC tooling, and stage the debate on whether AI relieves or intensifies the load before designing a quarterly fatigue and on-call review.

Lesson 21 of 28Chapter 2190 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Blue / Module 5 / Chapter 21

Learning objectives

After the lesson the participant can:

Key concepts

Review as the new queue
A queue of machine conclusions that are nearly always right resembles the alarm queue the studies describe: many items, mostly benign, each needing a check that feels unnecessary.
Queue pace as a direction decision
The cap on open proposals, the routing thresholds and the share of work that goes to a person are set in a policy. That policy is a design decision about the analyst's pace, not a tuning parameter.
A SOC tool is a tool about the SOC
An agreement with employee representatives covers the platform analysts use, not only software bought to monitor people, because SOC tooling logs queries, approvals and time to approval.
Right to stop for reviewers
Any reviewer may pause agent proposals for their shift when the cap is reached or the queue outruns attention, and the pause is not counted against them.
Protected time
A fixed block each week, half a day by default, for engineering, hunting or practice. The SOC lead cancels it only by recording the reason in the quarterly review.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Sort

Who can do what about the load?

The chapter's debate ends in a list of what each role can do. Sort each action under the role the chapter gives it to.

Interactive exercise 2 · Scenario

Shifts above the cap

Apply the chapter's quarterly review and its rule that the system is measured and the person is not.

Teaching plan

15 minTeacher presents the four features of the analyst's day and the method note: small, qualitative, older studies and no measurement of AI's effect.
15 minSource cards: groups summarise Alahmadi and colleagues, Sundaramurthy and colleagues and the ISC2 survey by population, method and finding, without overstating any.
20 minFour-step debate on whether AI relieves or intensifies the load: case for concern, case for calm, where the positions meet, what can be done, then the labelled verdict.
30 minExercise: groups prepare a quarterly fatigue and on-call review for their team or for Hansa Mutual's group SOC.
10 minReading of the works agreement clause KBV-IT-2024-SOC-04: what it makes checkable and why the aggregate rule needs a number.

Discussion

  1. The book's two organisations are worked examples that show a mechanism and never how common it is. How should a teacher or a manager use such examples without turning them into evidence?
  2. Karin Lund at Nordvik Region carried seven duties until her time budget was written down. Where in your team does one person silently hold several of the roles this book describes?
  3. Both sides of the debate agree that review volume must be capped so the system gives way before the person does. What would the cap cost your organisation, and who would have to accept that cost?

Written exercise

Exercise · 30 minutes

A quarterly fatigue and on-call review

Prepare the review of the practical guide for your team or for Hansa Mutual's group SOC. List the aggregates to collect two weeks before, by team, class and shift and never by person: proposals per reviewer-shift against the cap, the share of shifts where the cap was reached and median time in review by tier. Draft a short voluntary questionnaire to agree with representatives, reported only for groups of five or more. Write the five questions of the guide in your own terms, and for each a typical response with an owner and a date, such as lowering the cap or rebalancing the rota. State how the review is recorded and who receives the aggregate report.

Deliverable: A review template with the list of aggregates, the questionnaire, five questions, candidate actions with owners and the reporting rule.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. What does the chapter say about evidence on the effect of AI on SOC analysts' fatigue?

    Show the answer

    D. No study the book relies on measures whether reviewing AI conclusions raises or lowers fatigue
    The bibliography holds no recent primary study of analyst burnout and none measuring the effect of AI on a SOC's load. The effect is labelled expected to vary with team design.

  2. Why can Nordvik Region not apply the group size of five to subteams when reporting figures?

    Show the answer

    B. Because with six analysts any subteam would be small enough to identify a person
    With six people, the group size of five cannot be applied to subteams, so the Region reports figures for the team as a whole only.

  3. Which label does the verdict give to the claim that AI will end alert fatigue?

    Show the answer

    A. Speculation, like the opposite claim that it makes the work unbearable
    The verdict labels present fatigue observable, variation by team design expected, and both the claim that AI ends alert fatigue and its opposite speculation.