AI Red Team · Module 4 · Protect

Identity, Authentication and Access for People, Agents and Machines

The lesson covers PR.AA Identity Management, Authentication, and Access Control. Participants distinguish three populations of identity, decide whose identity an AI acts with in each usage mode, design task-scoped agent credentials with no ambient authority, plan the move to phishing-resistant authentication including sessions, recovery and the service desk, harden approvals against synthetic media, and use AI in access governance without letting it become the risk.

Lesson 14 of 28Chapter 1490 minutes

Read the chapterThe whitepaperThe slides

All courses / AI Red Team / Module 4 / Chapter 14

Learning objectives

After the lesson the participant can:

Key concepts

No ambient authority
The agent holds no standing permission merely by existing. A credential is issued for one task by a broker outside the agent's runtime, valid for minutes and never shared. Shared credentials let one compromise reach every component and destroy attribution.
Delegated token
A delegated token says who delegated, to which agent, for which task and for which legal entity, and the receiving system decides on all four. A token that names its task and entity cannot be reused for another task or market.
Phishing-resistant authentication
Authenticators such as FIDO2 security keys, platform passkeys and smart cards bind the authentication to the requesting origin, so a credential presented to a look-alike domain does not work at the real one. The user can still be deceived, but the deception yields nothing reusable.
Call-back, dual control, out-of-band confirmation
Three controls that make an approval rest on a channel the requester does not control, on a second person who did not receive the request, and on a record in an authenticated system of record.
Governing AI reads and proposes
AI that prepares access reviews and detects identity misuse does not write: revocations and grants pass through the identity system's workflow with a human decision. Its input, such as display names and ticket text, is treated as attacker-controlled.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Interactive exercise 1 · Sort

Identity actions by autonomy level

Sort each identity action under the autonomy level the chapter considers suited to it, or as never delegated to AI.

Interactive exercise 2 · Scenario

A familiar voice at the service desk

Apply the chapter's rules on approvals to a call at an organisation like yours.

Teaching plan

15 minThe teacher presents the three populations of identity and whose identity AI acts with in each usage mode, with the two problems of acting through a person's session.
15 minRead the credential profile of HM-SEC-001: scopes per autonomy level, denied permissions, entity binding and revocation within sixty seconds.
15 minDiscuss phishing-resistant authentication, the order of migration by account value, and why sessions, recovery and the service desk become the next targets.
35 minExercise: groups harden one approval process against synthetic media and express the rule as policy, then draft a credential profile for one agent.
10 minGroups test each other's approval rule by proposing a request that looks and sounds genuine, and check that the rule still refuses it.

Discussion

  1. The price of giving an agent its own identity is owning a privileged non-human actor that can be steered by its input. When is that price worth paying, and what makes it bearable?
  2. Why must a person who delays a senior request to complete verification never be penalised, and how would you make that credible in your organisation?
  3. Vendor AI in identity-protection products may block a sign-in or force a reset automatically. How would you find out which controls act automatically and how to override them?

Written exercise

Exercise · 35 minutes

Harden an approval and draft an agent credential profile

Part one: choose a high-risk approval in your organisation or Nordvik Region's supplier payment change. List the untrusted channels, name the trusted contact source, and write a rule that requires call-back to the registered contact only, a second approver who did not receive the request, out-of-band confirmation in the system of record and a cooling-off period, with what happens on violation and how long evidence is kept. Part two: for one agent, write a credential profile in the structure of the HM-SEC-001 extract: issuer outside the runtime, token lifetime and bindings, scopes with autonomy level per action, denied permissions an attacker would want most, entity binding and stop-path holders with a revocation time.

Deliverable: One approval rule as policy with required controls and violation handling, and one agent credential profile with scopes, denials, binding and revocation.

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

  1. Which permissions does the credential profile of HM-SEC-001 deny outright?

    Show the answer

    D. Assigning roles, resetting credentials and writing detection rules
    The profile denies role assignment, credential reset and writing SIEM rules, the permissions an attacker who steers the agent would want most. Session revocation and workstation isolation are its two reversible Level 3 Bounded actions.

  2. Why does a phishable fallback factor left enabled undo a migration to phishing-resistant authentication?

    Show the answer

    B. Because an attacker simply selects the fallback
    The chapter states that an attacker simply selects the phishable fallback, so each group's migration is done only when fallbacks are removed. The measurable goal is the share of accounts with no phishable factor enabled.

  3. In Hansa Mutual's approval policy, what does rule APR-02 require for a claims payment above the threshold routed through the Polish service centre for a Swedish claim?

    Show the answer

    A. A second approver who sits in the paying entity
    APR-02 requires the second approver to sit in the paying entity, so a request routed through the Polish service centre for a Swedish claim still needs a Swedish approver.