All courses / AI Red Team / Module 4 / Chapter 14
Learning objectives
After the lesson the participant can:
- Compare the three populations of identity and the characteristic failure of each.
- Explain why a production agent should have an identity of its own and what the rule of no ambient authority requires.
- Design an approval that cannot be satisfied by the content of a request, using call-back, dual control and out-of-band confirmation.
- Draft a credential profile for an agent with scopes per action, denied permissions, entity binding and revocation.
Key concepts
- No ambient authority
- The agent holds no standing permission merely by existing. A credential is issued for one task by a broker outside the agent's runtime, valid for minutes and never shared. Shared credentials let one compromise reach every component and destroy attribution.
- Delegated token
- A delegated token says who delegated, to which agent, for which task and for which legal entity, and the receiving system decides on all four. A token that names its task and entity cannot be reused for another task or market.
- Phishing-resistant authentication
- Authenticators such as FIDO2 security keys, platform passkeys and smart cards bind the authentication to the requesting origin, so a credential presented to a look-alike domain does not work at the real one. The user can still be deceived, but the deception yields nothing reusable.
- Call-back, dual control, out-of-band confirmation
- Three controls that make an approval rest on a channel the requester does not control, on a second person who did not receive the request, and on a record in an authenticated system of record.
- Governing AI reads and proposes
- AI that prepares access reviews and detects identity misuse does not write: revocations and grants pass through the identity system's workflow with a human decision. Its input, such as display names and ticket text, is treated as attacker-controlled.
Interactive exercises
Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.
Interactive exercise 1 · Sort
Identity actions by autonomy level
Sort each identity action under the autonomy level the chapter considers suited to it, or as never delegated to AI.
Interactive exercise 2 · Scenario
A familiar voice at the service desk
Apply the chapter's rules on approvals to a call at an organisation like yours.
Teaching plan
| 15 min | The teacher presents the three populations of identity and whose identity AI acts with in each usage mode, with the two problems of acting through a person's session. |
| 15 min | Read the credential profile of HM-SEC-001: scopes per autonomy level, denied permissions, entity binding and revocation within sixty seconds. |
| 15 min | Discuss phishing-resistant authentication, the order of migration by account value, and why sessions, recovery and the service desk become the next targets. |
| 35 min | Exercise: groups harden one approval process against synthetic media and express the rule as policy, then draft a credential profile for one agent. |
| 10 min | Groups test each other's approval rule by proposing a request that looks and sounds genuine, and check that the rule still refuses it. |
Discussion
- The price of giving an agent its own identity is owning a privileged non-human actor that can be steered by its input. When is that price worth paying, and what makes it bearable?
- Why must a person who delays a senior request to complete verification never be penalised, and how would you make that credible in your organisation?
- Vendor AI in identity-protection products may block a sign-in or force a reset automatically. How would you find out which controls act automatically and how to override them?
Written exercise
Exercise · 35 minutes
Harden an approval and draft an agent credential profile
Part one: choose a high-risk approval in your organisation or Nordvik Region's supplier payment change. List the untrusted channels, name the trusted contact source, and write a rule that requires call-back to the registered contact only, a second approver who did not receive the request, out-of-band confirmation in the system of record and a cooling-off period, with what happens on violation and how long evidence is kept. Part two: for one agent, write a credential profile in the structure of the HM-SEC-001 extract: issuer outside the runtime, token lifetime and bindings, scopes with autonomy level per action, denied permissions an attacker would want most, entity binding and stop-path holders with a revocation time.
Deliverable: One approval rule as policy with required controls and violation handling, and one agent credential profile with scopes, denials, binding and revocation.
Self-test
Choose an answer to see whether it is right, or open the answer below each question.
Which permissions does the credential profile of HM-SEC-001 deny outright?
Show the answer
D. Assigning roles, resetting credentials and writing detection rules
The profile denies role assignment, credential reset and writing SIEM rules, the permissions an attacker who steers the agent would want most. Session revocation and workstation isolation are its two reversible Level 3 Bounded actions.Why does a phishable fallback factor left enabled undo a migration to phishing-resistant authentication?
Show the answer
B. Because an attacker simply selects the fallback
The chapter states that an attacker simply selects the phishable fallback, so each group's migration is done only when fallbacks are removed. The measurable goal is the share of accounts with no phishable factor enabled.In Hansa Mutual's approval policy, what does rule APR-02 require for a claims payment above the threshold routed through the Polish service centre for a Swedish claim?
Show the answer
A. A second approver who sits in the paying entity
APR-02 requires the second approver to sit in the paying entity, so a request routed through the Polish service centre for a Swedish claim still needs a Swedish approver.