Culture, Trust and Psychological Safety in a Human-Agent Organisation

All courses / AI Leader / Module 4 / Chapter 21

Learning objectives

After the lesson the participant can:

• Explain why trust in AI is to be calibrated and not maximised, using the survey evidence and its limits.
• Describe the three points at which an assistant changes what speaking up risks: the record, the count and the draft.
• Specify a trust and safety pulse whose limits are agreed with employee representatives and enforced outside the tool.
• Describe how blameless review protects the person nearest the system while a named leader still answers.

Key concepts

Calibrated trust in the organisation

In a survey of more than 48,000 people in 47 countries, 46 per cent were willing to trust AI systems, while two-thirds of employees reported relying on AI output without critically evaluating it. Low stated trust and frequent unchecked reliance coexist, so the aim is calibration.

Psychological safety

Edmondson's shared belief that the team is safe for interpersonal risk taking, a property of teams and not of temperament, associated with learning behaviour. How it changes when assistants join a team has not been measured in European workplaces; the chapter's statements on that are its own reasoning.

Shadow AI as a trust signal

People use unapproved tools because approved ones do not do what they need or the rules are unclear, and conceal use because they expect to be judged. In the survey, reported uploading of company information to public tools was highest where generative AI was banned.

Trust and safety pulse

A short, quarterly, team-level instrument bounded by what it is for. It asks whether people can say an assistant was wrong, know what they may use and know who answers. A union or works-council delegate co-owns the limits and holds the stop right.

Blameless review

A review that focuses on contributing causes without indicting an individual and assumes people acted in good faith on the information they had. It protects the person nearest the system and leaves the decision answerable to a named leader.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Teaching plan

Discussion

1. The share of employees who reported uploading company information to public tools was highest where the organisation had banned generative AI. What does the chapter allow you to conclude from that, and what does it not?
2. The proportion who think their jobs are at risk and the proportion whose jobs are at risk are different things. What can a leader in your organisation truthfully say today about each?
3. How the organisation responds to an ordinary error in an assistant-prepared paper is called the strongest signal of whether speaking up is safe. What signal did your last such error send?

Written exercise

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

1. What narrower conclusion does the chapter draw from the survey finding on bans, policies and the uploading of company information?

   1. That bans cause employees to upload more company information
   2. That a ban and a policy document, by themselves, do not produce transparent use
   3. That organisations without a policy have the most careful employees
   4. That policies should be replaced by monitoring of individual accounts on the organisational tier
   Show the answer

   B. That a ban and a policy document, by themselves, do not produce transparent use
   The association is cross-sectional: organisations that ban may be those whose staff most want the tools. The figures do not show causation, but they do show that bans and policies alone are not enough.

2. Who co-owns the limits of Nordvik Region's pulse TSP-NR-2030-01 and holds the stop right?

   1. The CIO as owner of the staff assistant
   2. The regional director, as the recipient of the sector aggregate
   3. The supplier of the survey service under contract
   4. A union delegate from the central work-environment committee
   Show the answer

   D. A union delegate from the central work-environment committee
   The HR director owns the pulse and answers for it; the union delegate co-owns the limits. Limits enforceable by someone other than the sponsor are what keep a measure of trust from becoming a means of watching people.

3. What rule does the chapter state about using pulse results, transcripts or usage counts in decisions about a named person?

   1. They may not be an input to any decision about a named person's employment, pay, discipline or access to work
   2. They may be used for appraisal if the person has given individual consent
   3. They may be used at Level 1 Assisted when a manager reads them first
   4. They may be used for discipline only after a blameless review
   Show the answer

   A. They may not be an input to any decision about a named person's employment, pay, discipline or access to work
   Nothing in the pulse, the transcripts or the usage counts may feed such a decision at any level, and no system acts on them at Level 4. The stop right over the pulse lies outside the system.