Surveillance at Work and the Chilling Effect

All courses / AI Boss / Module 3 / Chapter 13

Learning objectives

After the lesson the participant can:

• Distinguish the data a management system requires from the further uses its by-products invite.
• Apply the criteria of the cited court and authority decisions to a monitoring arrangement.
• Compare the case for concern and the case for calm on monitoring and name the points on which they meet.
• Carry out a proportionality review that sets purpose, aggregation, access, retention and the route to M3 Consequence.

Key concepts

Requires and invites

A visit-routing system requires the start and end of each visit, not location between tasks. By-products invite further use: once times exist per person, a figure per person can be computed, then a ranking, then a pay input.

Chilling effect

When every action may enter an evaluation, helping a colleague or questioning a decision incurs an observable cost for an unobservable benefit. The chapter labels a lasting effect on voice in AI-managed workplaces as expected, not yet measured.

Suited to monitor

The German Federal Labour Court reads equipment intended to monitor objectively, so equipment is covered by co-determination when it is suited to collect information on behaviour or performance, whatever anyone intends.

Aggregation by default

Team or route before person, week before day. Individual figures need a written reason and a named role, every individual-level view is logged, and representatives may review the log.

Retention by purpose

Each data element is kept only as long as its stated purpose needs. The Conseil d'Etat upheld that keeping every indicator for every employee, undifferentiated, for 31 days breached data minimisation.

Interactive exercises

Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.

Teaching plan

Discussion

1. The H&M case involved no AI. Why does the chapter include it, and what does it show about what a management system could assemble routinely?
2. The restaurant study found less theft and higher legitimate tips, while the factory study found concealment under constant observation. What differs between the two forms of monitoring?
3. Mikael Strand keeps individual figures because he needs to see when a person's routes are consistently overrun. Where is the line between that use and evaluation of the person?

Written exercise

Self-test

Choose an answer to see whether it is right, or open the answer below each question.

1. What did Nordvik Region's review, recorded as AIDR-0604, do with the location trace the app stored between visits?

   1. It kept the trace for 24 months as a planning aggregate
   2. It stopped collecting it, keeping location only as confirmation at the start and end of a visit
   3. It made the trace visible to each worker's colleagues in the roster app, so that informal swaps between routes became easier to arrange
   4. It moved the trace into the supplier's system for model training
   Show the answer

   B. It stopped collecting it, keeping location only as confirmation at the start and end of a visit
   The trace had been used to estimate travel times; the review replaced the estimate with route-level averages, set raw events to 60 days and route aggregates to 24 months, and closed the route from dashboard figures to pay, discipline or dismissal.

2. According to the Commission's guidelines as the chapter reports them, which statement about Article 5(1)(f) of the AI Act is correct?

   1. Inference of emotions from written text is inside the prohibition, whereas inference from voice is outside it wherever the employer claims a safety reason
   2. The prohibition applies only to recruitment and not to existing staff
   3. Inference from keystrokes, facial expressions or voice is inside it, and the safety exception does not cover stress or burnout detection
   4. The Digital Omnibus removed the prohibition for employers with a works agreement
   Show the answer

   C. Inference from keystrokes, facial expressions or voice is inside it, and the safety exception does not cover stress or burnout detection
   The guidelines place inference from text outside the prohibition and inference from biometric signals inside it; the medical or safety exception does not extend to stress or burnout detection, and the Omnibus left point (f) unchanged.

3. Under the annex to KBV-IT-2024, who may see a claims handler's individual throughput figure?

   1. The handler and the handler's own team leader
   2. Every team leader in the German claims organisation
   3. The Konzernbetriebsrat and the group head of claims operations
   4. All members of the handler's team, as a ranking list
   Show the answer

   A. The handler and the handler's own team leader
   The annex limits visibility to the handler and their own team leader, prohibits ranking lists, retains figures for 13 weeks and has the works council review the access log quarterly.