All courses / AI Threat / Module 2 / Chapter 7
Learning objectives
After the lesson the participant can:
- Distinguish performance with the tool from learning without it, and explain why the distinction decides how AI in education is judged.
- Describe the design features that separate a tutor from an answer engine.
- Identify which education uses fall under Annex III, point 3, and Article 5(1)(f) of the AI Act, and which the Act leaves to the institution.
- Draft a learning policy that classifies tasks into unaided, tutor and tool lanes with an unaided measurement.
Key concepts
- Desirable difficulty
- Conditions that make learning feel harder, such as retrieval from memory, spaced practice and attempting a problem before seeing the solution, produce better retention than conditions that feel fluent. The effort is to a large extent the learning.
- Performance versus learning
- Performance is what a person produces with the support present; learning is what remains when it is removed. Performance can rise while learning falls, which makes the harm hard to see.
- Answer engine and tutor
- The same assistant can produce finished work that the learner copies, or withhold the answer, ask for an attempt first, give graded hints and ask for the reasoning back. Design, pedagogy and assessment decide the path.
- The apprenticeship problem
- Professions make experts by having novices do routine work under supervision. Generative AI is best at exactly that work, so the skill may never be built by people later expected to supervise the system.
- Three lanes
- Unaided: practice and assessment of a named skill. Tutor: practice with a tool that withholds answers and gives graded hints. Tool: AI permitted and disclosed where the skill is not being learned. Every task defaults to unaided until classified.
Interactive exercises
Do them here and get feedback at once. Choose a card and then where it belongs, or drag it.
Interactive exercise 1 · Sort
Three lanes in a graduate programme
Sort each task from Hansa Mutual's graduate-programme policy, and each description from the practical guide, into the lane it belongs to.
Interactive exercise 2 · Scenario
A detection score and an essay
Apply the chapter's section on assessment after generative AI.
Teaching plan
| 12 min | The teacher introduces desirable difficulty and Table 7.1, then presents the randomised experiment: three groups, practice results and the unaided examination. |
| 10 min | Participants discuss the narrow claim the evidence supports strongly and the broad claim it supports weakly, then review children, age defaults and the apprenticeship problem. |
| 13 min | Walk through assessment after generative AI and the AI Act provisions for education; participants sort five example tools into high-risk, prohibited or left to pedagogy. |
| 30 min | Exercise in groups: write a three-lane policy for a real course or graduate programme using Hansa Mutual's AIDR-0470 as a model, including a monitoring trigger. |
| 10 min | Close with the debate, noting that both sides read the same experiment, and the verdict on T8 and T9. |
Discussion
- Both the case for concern and the case for calm start from the same experiment. What does each side take from it, and what would a multi-year cohort study need to measure to move either?
- Hansa's graduates may not approve the claims-triage agent's actions until they have passed an oral defence. What does that rule imply about who should hold approval rights in your organisation?
- The chapter says slower junior work is the price of the next generation of experts. Who in an organisation has the incentive to pay that price, and who has the incentive to avoid it?
Written exercise
Exercise · 30 minutes
A three-lane AI policy for learning
Choose a course you teach or a graduate or trainee programme in your organisation. Following the eight steps of the practical guide, name the skills AI can perform that must still be built at this stage. Classify at least eight tasks into the unaided, tutor and tool lanes, defaulting to unaided. State the design requirements for any tutor, the age defaults if learners are children, and how at least half of the evidence for each graded assessment will be observed. Define one unaided measurement per term and a monitoring trigger with the action that follows, as in AIDR-0470.
Deliverable: A policy record listing skills, tasks by lane, observed assessments, an unaided measurement and a monitoring trigger with its consequence.
Self-test
Choose an answer to see whether it is right, or open the answer below each question.
In the randomised experiment in a Turkish high school, what happened to students who practised with the standard chat interface?
Show the answer
D. They did better in practice but around 17 per cent worse on the unaided examination
Practice performance rose by around 48 per cent, but unaided examination results were around 17 per cent worse than the control group; many students used the assistant as a crutch.What did the tutor configuration in the same experiment achieve?
Show the answer
A. It largely removed the harm to learning but produced no significant gain on the examination either
The tutor more than doubled practice performance without reducing learning, yet gave no significant examination gain: harm can be designed out, but large gains have not yet been designed in.Which education use does the AI Act prohibit under Article 5(1)(f), according to the chapter?
Show the answer
C. AI systems that infer emotions in education institutions, except for medical or safety reasons
Marking, ranking and proctoring fall in principle under the high-risk category of Annex III, point 3, while emotion inference in education institutions is prohibited. Homework use is left to the institution's pedagogy.