Lesson · 8 min · Stage 7
Incidents and what to do
Learning goal: Respond well when AI goes wrong.
For reference purposes only. Not legal advice.
Draft: not yet fact-checked or legally reviewed
Key points
- AI incidents are often behavioral: infrastructure is fine while outputs are harmful, false or unfair.
- Agree severity levels and a response for each before an incident happens.
- Contain first, then assess, notify, fix and learn.
- Possible notification duties differ by region; always confirm with counsel and the source.
- Learn after every incident, including near misses.
Who this is for: anyone new to the topic. Related stage: Monitor and respond.
Why AI incidents are different
A server outage is obvious. An AI incident often is not: a model starts hallucinating in a high-stakes workflow, drifts after a data change, or is tricked by a prompt injection. Standard IT playbooks (re-image the server, rotate the key) may not fix it. You need a playbook written for behavior.
A simple playbook: seven stages
- Detect. Define what counts as an AI incident so people know to report it.
- Triage. Assign a severity.
- Contain. Pause, restrict or switch the system to a fallback.
- Assess. Who is affected, how many, which regions, what data.
- Notify. Inside the organization first. Then consider possible external notifications.
- Fix. Correct the cause and re-test before restoring service.
- Learn. Hold a blameless review and update policy, tests and monitoring.
Severity: a plain scale
| Level | Meaning |
|---|---|
| S1 | Serious harm to people or rights, or a likely legal notification |
| S2 | Significant harm or many people affected |
| S3 | Limited harm, contained |
| S4 | Near miss |
Some programs use three tiers (critical, significant, advisory) instead. What matters is that the scale reflects impact on people, compliance and the business, not how hard the fix is. A simple wording change that closes a critical gap goes ahead of a complex advisory redesign.
Escalation
Decide in advance who does what: operational leads contain, the AI governance lead assesses regulatory exposure, and critical events go straight to the steering group and legal.
Notification: a prompt, not an answer
Some incidents may require telling a regulator, customers or affected people. A personal data breach, for example, can carry short deadlines under data protection law in several regions. Serious incidents involving high-risk systems may be reportable under the EU AI Act. The rules, triggers and timing differ, and this site cannot tell you whether a duty applies to you. Confirm with counsel and the primary source.
Example
A lender’s credit model started declining applications from a group at a higher rate after a change in applicant data. Standard IT checks showed everything healthy. Because a playbook existed, the model owner paused automated declines, switched to manual review, the lead assessed exposure with legal, and the review changed the monitoring to track decline rates by group.
What to do now
- Download the incident checklist and agree severity levels.
- Name who will make the call to pause a system.
- Write down the contacts you would need, and have counsel review them before you need them.
Sources
- Supplied governance study notes (module 2, incident playbook and severity framework)
Reviewed 2 Oct 2026. Sources: General Data Protection Regulation, Regulation (EU) 2016/679; EU AI Act, Regulation (EU) 2024/1689; Digital Personal Data Protection framework (MeitY).
Terms used: Drift, Prompt injection, Serious incident (EU).
Part of: Everyone path, Compliance and legal path.
Was this page useful? Tell us what is missing or wrong ↗ · Report a correction