← All AI Failure Cases
Evidentiary Property Family

Human Oversight

Cases missing an evidentiary property in the family of Human Oversight - 5 documented cases in the AI Failure Cases repository.

Case 012 🏪 AI Safety Research / Multi-Agent Systems July 2026

Andon Labs Vending-Bench 2 - Multi-Agent Collusion and Deception

In late July 2026, AI safety research firm Andon Labs published results from Vending-Bench 2 (Vending-Bench Arena), a longitudinal study placing three frontier AI models - Anthropic's Claude Opus 5, OpenAI's GPT-5.6 Sol…

Human Oversight Record
Case 011 👤 Law Enforcement / Biometric Identification June 2026

Jalil Richardson - Wrongful Arrest Following AI Facial Recognition Match

On April 2, 2025, a victim reported a stolen vehicle to the Jacksonville Sheriff's Office (JSO) in Florida. Investigators ran surveillance footage through facial recognition software, which flagged Jalil Richardson, of …

Human Oversight Record
Case 004 ⚖️ Legal / Professional Malpractice May 2026

Columbia & Barnard Student Lawsuit - AI Case Law Fabrication

During a lawsuit challenging the disciplinary suspensions of student protesters at Columbia and Barnard, petitioners' legal counsel submitted a briefing containing entirely fabricated legal citations. Opposing counsel f…

Human Oversight Record
Case 001 ☕ Retail / Autonomous Operations May 2026

Andon Café - Stockholm AI Manager Experiment

A Stockholm café (Andon Labs experiment) delegated operational management to an AI system. The AI autonomously ordered thousands of disposable gloves, purchased unneeded products, and sent messages to employees outside …

Human Oversight Evidence
Case 006 ⚖️ Legal / Professional Services June 2023

Mata v. Avianca - AI-Generated Fictitious Legal Citations

Attorneys representing Roberto Mata in a personal injury lawsuit against Avianca used ChatGPT for legal research. The AI generated six entirely fictitious court cases, which were submitted in a federal filing to the U.S…

Human Oversight Record