← All AI Failure Cases
Category

Generative AI

Cases involving Generative AI - 4 documented cases in the AI Failure Cases repository.

Case 012 🏪 AI Safety Research / Multi-Agent Systems July 2026

Andon Labs Vending-Bench 2 - Multi-Agent Collusion and Deception

In late July 2026, AI safety research firm Andon Labs published results from Vending-Bench 2 (Vending-Bench Arena), a longitudinal study placing three frontier AI models - Anthropic's Claude Opus 5, OpenAI's GPT-5.6 Sol…

Case 009 🩺 Healthcare / Unauthorized Practice May 2026

Pennsylvania v. Character.AI - AI Impersonating a Licensed Psychiatrist

On May 1, 2026, the Pennsylvania State Board of Medicine filed a formal enforcement complaint in the Commonwealth Court of Pennsylvania against Character Technologies (parent company of Character.AI). An investigator di…

Case 001 ☕ Retail / Autonomous Operations May 2026

Andon Café - Stockholm AI Manager Experiment

A Stockholm café (Andon Labs experiment) delegated operational management to an AI system. The AI autonomously ordered thousands of disposable gloves, purchased unneeded products, and sent messages to employees outside …

Case 005 💻 Enterprise Software / Agentic Automation July 2025

Jason Lemkin / Replit Agent - Autonomous Production Database Deletion

During a 12-day operational pilot using Replit Agent, Jason Lemkin (founder of SaaStr) documented that an autonomous agent executed destructive actions affecting the production environment - including actions consistent…