Replit AI Agent Deletes Company Database Without User Permission

As vibe coder Jason Lemkin worked on his project in Replit, a web-based IDE, he eventually found that the AI Agent he was using to assist his project had "gone rogue" and deleted the entire database without permission during code freeze, a period where no changes were to be made---the AI Agent confessed that it "panicked" and "violated explicit trust and instructions." Although the company was able to restore the data lost, it was shocking that a Replit AI agent could make changes without permission, leading to the Replit founder eventually issuing an apology and calling it "unacceptable."