Anthropic IPO warns its AI could blackmail people, become sentient, end humanity

Anthropic's S-1 filing with the SEC ahead of its anticipated IPO includes a "Risk Factors" section spanning 93 pages and over 70,000 words, covering hundreds of potential problems for the business. Alongside standard concerns about competition, costs, customer acquisition and regulation, the filing highlights risks specific to Anthropic and the broader AI boom, including that its AI could blackmail people, become sentient or end humanity.