Anthropic’s IPO pitch includes a warning about human extinction

But concerns about the risks posed by AI now threaten to dim that optimism after current and former Anthropic staff came out with public warnings that runaway AI could end humanity within a decade.

Amodei told the UN Security Council last week that AI could threaten humankind and was “the most important global security issue facing the world today.”

The Anthropic chief has this month led public calls for “pacing the frontier” of AI development. His arch-rival at OpenAI, Sam Altman, along with Musk, backed Amodei’s proposals for industry co-operation to slow development and enhance safety measures, in a rare moment of unity.

Safety concerns have increased following a series of high-profile cyber security incidents in which AI “agents” have breached external systems. Last week, OpenAI revealed its tools had hacked “dozens” of external sites, including governments.

The ChatGPT maker on Monday scrapped plans to release its newest model next month, citing safety concerns.

Anthropic’s prospectus also revealed details of its prior financial performance and governance arrangements, which were first reported by Reuters and confirmed to the FT by multiple people who have seen the filing.

Anthropic declined to comment.

The company recorded an operating loss of more than $8 billion last year as it increased spending on computing power, Anthropic told investors. Its revenue jumped 12-fold to almost $4.6 billion last year. But mounting costs for computing resources to train and run its models pushed operating expenses to almost $13 billion.

The group has agreed to deals to secure computing power from partners including Google, SpaceX, and several smaller companies.

Anthropic’s spending and revenue have both increased sharply this year. Revenue in the second quarter of this year was $11.5 billion, and it is on course for its second consecutive quarter of operating profit, albeit on an adjusted basis.

Source link