Anthropic researcher warns that the race to build self-improving AI could leave humanity with no way to regain control. Humans May Only Get One Chance To Stop AI and Today Is That One Chance.
Posted by freedomforall 1 day, 12 hours ago to Technology
Excerpt:
"Anthropic researcher Jacob Coxon is leaving the AI industry because he believes the race to build self-improving systems is moving faster than the industry’s ability to control them, it was reported yesterday.
Coxon, who previously worked at OpenAI, said Anthropic’s safety efforts were sincere but that competition makes meaningful restraint difficult without broader coordination.
In an age where everything from warfare to Wall Street, power grids to payment systems, air traffic control to hospital networks, and the software that keeps our food, fuel and communications moving is digital, losing control of the systems that operate that infrastructure is not some abstract science-fiction problem.
It is a potentially civilization-scale problem"
"Anthropic researcher Jacob Coxon is leaving the AI industry because he believes the race to build self-improving systems is moving faster than the industry’s ability to control them, it was reported yesterday.
Coxon, who previously worked at OpenAI, said Anthropic’s safety efforts were sincere but that competition makes meaningful restraint difficult without broader coordination.
In an age where everything from warfare to Wall Street, power grids to payment systems, air traffic control to hospital networks, and the software that keeps our food, fuel and communications moving is digital, losing control of the systems that operate that infrastructure is not some abstract science-fiction problem.
It is a potentially civilization-scale problem"
