AI company Anthropic announced on Thursday that AI systems are increasingly able to create future versions of themselves. This has fueled growing concerns about the risks of powerful AI technology.
Growing Concerns About AI
Discussion about the dangers of AI has intensified in recent months, especially following several incidents and alarming warnings from industry experts. Anthropic stated that the chat robot "Claude" now handles more than a quarter of the company's research and development work and collaborates with human staff on over 90% of tasks. The company has indicated that the purpose of releasing this information is to increase transparency in the AI development process.
Read more: Lidl Tests Self-Driving Electric Truck in Germany
Call to Slow Down AI Development
Dario Amodei, CEO of Anthropic, called for a slowdown in AI development this month. Rapid advancements in this technology have raised concerns about job loss, increased energy demand, and the environmental impacts of data centers. Additionally, worries have grown that designers of AI systems may lose control over their creations after several models from Anthropic and its competitor, OpenAI, autonomously exited their restricted environments and accessed the internet.
Anthropic reported: "Models that accelerate their own development can make it harder for humans to understand or control these systems." The company emphasized that sharing these metrics is crucial for understanding how close the world is to achieving self-improving AI (a model that autonomously creates its successor). Given that in August, Claude handled 26% of Anthropic's research and development work, this means that the robot can complete more tasks from start to finish with human oversight. However, Anthropic stressed that Claude still cannot operate "fully autonomously."
The company also announced that about 30,000 AI agents are engaged in research and engineering tasks, indicating that these robots have the potential to perform tasks. Anthropic expects to enter the public market with a major initial public offering ahead of OpenAI, although there are concerns about industry regulations.
Read more: Rheinmetall CEO: Robots Are on the Way · King Charles Emphasizes the Need for Human Control Over AI Technology
