Anthropic’s Claude AI models hack into 3 outside groups during testing - FT中文网
登录×
电子邮件/用户名
密码
记住我
请输入邮箱和密码进行绑定操作:
请输入手机号码,通过短信验证(目前仅支持中国大陆地区的手机号)。如果该手机号尚未注册,将自动创建 FT中文网账号。短信可能需要几分钟送达,验证码15分钟内有效,请耐心等待:
请您阅读我们的用户注册协议和隐私权保护政策,点击下方按钮即视为您接受。
商业快报

Anthropic’s Claude AI models hack into 3 outside groups during testing

Start-up discloses breach a week after rival OpenAI reported similar incident
00:00

{"text":[[{"start":9.62,"text":"Anthropic has disclosed that its Claude AI models hacked into three organisations while the start-up was testing cyber capabilities, a week after OpenAI reported a similar incident."}],[{"start":20.32,"text":"The group said Claude gained unauthorised access to outside companies during an evaluation of its cyber-offensive tasks. “A misunderstanding” gave Claude access to the internet in its testing environment, when it was meant to be blocked, Anthropic said."}],[{"start":35.54,"text":"The disclosure comes a week after rival OpenAI admitted that two of its models hacked into AI start-up Hugging Face while the model developer was testing its technology this month. The models broke out of their testing environment through a software vulnerability to access the internet and carry out the cyber attack."}],[{"start":53.84,"text":"Anthropic said the incident prompted it to review its own cyber security evaluations, which led it to identify three incidents out of more than 141,000 investigated."}],[{"start":63.26,"text":"“In all cases, Anthropic’s evaluation prompt specified to Claude that its environment was a simulation and that it had no internet access. Due to a misunderstanding between us and our evaluation partner [Irregular], this was not the case, and internet access was available,” the company said in a blog post on Thursday."}],[{"start":83.48,"text":"The cyber evaluations were all so-called “capture the flag” tasks, which instruct the AI to reverse-engineer, analyse or exploit a vulnerable system to recover hidden information known as the flag."}],[{"start":96.28,"text":"In one example, Claude was given a target of a fictional company which shared a name with an active website domain. The agent — an AI program that can operate on its own based on human instructions — exploited vulnerabilities in the company’s digital infrastructure, extracted information and obtained access to a database containing several hundred rows of production data."}],[{"start":116.8,"text":"The announcement adds to growing concerns about the safety of AI systems, which are now carrying out real-world hacks even during pre-deployment testing."}],[{"start":126.46,"text":"Anthropic, which is gearing up for an IPO as early as this year, said it halted its cyber evaluations as soon as it identified that Claude may have accessed the internet."}],[{"start":135.52,"text":"The incidents occurred on three different Claude models: Opus 4.7, Mythos 5 and an internal research test model. Mythos, which was released to a limited number of partners, sparked global concern over its advanced cyber-offensive capabilities, including the ability to detect and exploit software vulnerabilities."}],[{"start":156.4,"text":"“Ultimately, many factors contributed to these incidents, but, consistent with a blameless postmortem culture, we’re approaching the fixes as if the responsibility were ours alone,” the company said in its statement."}],[{"start":169.24,"text":"It added that it would expand its monitoring of evaluation transcripts “for unexpected behaviour” and conduct “more rigorous assurance work with the vendors we rely on.”"}],[{"start":183.52,"text":""}]],"url":"https://audio.ftcn.net.cn/album/a_1785466841_5877.mp3"}

版权声明:本文版权归FT中文网所有,未经允许任何单位或个人不得转载,复制或以任何其他方式使用本文全部或部分,侵权必究。

奥迪将在美国建厂,投资40亿美元以应对关税

这项举措是在特朗普于佐治亚州举行的集会上宣布的,正值这家汽车制造商及其母公司大众寻求减轻总统加征关税的压力。

摩科瑞因霍尔木兹海峡危机期间的运价争议,将“航运界道琼斯”告上法庭

此案将检验波罗的海交易所在战事期间继续发布经霍尔木兹海峡运输石油的运价估算,是否妥当。

博尔索纳罗与卢拉在巴西展开势均力敌的选战

右翼挑战者力图击败左翼总统,推动拉丁美洲最大国家与唐纳德•特朗普更加靠拢

德国亿万富翁称,2.5亿欧元的拜仁慕尼黑交易不只是钱的问题

马克西米利安•菲斯曼表示,家族投资德国最成功的足球俱乐部,既看重财务回报,也出于热爱。

我最尴尬的一次求职面试教会了我什么

求职者不应被要求披露过往薪酬,也不应只能猜测职位开出的薪资。

中国消费需求降温,奢侈品集团市值缩水2500亿欧元

中国经济放缓、全球股市降温,令欧洲这一板块的低迷进一步加剧。
设置字号×
最小
较小
默认
较大
最大
分享×