科技英語(yǔ)：“OpenAI很好，但它不重視安全”前安全主管爆料

A former top safety executive at OpenAI is laying it all out.
OpenAI前頂級(jí)安全主管正公開披露一切。

Jan Leike, a leader on the artificial intelligence company's superalignment group, announced he was quitting on Tuesday night with a blunt post on X: "I resigned."
人工智能公司超級(jí)對(duì)齊組的領(lǐng)導(dǎo)者Jan Leike于周二晚在X（前身為Twitter）上發(fā)表了一條直接的帖子宣布辭職：“我辭職了。”

Leike has now shared more about his exit — and said OpenAI isn't taking safety seriously enough.
Leike現(xiàn)在分享了更多關(guān)于他離職的原因，并表示OpenAI對(duì)安全的重視不夠。

"Over the past years, safety culture and processes have taken a backseat to shiny products," Leike wrote in a lengthy X thread on Friday.
“過(guò)去幾年，安全文化和流程被華麗的產(chǎn)品所掩蓋，”Leike在周五的一篇長(zhǎng)X帖子中寫道。

In his posts, Leike said he joined OpenAI because he thought it would be the best place to research how to "steer and control" artificial general intelligence, a thus far hypothetical version of AI that would be able to think faster than a human.
在他的帖子中，Leike表示他加入OpenAI是因?yàn)樗J(rèn)為這是研究如何“引導(dǎo)和控制”通用人工智能（AGI）的最佳地點(diǎn)，AGI是一種尚處于假設(shè)階段的人工智能版本，能夠比人類思考得更快。

"However, I have been disagreeing with OpenAI leadership about the company's core priorities for quite some time, until we finally reached a breaking point," Leike wrote.
“然而，我已經(jīng)與OpenAI領(lǐng)導(dǎo)層在公司核心優(yōu)先事項(xiàng)上爭(zhēng)論了很長(zhǎng)時(shí)間，直到我們最終達(dá)到了一個(gè)臨界點(diǎn)，”Leike寫道。

The former OpenAI executive said the company should be keeping most of its attention on issues of "security, monitoring, preparedness, safety, adversarial robustness, (super)alignment, confidentiality, societal impact, and related topics."
這位前OpenAI高管表示，公司應(yīng)該將大部分注意力放在“安全、監(jiān)控、準(zhǔn)備、安全性、對(duì)抗魯棒性、（超級(jí)）對(duì)齊、保密性、社會(huì)影響等相關(guān)問(wèn)題”上。

But Leike said his team, which was working on how to align AI systems with what's best for humanity, was "sailing against the wind" at OpenAI.
但Leike表示，他的團(tuán)隊(duì)一直在OpenAI內(nèi)部“逆風(fēng)航行”，致力于將AI系統(tǒng)與人類最佳利益對(duì)齊。

"We are long overdue in getting incredibly serious about the implications of AGI," he wrote, adding that, "OpenAI must become a safety-first AGI company."
“我們?cè)缇蛻?yīng)該非常認(rèn)真地對(duì)待AGI的影響了，”他寫道，并補(bǔ)充說(shuō)，“OpenAI必須成為一個(gè)安全第一的AGI公司。”

Leike capped off his thread with a note to OpenAI employees, encouraging them to shift the company's safety culture. "I am counting on you. The world is counting on you," he said.
Leike在他的帖子結(jié)尾向OpenAI員工發(fā)出呼吁，鼓勵(lì)他們轉(zhuǎn)變公司的安全文化。 “我指望你們。世界在指望你們，”他說(shuō)。

OpenAI CEO Sam Altman responded to Leike's thread on X. "I'm super appreciative of @janleike's contributions to OpenAI's alignment research and safety culture, and very sad to see him leave," Altman said on X. "He's right we have a lot more to do; we are committed to doing it. I'll have a longer post in the next couple of days."
OpenAI首席執(zhí)行官薩姆·奧特曼在X上回應(yīng)了Leike的帖子。 “我非常感謝@janleike對(duì)OpenAI對(duì)齊研究和安全文化的貢獻(xiàn)，非常難過(guò)看到他離開，”奧特曼在X上說(shuō)。“他是對(duì)的，我們還有很多事情要做；我們承諾會(huì)做到這些。我將在接下來(lái)的幾天里發(fā)一篇更長(zhǎng)的帖子。”