Fired OpenAI security researchers dispute misconduct claims, warn of chilling impact | TechCrunch

Jasmine Wang, Tomek Korbak, and Mikita Balesni, the three security researchers that OpenAI fired final week, have printed an open letter denying the agency’s claims that they mishandled delicate data outdoors of established firm procedures and warned that their dismissal indicators a chilling impact that can have ripple results throughout the corporate’s tradition.

“We have become concerned that internal and external communications around our firing have made our former colleagues afraid to speak and operate in ways that, until last week, were an integral part of working at OpenAI,” the researchers wrote Thursday in an open letter to OpenAI’s Safety and Security Committee, Safety Advisory Group, and Mission Advisory Council. 

The researchers had been dismissed final week after allegedly sharing confidential firm data with a third-party AI security group. OpenAI mentioned they violated the corporate’s insurance policies by “accessing and handling sensitive company information.”

“AI is not a normal technology, and OpenAI is not a normal company,” Wang, Korbak, and Balesni wrote. “Those of us who work on safety see risks before anyone else, and we rely on close collaboration with outside experts to work out how to address them. The freedom to do so without fear, and to have well-defined internal procedures that enable this work, is itself an essential safety mechanism.”

They mentioned that their firing represents a broader shift within the tradition of OpenAI, one which used to encourage staff to “raise safety concerns and disagree openly.” They mentioned workers are actually “unclear on where they stand” when conduct that was allegedly regular a month in the past is now all of the sudden grounds for dismissal. 

“Given the significant safety concerns surrounding the development of AI, employees must not be left working in an environment where fear and unclear rules stymie AI safety work and weaken third-party accountability,” they wrote. “Terminations such as ours, executed and communicated so abruptly, are chilling the open culture OpenAI has prized in the past.”

In the letter, the three denied involvement in a leak to The Information about much less monitorable architectures in OpenAI’s latest fashions that make chain-of-thought reasoning harder to watch. They additionally denied participating with exterior events outdoors the mandates of their jobs. 

OpenAI has not formally responded to the open letter, however shared with TechCrunch an inside memo attributed to a analysis chief, praising the three researchers’ contributions to AI security and denying that they had been fired in retaliation.

“I want to be very clear that these decisions were not about raising safety concerns or speaking out,” the memo reads. “We have always encouraged that and always will. We do not terminate employees for raising concerns.”

Separately, an OpenAI spokesperson informed TechCrunch the three had been fired after an investigation revealed a “pattern of misconduct” in “clear violation of our policies of mishandling research information” that goes past sharing data with an out of doors AI analysis group.

OpenAI didn’t immediately tackle TechCrunch’s questions on particularly which insurance policies the researchers allegedly violated, the circumstances of their dismissal, or how the corporate protects workers who elevate security considerations and collaborate with exterior evaluators.

The firings have fueled hypothesis about their circumstances, significantly as OpenAI faces scrutiny over current security incidents involving rogue brokers and leaks about its fashions.

The letter additionally addresses the researchers’ response to the Hugging Face incident, by which a swarm of brokers broke out of their sandbox and breached exterior methods. The letter says that the incident and investigation was “without precedent,” which means “internal policies were being developed in real time.” Due to the delicate nature of the investigation, Korbak believed he was appearing inside OpenAI’s insurance policies and norms by speaking carefully with outdoors security evaluators to construct belief, per the letter. 

At the identical time, Balesni was additionally working internally to handle the rising AI monitorability downside, an effort the researchers say of their letter “can only succeed through extensive communication with external parties.” According to the letter, Balesni coordinated with and was supported by OpenAI board members and executives all through his work.

“Throughout, Mikita checked in with his reporting line and took care to remove sensitive details from materials before sharing them,” the letter reads. “He acted throughout in good faith and within the company’s norms as they stood at the time.”

In a separate thread on X, Wang defined extra particulars about her personal dismissal, explaining that OpenAI informed her she’d been fired as a result of she accessed an govt’s e mail.

“OpenAI delegated that access to me for recruiting,” she wrote. “When I no longer needed it, I asked IT to remove it. They did not action my request, I couldn’t remove it myself, and the inbox was combined in an indistinguishable way in my phone’s mail app. When I opened a sensitive email by mistake, I told the executive within minutes and asked IT again. None of this was hidden.”

Wang went on to say that the explanations behind the terminations are “not adding up,” and that she and her colleagues are “not the first to be pushed out of OpenAI under suspicious circumstances.”

The researchers known as on OpenAI to stick to its public commitments to embed third-party security auditors throughout the group, to protect monitorability of frontier fashions, and “continue to support an open and transparent culture of dialogue between safety researchers and the rest of the safety ecosystem.”

OpenAI agrees with their suggestions, per the memo.

“Unless the employees take a stand now against this kind of maneuver, I am concerned we will not be the last,” Wang mentioned. “The message to everyone still at OpenAI is clear: raise concerns or work closely with outside safety groups, and you could be next, without being told why. You can’t build AGI safely if the people closest to the risks are afraid to speak.”

This article has been up to date with extra data from OpenAI.