OpenAI Holds Back Astra Model Over Safety Concerns
Show transcript
GPT-6.1 What's happening? >> I mean, this is the most advanced model that people are anticipating and OpenAI, to your point, has made one of its most concrete steps to really address what it means when it said that it is, you know, here for AI pacing. I mean, pacing is a conversation heard around the world these past few weeks, and we've been waiting for the labs to tell us exactly what that looks like. And so, in this case, OpenAI OpenAI is holding back a model. Last week, it announced it is also going to be, you know, holding back training on a separate model. >> model, right? >> Yes. And, you know, there's even latest updates that they're going to give senior leaders the ability to veto certain activities. So, we're getting more data on what it looks like for one of the most valuable companies to kind of train and hold back their technology as it does things it doesn't want them to do. >> Doesn't want them to do. So, what OpenAI said was that Astra 6.1 wasn't good enough at, quote, staying within scope and authorization, which in normal people speak basically means the model wasn't sort of reliably doing what OpenAI had hoped or instructed it to do. Um but context, DevDay, typically they release new products. Anthropic has been releasing models even with the warnings at the same time. Talk about some of the commercial pressure here. >> Yeah, I mean, it's not a great look that the day before DevDay, OpenAI had to release an apology to Australia, right? Like yesterday last week, news broke that OpenAI some of its models had had a hacked some of the Australian government systems. And so, late last night, you saw OpenAI release a long blog post explaining how it's going to do right by Australia. And so, when you when you think about commercial pressures, you think about the kind of stakeholders that OpenAI wants, which is enterprise, secure, reliable clients, correct? And so, this is a challenge for them. We already have OpenAI CEO Sam Altman telling us that they're not going to go public this year anymore. And so, we'll see how much and how far OpenAI goes.


