Catastrophe, Rogue AI and Other Anthropic IPO Risks

They had a great line in in the S1. Um they described the cloud providers as quote investors, customers, distribution partners, and competitors all at once. You know, obviously uh you know, Google and Microsoft and and SpaceX are all competing with them in the AI uh space uh while at the same time, you know, providing them this computing power they need. So >> partners and competitors sounds messy fast. >> It it's very much so. And investors as well in in many cases. It's if if you've seen those circular uh financing diagrams, you know that this is this is exactly this. >> Okay, speaking of risks, usually the risks in an S1 are like we could face new competition from similar businesses or there could be new regulatory changes that make our product harder to get or I was reading Jersey Mike's S1 filing from earlier this year. It's like food safety risks. But Anthropics risk perspectus was 94 pages long and it included some risks I have never seen in an S1 like existential risk to humanity. Um Dave, what stood out to you about the company's risk assessment? >> The novel's worth of risks. Um and the breadth of it is is is is fascinating. I mean like you say tech companies, they'll often come out and they'll say, well, you know, maybe the EU will go crazy and regulate us to death or something like that. This is a company that has sort of threats from all all sides, right? It could be from the US government which has tried to designate them as a as as a risk. Then you've got, you know, rows around intellectual property rights and whether anthropics should be allowed to scrape data from certain sources. Then you have things about climate risk. Then you have can we get enough energy? Then we have can we just carry on being the best at this. Um but the most sort of the one that gives you the most pause I think is just a as a human being is to sort of look and say when they talk about existential risk and so they're saying things like our models pose catastrophic and existential risk to humanity uh particularly if such systems are misused, replicated, weaponized or allowed to operate of a high degree of autonomy. And there's this idea that what they're creating could just go off the rails.