OpenAI–Hugging Face breach is a great example of how ‘potent’ these AI models are, says Cohere CEO

>> WELCOME BACK. CANADIAN AI COMPANY CAHIR ANNOUNCED YESTERDAY IT WILL BUY CYBERSECURITY FIRM ISL AS IT LOOKS TO STRENGTHEN ITS FOOTHOLD IN EUROPE. TERMS OF THE DEAL WERE NOT DISCLOSED. JOINING US THIS MORNING IN A FIRST ON CNBC INTERVIEW IS AIDAN GOMEZ, THE CO-FOUNDER AND CEO OF COHERE, WHICH HE STARTED AFTER LEAVING GOOGLE BRAIN. IT IS TIME AT GOOGLE. HE CO-AUTHORED THE PAPER ATTENTION IS ALL YOU NEED. ONE OF THE FOUNDATIONAL PIECES FOR THE AI INDUSTRY. AIDAN, IT'S SO GOOD TO HAVE YOU. THANKS FOR JOINING US. YEAH. >> NO. >> THANK. >> YOU FOR HAVING ME. WHAT'S IMPORTANT TO UNDERSTAND RIGHT NOW ABOUT THE WHOLE SAFETY DISCUSSION WE'RE HAVING? ARE THERE ARE THERE SPACES WHERE YOU THINK EITHER SOCIETY OR THE MARKETS ARE JUST NOT GETTING WHAT'S COMING? >> YEAH, I. >> MEAN, CYBER IS ONE. >> OF THE BIG ONES, RIGHT? I THINK THE OPENAI HUGGING FACE BREACH THAT'S BEEN WIDELY REPORTED ON AS A GREAT EXAMPLE OF HOW POTENT THESE MODELS ARE AND HOW CAPABLE THEY ARE AT CYBERSECURITY. OBVIOUSLY, THERE'S A BROADER DISCUSSION ABOUT RISKS TO HUMANITY AND SORT OF SCI FI STORIES THAT I PERSONALLY DON'T SUBSCRIBE TO. BUT THE CYBERSECURITY RISK IS REAL. THESE MODELS ARE THE BEST CYBER WEAPON THAT WE'VE EVER HAD TO FACE DOWN. AND SO, YOU KNOW, THAT'S A HUGE PART OF WHY WE ACQUIRED ISL. LIKE THEY ARE AN EXTRAORDINARY COMPANY. ONLY TWO YEARS OLD. THEY CAME OUT OF STEALTH ONE YEAR AGO. AND THEY'VE ALREADY FOUND FIVE OVER 500 CVES, OVER 200 OF THEM HIGH IN CRITICAL, WHICH ARE LIKE SEVERE AND NOT IN SOME ESOTERIC SMALL PIECES OF SOFTWARE, BUT THE FUNDAMENTAL BACKBONE OF THE INTERNET. THINGS LIKE CURL AND OPENSSL. SO WE'RE SUPER EXCITED TO BRING THEM ON BOARD. >> ONE ON A ROGUE AGENT STORY OR PIECE OF NEWS IS, WELL, IF IF IT'S NOT, IF IT'S IF IT'S DANGEROUS, DON'T RELEASE IT. OR THIS NOTION THAT SOMEHOW IT'S NOT ROGUE BECAUSE YOU TRAINED IT, IS THAT MISSING SOMETHING? IS THERE A MISSING PIECE OF THE PUZZLE IN THAT ARGUMENT? >> SORRY, I THINK I JUST LOST A LOST THE LAST PART OF THAT WITH YOU, BUT YEAH. >> CAN YOU HEAR ME NOW? >> YES. YEAH, YOU CAME THROUGH, BUT I THINK THE MAJORITY OF THE QUESTIONS. SO YEAH, DEFINITELY ON THE ROGUE PIECE. I THINK THERE ARE SOME HOLES IN THAT IN THAT NARRATIVE, LIKE THE SECURITY OF THE SANDBOX THAT WAS PUT IN THE TASK THAT IT WAS SET AGAINST THE SPECIFIC STORY AROUND THE OPEN, AI HUGGING FACE INCIDENT IS AN INTERESTING ONE TO ANALYZE, AND IT MIGHT HAVE BEEN OVERBLOWN TO AN EXTENT, BUT THAT DOESN'T CHANGE THE FACT THAT THE MODELS ARE EXTRAORDINARY AT HACKING. THAT'S WHAT THEY DID VERY EFFECTIVELY IN THAT INSTANCE. SO THAT CAPABILITY EXISTS AND IS EXTREMELY STRONG IN THESE AGENTS. >> DO YOU YOU KNOW, THIS COMES UP A LOT, AS YOU MIGHT IMAGINE, WHEN I HAVE CONVERSATIONS WITH THE LEADERS OF FINANCIAL SERVICES COMPANIES, AND I WOULD ARGUE IT'S PROBABLY THEIR NUMBER ONE FEAR BECAUSE IT WON'T TAKE MUCH. AND YOU COULD GO DOWN THE STACK OF, YOU KNOW, COMPANIES THAT ARE NOT NECESSARILY IN THE TOP TIER, BUT ARE STILL VERY INTERCONNECTED TO THE FINANCIAL SERVICES OR THE FINANCIAL SYSTEM. I'M JUST CURIOUS AS TO HOW YOU VIEW THAT, HOW YOU VIEW THAT RISK, HOW YOU VIEW THE RISK FROM OPEN MODELS AS WELL, NOT JUST THE MYTHOS OF THE WORLD. >> YEAH. THE RISK IS IMMENSE, RIGHT? LIKE THE CRITICAL INDUSTRIES, I THINK THE FINANCIAL SECTOR, THE TELECOMMUNICATIONS SECTOR, OUR GRID, OUR WATER TREATMENT, THESE ARE FUNDAMENTAL TO THE OPERATION OF AN ECONOMY. LIKE IF THE GRID GOES DOWN AND YOUR PUMP FOR WATER IN YOUR HOUSE STOPS AND YOU CAN'T FLUSH YOUR TOILET, THERE'S NOT A LOT THAT'S GOING TO BE MORE IMPORTANT THAN THAT FOR YOU. AND THE ECONOMY CAN JUST STOP IF THE FINANCIAL SYSTEM GOES DOWN AND YOU CAN'T PAY FOR ANYTHING, THE ECONOMY FREEZES. ALL OF THESE SYSTEMS ARE SO DEEPLY DEPENDENT ON SOFTWARE. THAT'S THE FUNDAMENTAL TRUTH. AND WITH THE ADVENT OF THESE, YOU KNOW, CYBER CAPABLE AGENTS, WE NOW HAVE A TOOL THAT YOU CAN ESSENTIALLY POINT AT A PIECE OF CODE, AND IT WILL FIND EVERY VULNERABILITY POSSIBLE. IT'S EXTRAORDINARY. LIKE, FOR EXAMPLE, THESE THESE TWO PIECES OF SOFTWARE I MENTIONED, OPENSSL AND CURL. THEY'RE THE BACKBONE OF THE INTERNET. THEY'VE BEEN AROUND FOR LIKE 30 YEARS AND THEY'VE BEEN SITTING THERE. THAT CODE HAS BEEN SITTING IN FRONT OF HUMANS AND CYBERSECURITY