Robots in Airbnb Rentals

This podcast is supported by Atlassian Rovo, AI that takes your team from AI novice to AI native. What if AI handled the busy work for you? Updating Jira tickets, drafting campaign briefs in Confluence, writing project updates. All without you lifting a finger. Meet Rovo . AI that works where your team already works, using your company's data and permissions to take action. Get started with rovo at ROVO.com . I have to say, technology is not my friend this week. What's going on? Well, first of all, I now have a new piece of technology in my bedroom called a CPAP machine. You heard no of these things ? So listen, you if you're out there, you think you you want a boyfriend, like you do, but here's what's gonna happen: he's gonna notice during the night that it appears that you briefly stop breathing, and that's gonna terrify him, and next thing you know , you're gonna be at the doctor. Now I sleep with a mask on, and when I breathe, I sound like Darth Vader. So that's thing one that's happening to me. I accidentally bricked my laptop with a bottle of water in my bag. Yeah. And then today I'm trying to get to the office for the podcast, and my debit card that is attached to my public transit card expired. No big deal. For two days, I've been trying to navigate the city bureaucracy to just replace the credit card that is attached to my transit card. It won't work. So I have to order a an Uber to the office and it says it's going to be six minutes. It was more like a casual 12 and I get in and it's one of these cars where the driver appears to have been smoking in it continuously since 1976. So that is sort of my tech stack of so over the past seven days. And um That sounds horrible. I'm frustrated, Kevin. That sounds horrible. I'm so sorry for your loss. I need you to carry the show. Okay. I'm not in a good place and I need help. In therapy, they teach you have to learn to ask for help, and I'm asking for help. Yes. You know those like things with uh the the footprints in the sand? Yeah, will you carry me? Yes. Today was the day that I carried you. Kevin Roos is my own personal Jesus. Yes. You're always saved. Let's tape a show. Let's tape a show. I'm Kevin Roos, a tech columnist at the New York Times. I'm Casey Noon from Platformer. And this is Hardforge. This week on the show, SpaceX, Anthropic, and Open AI are all heading to the public markets, but what do their IPOs mean? Then author Kevin Hartnant is here to talk about why some mathematicians are sounding the alarm about the use of AI in their field. And finally, some hat GPT. And that'll be math-free. Gotta keep it balanced. Well Casey, the big news this week is that the AI IPO race is heating up. It's hot IPO summer. It really does seem like it is going to be a hot IPO sum mer. Kevin, I am told that we are on track to see what might be the three biggest IPOs of all time. Yes. So SpaceX is getting ready to go public as soon as maybe next week. And then just this week, Anthropic filed a confidential S1 with the SEC, uh noting that it intends to go public. That is sort of the first step in the process. And there are reports that OpenAI is going to file their S one soon as well. This is obviously long awaited. People have been wondering when these giant private companies were going to go public. And now it seems like they're all racing to do it as quickly as they can and potentially beat each other to market. Yeah, and the consequences are really important and we're going to get into them. But uh before we do that, truly there has never been a better or more important time to do our disclosures. Yes. I work for the New York Times, which is suing OpenAI, Microsoft, and Perplexity. And my fiance works at Anthropic. Okay. So those are our extra special AI disclosures this week. Now, Casey, let's talk about these IPOs. Let's do it. Maybe we should start with SpaceX. What is going on with the SpaceX IPO? What are we expecting and what does it mean? Yeah, so you know, as you know, Kevin, SpaceX is just the furthest along right now. They seem like they're getting very close to the finish line and they just have some staggeringly ambitious plans. They plan to sell their shares at $135 a piece, which would raise $75 billion. That would make it the largest IPO of all time. It would also value the company at between one point seven five and two trillion dollars, which would sort of instantly make it among the very biggest companies in the world. Yeah, those are crazy numbers. Like that those are just numbers that we have not seen before in the history of capitalism. And we should also just remind people that when we say SpaceX, we are talking about sort of the combined Frankenstein. Yeah, remind us what is actually in SpaceX . So they make rockets. They make Starlink. They also, as of fairly recently, own XAI and X the social network. And so that is all sort of part of this Elon Musk conglomerate. What about Hobby Lobby? Do they is Hobby Lobby part of it as well? Not yet. But don't give their biz dev team any ideas. Okay. Fair enough. We're gonna do Hobby Lobby in space. So this giant conglomerate is being sort of positioned in the market as a way for people to invest in AI. Obviously they do have an AI company inside of SpaceX, but I would say investors are also, I would say, more excited about the space part of it, which is the most develop Yeah, I mean look, there are two great businesses in here, right? One is a reusable rocket business that delivers satellite into space. It's very hard to build that kind of company, right? So like SpaceX just has an incredible moat. There aren't that many competitors to it. We saw Blue Origin, one of its biggest competitors, lose a rocket on the launch pad at you know just, uh in in over the past week or so. So that is what makes that an incredible business. And then Starlink is just on fire, right? Like they're using their ability to deliver satellites into space to also create a really powerful global internet access system that is just growing like wildfire. So there are two amazing businesses in there. And then they also have two terrible businesses called XAI and X.com. And it'll be really interesting to see what the interplay of the good businesses and the bad businesses are, you know, in the months to come. Yeah. Sometimes you just gotta take the good with the bad. And uh especially when they're all packaged in the same stock ticker. What's interesting is that you didn't have to take the the good with bad you could have just had the good. Like up until very recently, SpaceX was just SpaceX and Starlink. Like it was just a pure good business, but then it seemed like Elon Musk decided he needed to kind of, you know, hide his losses somewhere and so they inherited the two worst companies he owned. Well, and what's interesting about that is that one of those companies, XAI, appears to be pivoting. So they are now renting out compute uh that they originally built for themselves to anthropic. Yes. Another one of these companies that's gonna IP O this year. So uh they are positioning themselves as something like a space company with a kind of AI neo cloud business attached to it and a social network that is going to become the everything app. All of it is a little mysterious, but basically, this is the long-awaited uh time when all of Elon Musk's sort of Voltron-like companies are going to sort of take a stab at going public together. So that is uh the SpaceX IPO. Now let's talk about Anthropic. They have filed their confidential S1. They are also expected to go public at something over a trillion dollars. That is not w what? Oh, I'm just shaking my head at the insanity of that considering what their ARR was one year ago today. Yes, I mean this one's just wild to me. Like I was thinking the other day about the first time I ever visited this company. It was in twenty twenty-three. So three years ago. And when I tell you that this company was not only ambivalent about making money, but seemed to actively resist the idea of making money, they're like a small group of like very earnest AI safety obsessed people who were like tinkering with and building models for unspecified purposes. I I remember your story about it and it was just kind of about how gl um and strange the office was. Um, which you might expect for a bunch of very, you know, safety focused people who hadn't even decided whether they really wanted to start making a product yet. But boy howdy, did they make a product and decide that they actually liked making money and wanted to make a lot of it. And now they're going to be one of the largest IPOs of all time, just three years after I was hanging out with them in their little like Jackson Square walk up office. No, and like, you know, like in January of twenty twenty five, this company has um, you know, an an annualized revenue run rate of about a billion dollars. And you know, recently they've said it's fifty, you know, who who knows what it's gonna be by the time they IPO. But yeah, I mean that that just is unprecedented growth in Silicon Valley. Yep. Um OpenAI, we don't know anything about their upcoming IPO except that they have said that they plan to do it . They may file as soon as this week their paperwork with the SEC to start that process. People also expect this to be a big, gigantic IPO. And so all of this taken together, I think there are a few threads to pull on here. One of which is what is this going to do to San Francisco? Here we have two call it two and a half companies, because SpaceX has some uh headquarters and offices in other Texas and Southern California and other places. So two and a half companies going public in the same year, based in San Francisco, minting uh, you know, hundreds, if not thousands, of new millionaires, uh dec amillionaires, and centimillionaires, and what that will do to the city's tech scene, to the local real estate market, et cetera, et cetera. What are your thoughts on that? I mean, my fear, Kevin, is that we are about to see a massive increase in inequality in a town that already had really significant inequality, right? And I just worry that it's gonna sort of feel even worse. And and where I'm already starting to notice it is when I talk to my friends who have like really good jobs, paying like maybe even mid-six figures. They're looking at what they're reading about the folks who got in early at an open AI or an anthropic . And man, the comparison is not feeling good. And they're starting to wonder: what does this mean for me? Am I going to be able to lead the life that I wanted? And it just had me thinking a lot about how when I got to San Fran cisco in 2010, there was a sense of abundance here. There was a sense of anyone can do a startup and anyone can sort of have the the life that they want. And it was true for many, many tens of thousands of people. And I feel like we're almost swinging back to this sort of scarcity mentality here, which is like, well, if you didn't make it in at one of these two companies, you know, your future is in doubt. So I don't know how true that is, but I can tell you that that is the anxiety that I'm hear Totally. And it's it's obviously there's some, you know, it's hard to feel much sympathy for these people who are very well paid engineers and tech workers who are looking at their slightly richer peers and thinking , uh, I gotta get some of that. But I think this is a real like status anxiety moment in San Francisco and Silicon Valley, where even the people who sort of thought they had sort of made it in in the world of tech are now looking at these people who have joined these like you know insanely fast growing companies um that are sort of wanting to get in on that somehow but also like thinking it might be too late. Like people who I don't think were feeling precarious a year or two ago are now. And I think that's just a really interesting sort of social marker. Yeah. And like, you know, just to say again, like I I think what you want in a society is for opportunity to be spread broadly and for everyone to feel like they have a chance to lead the life that they want. And so when you move into a world where there are is what essentially amounts to a handful of lottery winners. And those are the only people that truly get to live the lives that they want. Like that just causes massive, you know, social instability and all sorts of other problems. So yeah, I my I I have like a knot in the pit of my stomach about this. I do too. And one thing that is making it slightly better is that I did see this coming and I do get to crow about my correct prediction I made on our prediction episode back at the end of last year, which was that 202 6 uh I predicted was the last year to buy a house in San Francisco, which now appears to be true. Um the real estate market is going nuts. Houses are going for you know many multiples of their asking price I mean look, I think those people are smart. Like there's a very real chance that that stock will appreciate in value even faster than your house. So I say shoot or shoot. Yes. So there are two other things about these IPOs that I want to discuss with you. One of them is the effect it's going to have on philanthropy. Because one of the strange characteristics of these particular companies is that many of their employees, and I would say this especially applies to anthropic, but there's also a a piece of this at OpenAI, are committed to effective altruism and other sort of similar philanthropic movements that basically teach you that you should, if you want to make a maximum impact on the world, you should make a bunch of money and then give it away. And so, nonprofits, philanthropies, um, donor advisory networks in and around San Francisco are now starting to ask: like, what if we just have this insurgence of new philanthropic capital coming from these IPOs? Um, our mutual friend Nan Rantsehoff wrote a great post about this the other day calling it the third wave of philanthropy, basically, where you have tens of billions or possibly hundreds of billions of dollars sort of flooding into these charitable movements and causes. Um, how does that affect like what gets funded? Are there going to be new institutions that need to be built to sort of absorb all of this philanthropic capital? I think this is something that people outside San Francisco don't quite understand is like how much money is going to be flowing into these philanthropies over the next couple of years. Yeah, I also really uh love Nan's post and had a uh chance to uh talk with her about it in person um uh recently and it was just so fascinating to hear about the sheer volume of philanthropic capital that we're expecting to emerge as a result of these IPOs and how little infrastructure there is to absorb it. Something that I think m some people might might not know about anthropic is that from their start, they have told people as they come on board, if you pledge like a percentage of your equity to philanthropy, we will actually match it. And so this is just a program that is, you know, dramatically amplifying the amount of philanthropic capital that is about to be come available. So it was it was not just matching. So so there are two things that Anthropic did that sort of speak to their I don't know historical ties to effective altruism and and that sort of world of phil anthropy. One is that all of the co-founders pledge to give at least 80% of their wealth to charity. So right there, off the top, we are talking about uh hundreds of billions of dollars potentially that are being earmarked for charity just by the eight co-founders of Anthropic. Then you have this stock matching program, which as you alluded to, not only offer to match employees who pledged a certain percentage of their stock to charity share for share, but match them three to one in the case of some early employees. And that just is creating like when you when you actually lay out the numbers as Nan did in her post, like it is just staggering the amount of money. Like we are going to see something bigger than the Gates Foundation every year, potentially for the next few years. And like it's gonna go to some stuff that will seem to the outside world fairly weird, right? Like what? The the joke going around uh the sort of AI circles is this is gonna be a great year for shrimp welfare. Um, because shrimp welfare for arcane and and reasons that are probably not worth going into here has become like a a sort of j half joking pet cause of the effect of altruists. But it's a great year to be a shrimp. It's probably also a great year to be working on uh global health and pandemic prevention, AI safety, these other sort of cause areas that are very closely affiliated with effective altruism. Yeah. I mean it makes me glad that we shredded the social safety net and did all that like sort of reductions in pandemic preparedness. So now the San Francisco billionaires can uh step in and rebuild it uh hand by hand. Exactly. I want to bring up one other thing about these IPOs and ask for your opinion about it, which is that the thing that makes me nervous about these IPOs is not that they could go sideways or people could lose money or these companies are very speculative. All of that is true. What worries me is the safety angle here, because I am of the belief that these AI systems are getting more powerful, that those increased capabilities also bring increased risks. And I just know that many of these AI companies , OpenAI and Anthropic specifically, were started by people who were worried about safety and specifically worried about the ability of a for-profit corporation to develop AI safely . At OpenAI, you've had this sort of governance struggle that resulted in, among other things, Sam Altman being fired and rehired. At Anthropic, they have sort of made themselves a public benefit corporation to try to kind of lessen the influence of uh sort of shareholder capital and fiduciary duty on their ability to make decisions related to safety. But I think all of that just gets much harder in a world where these are publicly traded companies that you know big investors, uh index fund holders that you know retirees are invested in. It was already going to be hard to sort of slow down or maybe refuse to release something that was dangerous because of the you know enormous sums of money that these companies have raised. But it's going to be a lot harder when the public markets are also pressuring these companies to race and go as fast as they can. Aaron Powell Does it matter that both OpenAI and Anthropic are structured as public benefit corporations and like sort of have like are allowed to make social commitments that a sort of you know traditional like SpaceX, for example, will not be beholden to? I'm I'm of a couple minds on this. I think it's probably better that they are public benefit corporations than not, because public benefit corporation is sort of this you know legal designation that allows you to take into account things like um are we being socially responsible it doesn't you know investors can't sue you as easily for sort of breaching your fiduciary duty if you do something that is counter to their interests as shareholders. But there are still corporations and they still exist at the pleasure of shareholders. And there are certain concessions they can make to social issues and impact. But when it comes down to it, like when the rubber meets the road and one of these companies develops a model that is truly dangerous, they are going to now need to weigh not just what do we think the right thing to do is, or what do our private investors think we should do, or what do our employees think we should do? But they're also gonna have the public markets breathing down their neck. Um they're going to have activist investors and things like that. So I'm just nervous about the structure that is now going to grow up around these companies and just push them in the direction of acceleration. I think that's fair. And I may be coping, but when I think about the possibility of a lab developing a really dangerous model and saying, well, due to you know shareholder pressure, we're just gonna put it out there. You have to remember that like the shareholder pressure can work in the other way too, because if you put out a model that can create a new bioweapon, you're probably gonna get sued for securities fraud by a shareholder that said I trusted you to only release safe models. So I do think that there are gonna be some positive pressures here that hopefully you know keep them from uh doing anything too silly. Yeah. How do you think this will impact the average person who's not an investor or a shareholder in these companies who may just uh you know want this stuff to be developed well and safely? Um I mean I think, on balance you're right that like because these are corporations, we do have to worry that like capitalist pressures will lead them to cutting corners and doing things that are unsafe. So that is, I think, the right concern to have and to keep your eye on it. On the other hand, like I could also see an argument that when your company goes public, you are introducing more democratic oversight and governance into it, right? These folks will now have to like report their earnings. We will they will have to um uh give us information about their their financials. Uh they will have to make certain disclosures as you know their uh their their products come out and and as their company changes. And you know, you know, sh shareholders will be able to to maybe vote on on certain things. So, you know, I think these are all good things because right now we have almost no levers whatsoever that people can pull other than trying to prevent a data center from uh being built in their backyard. Um, so maybe these give folks uh some new ones. Yeah. And I think there's been a lot of hand-wringing over these uh these indexes and these exchanges that have changed their rules, like the NASDAQ 100 and the S <unk>P ha have already or are considering loosening their rules around these so-called seasoning periods. Basically, it used to be if you were a brand new public company that had just IPO'd, you could not be included on these major stock indexes because they sort of wanted to see like whether you were stable enough to like become part of the basket of blue chips that people invest in when they buy an index fund. Now, partially because of these uh looming IPOs, those rules have been relaxed so that these companies are not going to have to wait three months or six months or a year anymore to be included on these exchanges. Some people have said, well, that sounds bad and, we're expos ing retail investors to these like volatile and risky stocks. I'm not that worried about it. I think like investors want exposure to these companies. Um, I know several people in San Francisco who have been sort of like devising these crazy like harebrained schemes to get pre IPO stock in one of these companies. And um I think that letting the public benefit from the upside of the AI boom, I think is going to do more help than harm, but I could be wrong if all this goes up in a conflagration and people lose their shirts. I I mean, yeah, yes, absolutely. Um, you know, um Kevin and I are not uh financial uh advisors. Um I am actually a certified financial advisor. I am not a financial advisor. Um but I do think that if you know you're a retail investor and you believe in this stuff, you should have the ability to like make that bet. Because we live in a country where you can bet on Bitcoin in an exchange traded fund. You can go on a prediction market as a member of the military and bet on an operation that you're a part of. So in a world where those are our restrictions on uh, you know, sort of financial gambling, if you want to buy a share of open AI, I say godspeed. Yeah, I think that part of the icky feeling that people are having about the AI industry now is that so much wealth is being concentrated in so few private companies and so few hands. And so in a optimistic scenario where these IPOs go off without a hitch and these companies, you know, keep growing at hyperscale, I think maybe having the benefits shared a little more broadly through things like index funds could be good for people's feelings like, oh, there's something for me in this. I I'm gonna go further and saying it's not just good. I'm gonna say it is necessary. Like like we cannot have a a very small handful of companies that are growing this quickly, that are concentrating wealth and power that much into so few hands. It has to be shared more broadly than that. And while an IPO is a very small step in that direction. I do think it is a necessary one . Okay, well that is enough about the IPOs for this week. We will continue to cover these IPOs and everything that comes out of them, including possible space data centers. I don't know. I'm excited to learn more about those . I will say, when it when it comes to Starlink, I was not a believer. And then I went on my first Starlink equipped airplane last week. And Casey , this is going to be the biggest company in the world. It's very good. When people get a taste of 200 plus megabits in the air on a plane, you're never going back. Yeah, you can like actually watch YouTube if you have Starlink on your plane. You can watch so many YouTube videos. And the deal that they struck, apparent I've I'm told is they struck the deal where at least with United, they're like, we'll put Starlink on your plane and and you know, we will charge United for that, but you can't charge your passengers. So everyone's experience of Starlink is it is a free miracle that's being delivered to me and my airplane seat. Which is not a bad marketing strategy. Not a bad marketing strategy. When we come back, author Kevin Hartnett tells us what the heck is going on with AI and math . This podcast is supported by Atlassian Rovo, AI that takes your team from AI novice to AI native. What if AI handled the busy work for you? Updating Jira tickets, drafting campaign briefs in Confluence, writing project updates, all without you lifting a finger. Meet Rovo. AI that works where your team already works, using your company's data and permissions to take action. Get started with Rovo at rov o.com. If you're still paying one of your biggest expenses, either rent or mortgage without built, it's time for a change. Built is the membership for where you live that rewards you on rent, mortgage, and around your neighborhood. Every monthly housing payment earns you points that can be used toward flights, hotels, lift rides, Amazon.com purchases, and more. Earn rewards and get something back wherever you live. Become a built member today at join built.com slash hardfork. That's j oin bil t.com slash hardfork. Starting a tech company is thrilling. It's also really messy. Just ask anyone who's done it , or anyone who's tried. Better yet, ask EY. They've seen startups at their best moments. EY knows you don't start a company to burn cycles on regulatory hoops, discounted cash flows, or the f ine print of SEC form S1. You can't ignore it. That's how RISC compounds. What you can do is work with EY. They'll help you get it right early so you can stay in builder mode. Learn more at eY.com slash tech startups. Well Casey get out your TI eighty three graphing calculator because today we're gonna talk about math. Can I play snake on it or do we actually have to talk? No, we have to talk because today uh we are going to talk about what is going on with AI and math. Now this is a subject that we have talked about before on this show, but there's actually been a lot happening just over the past couple of weeks. So two weeks ago on May 20th, OpenAI announced that one of their models had reached this big mathematical milestone. Basically, it had disproved this long-standing geometry conjecture by identifying a new way of thinking about this famous math problem, one of these airdosh problems that basically no human mathematician had considered before. That was considered a very big deal in the world of mathematics. And at the same time, there's also this backlash brewing in mathematics to the use of AI. Just this week, a group of mathematicians have been passing around and signing something called the Leiden Declaration, which is basically an open letter about the use of AI in mathematics from people who are concerned that maybe they're sort of eroding the human foundations of this academic mathematical discipline. Yeah. And when I asked a mat hematician why, they said y equals mx plus b . Okay, very good. That of course is the classic slope intercept formula for a straight line . Which model did you use to look that up? I'll tell you later . So we just thought it was a really good idea to check in on the state of AI and math and to help us make sense of what is going on right now. We have turned to one of the best guests I can imagine for this subject. Kevin Hartnett is a journalist. He has covered math and computer science for many publications, including most recently as a senior reporter for Quanta magazine. He's also the author of a book that comes out next week called The Proof in the Code, which is sort of about this formal math language called lean and how it's transforming math and AI. Today he works as the editorial lead at Cursor, the AI Coding platform, and I just thought he would have a really good view of this situation. Also, we just like to bring on people named Kevin because they tend to be really smart. Okay, let's bring in Kevin Hartnett. Kevin Hardno, welcome to Hard Fork. Thanks, Kevin. Great to be here. Well, Kevin, we've brought you here today to talk to you about AI and math, you just wrote uh a book called The Proof in the Code, um which is, I'll just say it, the most interesting book I've ever read about math. It's it's a it's a short . It it narrowly edged out one fish, two fish, red flesh, blue fish. Um so when we last checked on the field of mathematics and AI, uh it was last summer and three of the big AI labs, Google Deep Mind, OpenAI, and Harmonic, had all reported that their math models had achieved a gold medal score at the International Math Olympiad. That was something that, you know, people had been saying for years would be impossible for or would take many, many decades for computers to be able to do, but their AI models did it uh last summer. What has been happening in the field of AI and math since then? Yeah, I mean virtually everything. So like the IMO had been a benchmark for a long time in my book. There's a whole chapter about the previous year's IMO, the 2024 IMO, where Google DeepMind got a silver medal score. And that was kind of considered a small watershed. And then as you said, last year three labs got this gold medal level score, which had really been the kind of the benchmark that had been set out. At that point, AI was still just doing essentially high school math. The hardest high school math in the world, but still just high school math. And I think for people who never went beyond high school math, it's hard to like really appreciate how far that is from the frontier of research math, like forever far. Um that's like barely even wading into the field. It's like zero percent of the way to the frontier. So it was a proof of concept maybe, but it certainly didn't mean much in terms of can these these um models actually do research. That's that's very hard for me to hear as someone who was not that good at high school math. I have to say . Like I'm I'm feeling a little defensive, but I but I get what I believe you. It's just making me defensive. Wha why were the labs so focused on the IMO and on math in general? Was it because that was just like a very hard challenge that they liked or was it because they thought that being able to do math at a high level would enable their models to do other important things? Well it's definitely both. I think the the challenge, this IMO grand challenge, which was the name that a researcher at Microsoft research gave to it, was that was really about like can we just like create models that can do amazing math research? It was just really kind of research for research's sake. At a certain point, the labs and these startups you mentioned adopted that challenge themselves and their motivations were a little different. And there's this very much this belief that if you can teach a model to reason about math problems and solve math problems it will be much better at other things and I always think about this statement like my high school math teacher would give when people would ask like why are we learning this what's the point of this it's like they would either say so you can balance your checkbook or to teach you how to think, right? It's like one or the the other. And t to teach you how to think is really the point here. It's like if you can reason through a math problem, think logically, then you're how you can apply that type of skill to like all of the parts of your life. And I think the labs believe that if you can teach a model to reason through math problems, it's gonna be able to do all these other things that are much more probably like commercially valuable well as well. So yeah, I'm having a flashback to when we first started to talk about AI and math and the knock on these models was that they were actually quite terrible at it, right? And that if you would try to get them to do basic addition or multiplication, they would utterly fail. So Kevin, sketch out for us a little bit what the labs did to sort of uh navigate through that problem and get to a place where they could kind of credibly try to advance the frontier of the uh science. Right, right. When when ChatGPT came out in November 2022, mathematicians were like passing around all these like ha ha ha look at this stupid model telling me that there are only finitely many primes when we all know there are infinitely many primes and like two plus two is five. Right basically that kind of thing. I mean I think I s essentially the models got better. There's definitely an element of reinforcement learning on math problems that make these models better, like RL on math. But I think it is like just like the general improvement in these models that we all experience kind of in a lot of ways we use them has led to these kind of incredible reasoning tasks that they become capable at. So let's talk about uh one of the areas where it seems like we've seen some creativity in math with AI lately, which are these Urdosh problems. Kevin, can you tell us who this Urdosh was and why he left us with so many problems. Yes, I mean so Paul Erdosh um is a really colorful mathematician. He was essentially the Bob Dylan of math in that he like spent his life on the road. He died, I think, at age 83, actually at a math conference. He slept on mathematicians' couches his whole life. And as he went around, he compiled lists of problems that he thought were interesting. Uh, either he would find them in the wild or he invented many of them and he created this airdush list. He endowed them with these like tiny little rewards, like $20 for solving this problem, $500 for solving this problem, and that fund still exists after his death. And these things are paid out. Actually, I don't know if the LLMs have received the money or who gets the money when they do it, but anyway. Don't give them the money. They don't need the money. A thousand problems, twelve hundred problems that he thought were interesting, and just kind of left them out there. The AI labs and these startups have looked for kind of benchmarks, uh, kind of mountains they can climb, things they can do to prove that their models work well. The IMO uh was one of the most prom inent ones. They got the gold medal there. They needed to move on. They moved on to the Putnam exam, which is the premier college math competition, and started to do quite well there. And then they just started looking for kind of like new targets. And these heritage problems are sitting out there, 1200 or so problems. Uh, and so they essentially set their models to work on you know all of them, like see what you can do on them, and it would cook up answers to them. And through the beginning part of this year, we would see like on Twitter one announcement after another, solved Erdisch problem 737, solved Erish problem 63 . And I think mathematicians viewed those very kind of like hypey announcements differently than the the energy behind the announcements themselves. How did mathematicians view them? They said something isn't adding up here. Thank you, Casey. I'm gonna have to definitely like think of some puns. I'm gonna get one pun out before we finish this podcast. That's my goal. Um Go ahead. Yeah. So mathematicians, um there are just a lot of unsolved math problems in the world. And just because a math problem is unsolved and has been around for like decades and is was dreamed up by a famous mathematician, does not make it an important problem. Like an important problem is one the field kind of in its like collective wisdom determines either like the answer to the problem really will change how we view math, or more significantly, the methods we will need to develop to solve that problem are just gonna remake the field. It's gonna create important new math. These Erdish problems were just not viewed that way. They're kind of like sophisticated riddles in a way. These are like the Sudoku of math. It's like the Wordle of Math. It is like the Wordle of Math. These airdush problems are like toy problems, not serious problems. Well, like it's not true about all of them. And about a month ago, OpenAI came out with this like big new result. They've solved what many people think of as one of the most important air dish problems, this thing called the unit distance conjecture. What was important about the unit distance problem is it was a problem that a lot of people had looked at. So you could just say no humans have really tried to solve this. Like people have looked at it, they hadn't solved it. The methods underneath it were very sophisticated and surprising. It was not just kind of a clever cobbling together of like obvious techniques. And the result itself was just like so good. Pretty unanimously, people agreed this could be published in the Annals of Math, the top journal of math. In a way, over the last year, there'd been this kind of shifting of goalposts. AI did this, but it can't do that. Oh, it did that. Nope, it still can't do this. But this result, this proof of the unit distance conjecture really said AI can do absolutely top-tier research. I've been following the story of AI and math in part through people like Terence Tao, who is widely considered the greatest living mathematician. He has been sort of experimenting and writing and making videos about his experiments with these AI programs for use in sort of frontier math research for a number of years now. And when he started sort of working with them, he was like, oh, these aren't that helpful, or maybe they're like a, you know, a sort of mediocre grad student uh who you'd have assisting you. And more recently, he seems to be actually saying, like, this is revolutionary for the kind of frontier math research that I and other professional mathematicians do. He recently made a video with OpenAI talking about how he can now just try a bunch of sort of crazy ideas and experiments because the sort of cognitive friction of using these models means that you can just sort of have an idea and give it to the model and say, go test this a bunch of different ways and figure out if there's anything there. Is that a widely held view among mat hematicians, or is he just sort of on the extreme AI pilled end of the field? Yeah. So Terry is an extremely interesting figure in this because he is so important, as you as you said. Um he there's I have a whole chapter in my book about some of the early work that he did with AI, this thing he called equational theories. And he's always been interested in different ways of doing math. Um he's very intensely collaborative. He just he's interested in kind of new ways of working. Um Terry is, I think , kind of representative of one of three attitudes towards AI and math right now. A couple weeks ago, I was at the Institute for Advanced Study in Princeton, New Jersey, which is like the citadel of modern math, like the biggest, the most dense collection of kind of great math minds in the world, live and work there. And in a single afternoon, I was walking the campus there and I had two strikingly different experiences. I ran into two 40-year-old mathematicians, top of the field. One of them told me he just tried to do some math with Gemini and is like, that stupid thing told me like XYZ thing, which we know is wrong, is true. And then I closed it and I went back to doing math the other way. An hour later, a guy who, you know, on paper looks a lot like the first guy says, I think in two years AI is going to put mathematicians out of business because it is just going to be strictly better than us at all of it. And like we won't need mathematicians anymore. So like those two polls, Terry is squarely in the middle. He, that open AI video you described, Kevin, that's like the kind of jet pack for your thoughts view of AI. It's like the Iron Man suit that will allow me to do more and better and bigger things than I could before. Um, he is clearly the leading figure of that point of view. I don't really know if you were to take a poll right now of mathematicians, like how it would break down. I would guess the it's gonna put us out of business would finish last . Um, and I would guess Terry's would finish first. And I think that it's good for nothing. That might have actually won a year ago, but I think that's definitely falling in the polls. Let's talk about some potential paths to a world where maybe more people are agreeing with the person who thinks that uh AI threatens the job I do. This was fascinating, and this is actually w the reason we wanted to have you on today was to talk about this response, this declaration, the Leiden declaration on artificial intelligence and mathematics. And this is a basically declaration signed by something like 800 mathematicians so far that I would characterize as like a very worried document. They are upset about the use of AI in their field, what they consider the irresponsible or reckless use. They, you know, make a bunch of statements about how these technologies are producing plausible but unreliable or even incorrect arguments, which are hard to distinguish from sort of correct proofs. So help us understand this declaration and kind of the the perspectives of the mathematicians who are putting their names on it. Yeah, I think you are you are right that it reflects a kind of deep concern and worry for the future of the field. Um mathematicians, I would think, are deeply worried in the way of a population or a community that largely was able to like run itself and like self-regulate for centuries. And now there's this like massive exogenous force that is like shaking it. And they want to be able to kind of like defend the field. They want to, I do think wanna kind of set up some kind of guardrails and also say like this is our field. You don't get to tell us kind of what's important, how it how it runs. And that this document you talked about, Kevin is I think an effort to try and start making that kind of statement. Well I think they've realized that there's strength in numbers. Oh my god. So here's what I want to know. The hits keep coming. Here's what I want to know. Like what what exactly is so threatening to them about other people using ChatGPT to do math proofs well let me actually sp step back one second. I think there are kind of two things the Leiden documents trying to do. One is the same thing that like all fields are trying to do which is like what are the new rules for the road in the age of AI. Like basically saying if you use AI when writing a proof, you need to tell us about it. Like the math archive, which is where proofs are posted online before they're published, uh recently issued a statement that if we we see unedited use of AI in your PDF that you upload, like we see like the metadata from the AI prompt, like you copy and pasted it in there and you didn't even know it was there and you didn't review it. We're banning you from the platform for a year. So there's like some effort to like set some new rules for the road. That's one. And then two, I think they worry that the types of math and incentives to do math, the types of math problems that LLMs are good at are different than the kinds they care about, but like their own priorities are just gonna be like steamrolled by uh the rapid pace of progress and the particular kinds of problems that AI is good at at the moment, um all the attention and kind of money that flows to them. I think they're worried the field will kind of get squeezed off and they'll have no say in that direction. They're trying to have a say. Like I'm sure this is a naive perspective, but isn't this just what people in every discipline feel when there's like a new technology that does the thing that they used to do better than they do? Like it wouldn't the Abacus Guild have been writing uh declarations, you know, about the the dangerous new calculators? They wouldn't have bothered. They were very violent. They they turned straight to violence. So I mean, is this just like a purely defensive thing? Um I think there are definitely large elements of math that are worth preserving and that like AI could in a certain way kind of undermine those elements without fully replacing them. And I think that is like a valid worry. Like math is like a very rich discipline. It's the kind of the the flowering of like the human mind. I think there are things to worry about that AI can kind of strip a lot of the the incentive and value out of it without fully replacing it. I I I kind of just want to return because I'm still not sure I totally connected on like what the folks who signed the Light and Declaration are worried about. There is like a version of this anxiety that I feel like I've seen in other professions, which is essenti ally AI just enables the instant creation of so much stuff, what is often called slop, that it kind of overwhelms and crowds out the people in the industry who are actually like talented and doing a good job. Like, is this primarily just a slop issue where they feel like they're not going to be overcome a tide of AI generated proofs, or is there something else there that I'm miss ing? Oh, I think it's actually entirely that like if AI can generate proofs that are really good and we can read them and we can all be super impressed by them, then there'll be no more reason for us to like have jobs. Like we will be like hobbyists, like great ch ess players. And is the anxiety there like an economic one of hey, like this is how I feed my family? Or is it something in addition to that of like without humans like steering the direction of math, something bad will happen. I think the anxiety is um having been in possession of something for a long time that was like very special, that was like rare in the human population, great ability at math, and now is kind of like generally available. I think that's just kind of a weird thing to reckon with. Uh, I think it's also this belief that kind of math and the way the community has developed, the norms around it, um, has produced a lot of basic discoveries that are both practically important, like kind of math fuels our understanding of the universe, it's important in engineering, it's important in kind of uh all sorts of technology. So there's a concern that if you kind of squeeze it off in certain ways, that we will lose those downstream benefits. And um I think the more serious point is this belief that kind of math is just a quintessentially human endeavor. It's like the pinnacle of human thought. It's like writing a sonata. It's like writing a novel. And that I don't know. I think we don't feel as threatened in those areas by AI because we kind of understand that like the human behind the creation is such an important thing. Oh, I think writers and musicians feel very threatened by AI. Uh, just just to offer that. Like, I think there's a very similar response happening in the creative community. Do you? I guess I was I was not so sure of that statement. I just like do I think that people would not be as interested in a novel written by AI. They're not they're not gonna be interested if they know that it was written by AI. Yes. Yeah, that is true. That is true. Yeah. Um anyway, so like if a proof is not if there's no human kind of behind it, who kind of sat and wrestled with it , then maybe we lose some kind of very essentially human endeavor. That is the the worry. Right. I think it's it programmers are an interesting exception to this sort of defensiveness, because for the most part, I think like many programmers are very excited about the tools that allow them to just like do their jobs better and faster. And obviously they're worried about the the future of their own jobs. But I don't think you're seeing this kind of like Leiden declaration backlash to the use of AI for programming. But I think it's it's interesting to see just the list of kind of all-star mathematicians who have signed this declaration, including, we should say, Terry Tao, who we just mentioned is like fairly excited about the use of AI, also signed this declaration saying, hey, wait a minute, we gotta be like careful and put some rules on the road here. Let me ask uh what I imagine will be a naive question though, which is my extremely limited understanding of math is that mathematics are natural laws of the universe, right? Like this field is not invented, it is discovered. And my sense is that maybe potentially it is a field that could even someday be solved completely because we will just simply understand the structure of math and all of those laws of the universe. So I could imagine a group of mathematicians saying, hey, this is really exciting because this is going to accelerate us to sort of like getting to the teleological end of our entire discipline. But I'm I'm not hearing that today. So what am I missing? Yeah, this idea uh is math adventure discovered, right? It's kind of uh an never-ending debate. Uh 10 years ago, a little more than 10 years ago, Terry Tao won a big prize and he was asked that question. And he's his answer, which I very much remember was when you're doing math, it feels like you're creating something, but ultimately he kind of viewed it, I think he said, as an act of discovery. Uh I don't I just don't think mathematicians have any concern that they're we're about to run out of math to be discovered and AI would have to be like a lot better to discover it all. Like maybe we already know know, you, effectively zero percent of all the math there is to know. There's like a lot more out there. So I don't I don't think that's a concern, although that is a fun thing to imagine. Yeah. I'm just kind of wondering like is is the future of AI and math more likely to be sort of a bittersweet acceptance, or is there going to be this kind of principled resistance pushing back and saying, like, no, this is still going to be the domain of humans? It's hard for me to believe. I mean, I can only speculate. No one knows the answer to this. I ask mathematicians like frequently, where do you think this is going? What is the future for you all? No one knows. Um, it is just hard for me to believe that something that has been like so important and central to human activity for so long is just going to completely disappear and be replaced by pushing a button. I think we will be surprised by the way it turns out. Put me like kind of voting in that middle camp, the Terry Tau camp, that like we're going to human beings directing these machines in some important ways, choosing which problems to set them on is gonna continue to be important. So math is gonna look a lot different. There's just like no doubt about it. It's gonna have to adapt in a lot of ways, just like everybody in kind of almost any industry is. But I think there will be something quite impressive and different that comes out at the end. Well Kevin, thank you for helping us balance the equation. Yeah, you've been integral to the show. Thank you guys. It was a pleasure to come on and check your work . We really appreciate it. Thanks, Kevin. When we come back, he be tee Maybe that's an urgent message from your CEO. Or maybe it's a deep fake trying to target your business. Doppel is the AI native social engineering defense platform fighting back against impersonation and manipulation. As attackers use AI to make their tactics more sophisticated, Doppel uses it to fight back, from automatic ally dismantling cross-channel attacks to building team resilience and more. Doppel, outpacing what's next in social engineering. Learn more at doppel.com. That's do pp el .com. This podcast is supported by BetterHelp. Summer can feel like a sprint. Kids home, trips to plan, routines flipped upside down. It's easy to slip into survival mode, just trying to get through it. Then suddenly it's over, and you're wishing you enjoyed the days just a little bit more. Therapy can help you slow down and actually be present for the moments that matter. With BetterHelp, you can connect with a licensed therapist from anywhere on your schedule. Don't just survive this summer . Thrive. Visit betterhelp.com/slash New York Times. Not every sale happens at the register. Before ATT Business Wireless, checking out customers on our mobile POS systems took too long. Basically a steering contest where everyone loses. It's crazy what people will say during an awkward silence. Now transactions are done before the silence takes hold. That means I can focus on the task at hand and make an extra sale or two. Sometimes I do miss the bonding time. Sometimes. ATT business wireless. Connecting changes everything . Alright, Casey. Before we go, we did have some other tech news that we wanted to discuss this week in our segment, Hat GPT . Hat GPT, of course, our segment where we take new stories, put them in a hat, draw them out one by one, riff on them a bit, and then when one of us gets bored, we say, Stop generating. And then we solve a formal math theorem. Mm-hmm. That's that's a new twist on the game. All right, what's our first item today? First out of the hat. A San Francisco startup is secretly testing robots in Airbnbs and trashing them, lawsuit claims. This one comes to us from the San Francisco Standard. Casey, did you hear about this uh robot testing that's going on in the Airbnbs? I did. You know, and this is a thing. There are all of these well-funded robotics companies and they need to just practice doing household to urs over and over and over again, trying to generate lots and lots of training data, and apparently a lot of Airbnbs uh are now caught up in the crossfire. Yes, so on April twelfth, a ring camera in San Francisco, captured footage of people moving large black cases into a home in San Francisco. Uh, two days later, the house's owner stopped by the house to take out the trash, looked through the window, and saw uh black cables taped to the walls. A man was typing at a laptop sitting next to what appeared to be a robot, and when he ch when the guests checked out eleven days later, the house was a mess. Everything had been removed from the kitchen cabinets and the dishwasher I have to say I've rarely felt less sympathy for anyone on our show than the people who opened up their Airbnb to a robot company. Well, they didn't know they were opening it up to a robot company. Doesn't matter. I subscribe to the A-Lab theory. That's all landlords are bastards. So look, if if you have enough money to buy a place and then you just wanna, you know, rent it out and charge people these, you know, uh usurious uh cleaning fees, you know, and uh make them take out the trash on their way out the door, you know, I I I have no sympathy for you. Let a robot in there. You know, Airbnb was a 2010s phenomenon. Everyone's staying in hotels again. Like we we have to do something with these spaces. We might as well let a robot mess them up. Am I wrong? Tell me I'm wrong. You're wrong. You should not be able to just like bring in a bunch of robots in body bags to an Airbnb and like have them screw up the house. Or if you do, there should be a cleaning fee. And this the owner of this house is now suing this company called the Bot Company for renting his Airbnb under false pretenses to do robot training, and he's seeking, wait for it, $12, 3 83.50. That is now the median cleaning fee on Airbnb anyway. Like I'm telling you, this is a normal Airb nb situation. Stop generating. Okay . Next up , Trump sides executive order seeking oversight of AI models. This from Sheera Frankel and Trip Mickle here at the Times. President Trump signed an executive order on Tuesday that asked technology companies to voluntarily give the government oversight of new AI models before releasing them to the public. There is a big change here from an earlier version that got sc rapped a couple of weeks ago, uh, which is that the number of days that the government will get to review models is down from ninety days to thirty. And apparently that was enough for former White House AI Csar David Sachs to give it his blessing. So Casey, what is going on here? Because when we talked to Sundar Pachai a couple weeks ago, he was going to the White House to um to you know be there for this EO signing, but then that got delayed because apparently David Sachs had a fit and didn't like something that was in the order. So now we have this 30-day provision. Um I am just very confused about the state of the AI order and whether David Sachs is still kind of running the show from the shadows over there. Well, he's not the AI czar anymore, but he definitely still has sway. And there are some within the administration who believe that if the government is able to hold up the release of a new model for 90 days, that could hurt American competitiveness. If you bring it down to 30 days, they're just not as concerned. So that's the change that was made. I mean, the part that just makes me roll my eyes at all of this is just that the fact that all of Like I think we are now past the point where frontier models actually should uh actually have to submit to mandatory required testing before they inflict these models on the public, but we're still not there yet. Wait, so it's voluntary to do the thirty days? It's voluntary to submit it and then the government has thirty days to, I guess, you know, give you notes. I see. I'm still confused about the state of AI regulation in this country, and my going assumption is that until I see somet hing uh that is, you know, mm b passed into law and signed, uh, we are just sort of operating in the vibes universe. Yeah. If the if the the state of uh AI regulation is uh hey, what do you guys want to do? What what sounds good to you? What would be good? What would work for you? Stop generating. Alright, what's next? Okay, we've got US is said to be investigating George Santos. Haven't heard that name in years. Over Calci Betting. This one comes to us from our colleagues at the New York Times. Federal authorities are investigating whether former U.S. Representative George Santos engaged in insider trading by betting on a prediction market about whether he would show up at President Trump's State of the Union address in late February. And uh Calci has referred this matter to the Justice Department and the CFTC for further investigation. So say a bit more, because am I right that there there were maybe some indications that he was going to go to the state of the union, but then it it appears that he may have um become aware of that and then gone and placed a bet that he would not go and then did not go. Yes, so the the pattern of facts as we understand them is that just before the State of the Union, George Santos goes on social media and says that he's going to attend. But he missed the speech, and around the time of the event, Kalchi detected that he had bet against his own attendance. Um we salute a legend. This diva truly will go down in her story. George Santos, I solution. Now look, there's a very narrow category of crimes, Kevin, for which I think you should not get in trouble, and this is absolutely one of them. If you are out there on social media engaging in trickery to get people to lose money in a prediction market , that I actually think should not be a crime. I or at the very least, I think you should get one for free. Yes. Very funny. It's always the ones you most expect. And uh this is going to be just a hilarious genre of like silly crime stories over the next few years is just increasingly famous people just getting caught with their pants down, betting on prediction markets about events that they themselves control. Yeah, I will say as an uh aging millennial, it is very appealing to me the idea that I could profit from uh saying I was gonna go to a party and then not go. That we've all had that dream. We've been doing that for free for years. Totally. What's wrong with us? Okay. Stop generating. All right. This next one comes to us from 404 Media. Hackers simply asked Meta AI to give them access to high-profile Instagram accounts, and it worked. Hackers say they used a meta AI support chat bot to break into a host of high-profile Instagram profiles by asking the support bot to change the email address associated with the target account. The claims coincide with a series of high-profile Instagram account takeovers, including the Barack Obama White House account, the Chief Master Sergeant of Space Forces account, and Sephora's account. Uh Kevin, what do you make of the fact that you can just apparently access someone else's Instagram account by asking Meta AI. Well, I I just want to say my old pal at Meta AI, nasty Nancy, would never have done this. She would have upheld the integrity of these Instagram accounts. Uh but now they've turned it over to this crazy chatbot who's just giving away people's passwords. Look, I know I know it seems like this story is bad for meta, but I actually think it's good because we have finally found something that meta AI is good for. And I'm not sure that I could name a second thing. So congratulations to the superintelligent. I learned about this when someone posted the apparent uh account, credentials, and cell phone number of Mark Zuckerberg on uh X. So I have not tried the number yet to verify that it works, but it appears that you can just go on and ask MedAI for anything. I'm gonna guess that that's not actually his contact information and is in fact some sort of phishing scam uh that would, you know, uh harm you only one way to find out. Everyone try calling Mark Zuckerberg at Kevin, you know we have a strict no-doxing policy here on the show. Okay, well, I'll save that for our bonus content. All right, stop generating. Next up, United Flight. Oh, this this is my favorite story of the week. United Flight forced to turn around because of a Bluetooth speaker name. That's the Verge headline. A United Airlines flight from Newark to Mallorca, Spain, last Saturday night, had to turn around about two hours after takeoff and do an emergency landing due to security concerns over a Bluetooth signal. The crew on the flight asked for passengers to turn off their Bluetooth devices multiple times and everyone complied except for one speaker that belonged to a sixteen-year-old boy and was named Bomb . It's pretty funny because it's like there's maybe only one word in the English language that you could name your Bluetooth speaker that would force an emergency landing. And you picked it, brother. Congrats. I was following the story on Reddit where they were like like weirdly a number of passengers on this flight were like active on Reddit. And so during this, they were like, the pilots and the you know are coming on and telling us that we all have to turn off our Bluetooth devices immediately. What's going on? And you kind of follow it in real time. And finally they figure out, yeah, there's this Bluetooth speaker. And when you connect it, it shows up on the little list of Bluetooth devices as BOM, which is a very bad name for a Bluetooth speaker. Don't do that. It's a very bad name for a Bluetooth speaker un,less you plan on playing some bomb-ass tunes. You know? It look, it's all about context. Also, I like I have news for people who are, you know, I don't know, running airport security. Most bombs that would blow up blades, you cannot actually connect to them via Bluetooth and are not named bomb in the Bluetooth list. These are not discoverable devices that are advertising themselves as what they are. It reminds me of like, do you remember when people used to give their like home Wi-Fi networks like names like you know, CIA surveillance van or something like that? It's like like the real CIA surveillance van is not named that. Yeah, look, I think we we have a very um important message to deliver to airline security, and that is you guys gotta have a sense of humor. You know what I mean? You guys need to relax, live a little. Take a chill pill. It was a damn Bluetooth speaker. Do you know how irritated I'd be if I was two hours into my flight under Mallorca Mallorca and now we had to turn around? Yeah. Trying to get to that beach. All right, last one out of the hat. You didn't say stop generating. Stop generating. Okay, last one out of the hat. Oh, Casey, this one's in your wheelhouse. Survivor boss Jeff Probe says Cal Shi and Polymarket are quote