The future of autonomous weapons

Hello and welcome to the Times Tech podcast where every week we unpack how technology is reshaping business, culture and everyday life. I'm Katie Prescott covering all things tech here in the city of London. And I am Danny Fortson out here in Silicon Valley . Which is Danny the place to be this week. I am so jealous , you are at what I think can only be described as the tech trial of the century, the millennium . The millennium . Elon Musk versus open AI. The beef between them is Elon Musk and Sam Altman co founded Open AI among others and Elon Musk said we founded it as a charity and he's turned it into something commercial in very basic terms. Yeah, basically I got bamboozled. I was a prime funder. I put in thirty eight million dollars to kind of get it off the ground and fund it in its early years . And then fell out over strategy . Elon Musk left and said and this is in an email gave them quote unquote exactly zero chance of survival once he left . He was like, yeah. And of course they, went on to very much survive, turn into a for fit, have a, you know, establish a for profit subsidiary, which is now worth eight hundred billion dollars , launch Chad GBT , kickstart the AI revolution . And so this fight is really around. He's like, Hey , I donated this money to a charity . Now it's one of the most valuable companies on the planet . That can't be okay. Podium guys . Exactly. So he's wanting just a cool one hundred and thirty four billion . I mean you know that seems reasonable. What was he like in court that first day with Elon Musk giving evidence like and what's been going on? Yeah, so it was a total zoo. So I got there at like eight AM and there was a line of maybe seventy five people waiting to get into the building , all kinds of camera crews, et cetera . So just a real spectacle. You got in there and there was like no room in the courtroom because it was fully packed. You have to show up kind of five six AM to try to get a seat inside the actual courtroom. Then queue for Wimbledon. Exactly, exactly, but without the strawberries . But then you get but they also have an overflow room that has a live video feed and audios and that's just like literally down the hall. So I was in the overflow room with probably I don't know, at least a hundred people. A lot of journalists, there's a lot of lawyers and in the foyer are all these like beefy looking guys with earpieces, which are all of the security detail for the various billionaires who were in the room that day . So they're all just kind of hanging out looking kind of big and buff and mean . But you had Elon Musk in the room, you had friend of the pod Sam Altman in the room. Wow . You had his co founder Greg Brockman in the room . And so I was there for opening arguments of both sides. Astonishing. Well, we should say open AI has strongly disputed Musk's claims and characterizations. Anyway, Danny, it's really exciting to hear what's going on and I can't wait to hear more over the coming weeks, but let's move on to today's episode where we're going to be talking about all things defense. And the price we pay for security, both globally and at home because this has been a massive issue at the moment, hasn't it? Yeah, exactly. And this is all of, course, German because what we're really talking about AI. And how does this all work? There's a very interesting dilemma around national security , safety at home and abroad in this age of AI. And the reason we're looking into this is because several stories have come together at once in the last couple of weeks that really shine a very bright light on this moment in tech and defense. So this week , Alphabet, which is Google's parent company, signed a deal that allows its AI to be used by the Pentagon for quote unquote classified uses, a little vague, but one could speculate . And this was despite a letter of protest signed more by more than six hundred Googlers delivered to CEO Sundar Pachai. And in signing the deal, they join really a pretty fast growing list of Silicon Valley companies currently making agreements to kind of do work for and sell stuff to the US military. Yes, it does feel like quite a moment as most companies grapple with what their relationship should be with government when it comes to defence . There's one company that doesn't grapple with that and that's pretty clear on what their view is, of course, and that is Palanteir. No dilemma, just quite a firm view. And they put out this post on X , which has had about thirty two million views , setting out its manifesto , which is just worth going into a bit. It sets out a future basically where AI warfare, it says, is inevitable and it calls on silicon Valley Tech bosses to, and I quote, participate in the defense of the nation. I mean, it sounds like something from World War two . Yeah, and a positions companies like Palantier is kind of now helping engineer national security for this kind of new AI era and they envision a world that grants, you know, really a handful of unelected tech executives huge influence over military strategy, domestic safety , and critics have called us, you know, what we're kind of we're a step toward, if not already in a surveillance state. So this week we're looking at how AI is transforming defense and security and asking the critical question are we actually being made safer because of AI? And in keeping with that theme of defense, one of the most controversial aspects of AI use . big Our interview is with the chief technical officer of defence company BAU Systems. Julian Kracknell is going to talk to us about what the future of defence looks like and if it involves killer robots going to war scarily making their own decisions . But should we start off by talking about Google's deal with the Pentagon? Danny, can you just take us back to what's happened? Yeah, so this week Google has reportedly signed a deal with the Pentagon to use its models, its AI models for classified work and the agreement allows the Pentagon to use it for quote any lawful government purpose. You may recognize that terminology because that was the kind of the key phrase when OpenAI and also XAI, Elon Musk Company signed similar deals to kind of start selling their wares to the Pentagon , anthropic, famously said we're not comfortable with this because effectively they don't trust the government in its current form to only use it for quote lawful purposes . And the agreement spark emedpl anoyee pushback inside Google. six hundred members of staff signed a letter and sent it to Sudanar Pachai . In it, they say, quote, we want to see AI benefit humanity not to see it being used in inhumane or extremely harmful ways . This would include lethal autonomous weapons and mass surveillance but extends beyond end quote. And this is somewhere Google's been before and grappled with before. So back in twenty eighteen, they scrapped a contract with the Pentagon project Maven after thousands of employees protested against the use of AI tools to analyze drone footage . So now eight years on , they've made another agreement and it feels like employees are pushing back again. Let's have a closer look at what the deal entails. So essentially it says Google has to adjust the company's AI safety settings and filters at the government's request and it doesn't give Google the right to control or veto lawful government operational decision making. Yeah, the Pentagon has not commented on this. And it's very similar to what we had Sean Gurley on last month talking about the whole anthropic herfal, and he's like, look, if you're selling something that can be used as a weapon or for weapons or with weapons to a military, you can't say, hey, don't use it to fire a gun in that way. You know, like you're kind of handing over power of these tools. You can't set rules about how it can be used. You're basically selling a product and then the government, the military, whomever , is going to use it however it wants . As you mentioned, this is really significant because back in twenty eighteen and I covered this at the time over the Project Maven AI drone contract , three thousand people signed a letter of protest. It was a really tumultuous in Silicon Valley, especially around defense . And then at that time, eight years ago , the company backed down and they basically declined to renew the contract, and who picked up ? Palantier . And what's really interesting more in a minute? Yes, indeed. And what's really interesting back then, three thousand people signed this letter of protest , today alphabet is twice as lar ge, so it's now one hundred ninety thousand people . Only six hundred people have objected in this way so far . So I'm not a mathematician, but that feels like on this very unscientific numbers even ShatPT could get its head around . Exactly. Just in this one unscientific metric that's like, you know, one tenth the outcry at least in this form. And again, I think it speaks to this moment of just this vibe shift we've been taught we're talking about a lot about a year ago where it's just whether it's due to the war in Ukraine , what happened in Israel and Trump being in office? Like there's been this turn used to be turning away from Washington and now there's a real turn toward Washington when it comes to, you know, big tech. Like I said, it's the vibe shift. And if you talk and if you look at like Andrees and Horowitz, one of the biggest investment firms out here, venture capitalists out here, they have what they call the American Dynamism Fund , which is really all about funding a whole new generation of American defense startups , which again, if you go back five years, that idea would just not really even be talked about in polite company out here . And now they're like stepping into that and be like, yeah, we're going to build a new generation of defense and we're proud of it. You know, so again, it's just it's quite a change. It does also feel naive , doesn't it , to think that you could sell technology to the government and then put these guardrails about how it uses it onto it. I think it's either it's quite binary really . And it also begs the huge question, should US AI companies be allowed to say no to Washington? And Palanteir, which is the company that interprets massive amounts of data , shared this manifesto a few weeks ago when it said no, absolutely not. Silicon Valley owes a moral debt to the U. S. for making its rise possible, and, led by its boss, Alex Carp, said National service should be a universal duty. It's worth saying this sparked so much controversy when it came out and some critics called it the ramblings of a supervillain. Palinger put it out on X it's twenty two points kind of point point by about kind of really it's a summation of the technological republic, which was the book that Carp put out some months ago , which kind of laid out a little like basically his life story and also building Palantier and his kind of worldview, which is long been, let's call it distinct from everyone else. Like, you know, Palantir is delightfully diplomatic obviously. Yes Palantier was basically created by him and Peter Thiel back in two thousand three in the wake of september eleventh because if you remember Peter Thiel, he was a founder of PayPal, they'd all these created anti fraud systems. And he's like, Hm , maybe we could use these to solve a problem of like, you know, finding those needles in the haystack of intelligence helping governments use their data better, find the bad guys before they do bad things . Thus was born Palantier , and it's been a pariah from day one. It's worth just talking a little bit about the scale of Palantir, I think. So just before we came on, I saw its market cap is currently three hundred twenty six billion dollars . Shares are up more than one thousand percent since it floated and just seventeen percent in the past year, but probably even interesting than those numbers is the boss Alex Karp, who is should we use the word distinct? Again, it's distinct. You've met him. I have what's he like for people who don't know him? So I did a profile of him a few years ago and I went down to their office in Palo Alto where I met him and I walk in and he's like he's doing he does kata which is a form of kind of martial arts in which you're kind of moving very deliberate movements through the air kind of looking like you know something out of a movie. He was doing Taichi or Kata in the foyer and people were just kind of veering around the boss, you know, the billionaire boss of their company as he's like very deliberately doing his taichi in the middle of this space . And then, you know, we go into his off , he has this wooden sword that he goes and, you know, talks in great length about this wooden sword that he has and what he uses it for . I would say he does not suffer from the lack of clarity of his views . Heath views Silicon Valley as dislike Island of moral bankruptcy where all of the best people, all of the best talent, at least this was a few years ago was going into optimizing ad spend , getting people hooked on apps. And he's like this is just all garbage. You guys are giving up your duty to the country to actually get involved, help the government, you know, help quote unquote war fighters and equip them with the best kind of twenty first century tools that you all know how to build and you're choosing not to . And so Palantier had been the subject of a bunch of protests Cailicon Valley famously progressive. So eventually he left he relocated the company to Colorado. He now lives in New Hamps hire out in the middle of nowhere by himself and he runs this company that has just grown dramatically in the past four or five years basically since he and I sat down the wars in Israel , Ukraine , now Iran . And they've been one of the kind of stars of the stock market and also his star has risen, especially with the advent of the Trump admin istration, their kind of let's call it a more muscular approach to international relations . And they process vast amounts of information , yes, as you said, for defense and for governments, but also for organizations like banks . And over here in Britain, people probably know them best because they won an enormous contract with the British government to process medical data for the NHS. Worth three hundred thirty million pounds. So some campaigners have said we're not sure. Is that dangerous? Is this the sort of company we want to be handling ? Our public data? Louis Mosley, who's the chief executive here, has pushed back very hard on that, saying, look, you need to see what we're doing . He said he welcomes the extra scrutiny that the company is getting. And it is getting a lot of scrutiny here at the moment. But yeah, it's growing and growing. Well, that feels like a good time to introduce this week's guest who's from the largest defence contractor in the UK and Europe, BAE Systems. And they just work , well with everyone, the UK Ministry of Defense, US Department of Defense, Denmark, Sweden, Saudi Arabia, with a market cap of sixty billion pounds This is a really incredibly topical interview given the conflicts going on around the world. Defense isn't something that is easy to discuss. And I think it's fair to say Danny, this is certainly a different side to a lot of the consumer and B two B tech that we talk about. Yes, and I just want to call out you did make a small mistake. It's not the Department of Defense . It's the Department of War . It's been rebranded, don't you know? No way. Yeah, yeah. Do not Dod . Okay . DOW Department . Anyway, so who better to answer that question and about what the future of defense and national security looks like than Julian Kraknell? He is the CTO of BAE Systems and we started by asking him just to go back a pace or two and explain exactly what the company does . With the biggest defense company in Europe pretty much depends slightly on how you measure it , one of the largest in the world. And the way I like to think of it is from outer space down to the seabed. So from a space perspective, we build satellites for communications and observation , then in the air domain , we have the combat air programmes that we're delivering at the moment, as well as all sorts of uncrewed vehicles and drones and similar things. On land we're the largest provider of land vehicles in the Western world . We provide complex warships, we build submarines as well as other uncrued vehicles that float or go on the land or under the sea. And then there's a whole set of systems that connect those together , whether that's communication systems, command and control systems, things like electronic warfare . So it's a very kind of broad portfolio and that's delivered internationally. So very large in the UK, big presence in the US, very large in Australia, as well as lots of other countries around the world. And give us a sense of what your role as Chief Technology Officer entails because I just can't even begin to wrap my head around that. I mean rese,arch the and development must be enormous for BAE before you get on to everything else you do. Yeah. So I'm responsible for four things. The group's strategy overall and thinking about how we run the strategy process. A number of the operational functions, so project management, engineering, man ufacturing, quality . Technology. Now that's not every bit of technology we do. Clearly, there's a lot that happens within the businesses and within the sectors, but my team are thinking about some of the areas we might go next, particularly how we incubate new ideas and think about taking those establishing whether they've got legs and might go somewhere and then also on the CIO as well. So the IT, cybersecurity , all of that kind of stuff. How has AI changed what you do over the past few years? Because I imagine AI has always been integrated into what BA systems does, but with the advent of generative AI, Chattbutt launching in twenty twenty two, for everybody, things have changed quite dramatically. You're absolutely right that AI has been involved Defense has made use of AI for an enormously long time. If you think about the typhoon platform which you may recognise is a combat jet that's used by the UK, it has two very distinctive little flaps at the front of it that keep it stable because the platform itself is inherently unstable in order to be more performant. And those flaps are controlled by an AI system and that's the only reason that the plane stays up and is capable of flying is because there is an AI augmenting the pilot at all times. So the kind of use of AI is definitely something that's been prevalent in defence . Things like generative AI and LLMs are clearly having an impact in some ways in similar ways that you would see in other non defence organisations , you know, helping people write reports and similar . But also in things like controlling drones, being able to interact with them with natural language and ask it to perform a function and they'll go off and task the drone to behave in that way . There are other ways that we're making use of AI, so things like physics based AI models to allow us to design complex components more quickly rather than having to do lots of iterations with humans trying ideas out and then testing them using the physics based AI models to try and get to an answer more quickly. So it's definitely something we're making lots of use of in defence. I just want to get your sense of kind of the moment we're in if you go back to twenty eighteen, it was another moment out here in Silicon Valley in particular where there was this very kind of infamous project Maven drone contract with the Pentagon that Google had. It was revealed. There was a big walkout and you know, you had all these employees being like, We don't want to be in the business of war. Google gave up the contract, Palantier picked it up. Palantier famously left Silicon Valley because they're like basically you all need to be more patriotic, stop worrying about, you know, better ads, make weapons of war to defend the West, et cet,er eta cet era . And there's been a real shift in, especially the last, I would say eighteen months to two years where all of a sudden kind of defense is seen as something that is okay to do now . From where you guys sit as one of the biggest defense contractors in the world , how has the playing field changed in terms of what the big tech companies in Silicon Valley are doing and how they're showing up in your universe compared to, you know, say five, six, seven, eight years ago. I mean, clearly that question of whether you're comfortable to work in defenses is one that we've thought about a lot and we're really proud of our role in defense. Our motto, if you like, is we protect those that protect us. And I think it's a very inspiring thing for us as an organization . In terms of access to technology, you know, my sense is it can only be a good thing that more technology is available to be used in the in the defense space. So where we are today I think is clearly helpful. I think the risk is if that appetite changes and it's to take away some types of technology that we have started to rely on. But certainly from my perspective, it's clearly a good thing that people are both applying their technology towards defense and also actively investing in the area. Are the tech companies, whether they're startups because there's a bunch of new kind of American defense startups like Andero and others, are they showing up in pitches in a way that they just weren't there before? There are a lot more companies interested in defence and I think that has changed fairly significantly over the last probably five years or so. I suspect you type back to the events in Ukraine and that has in some ways it has reestablished the reality of the threat, made it clear to governments around the world that they need to invest in defence and therefore that has attracted investment and technology into the space. How important is it now then in warfare to have the right technology? I mean, is it a question of whoever spends the most has the best tech can win wars? Or as we've seen with , I guess, Iran recently and some of the cheaper technology that they're using, which has been relatively successful in some fronts. Is that you know, do you feel it's still an open playing field or is that darf question? It's not a dough question. There is a balance to strike between kind of exquisite tech at one end and the mass of volume that you can get at another end. And the focus on affordable combat mass is something that I think has become much more apparent coming out of Ukraine. In the Strategic Defense Review in the UK, which was published a few months ago , they talked about a balance between exquisite capability , reusable capab ility and attractable capability and exquisite meaning generally meant crude crude CREW ED with people inside it and therefore with the protection that's necessary around that to protect people. But typically the view expressed in the SDR is probably about twenty percent of your capability would sit in that space, probably about forty percent reusable and forty percent attractable . So you're certainly seeing a recognition from governments , again, driven to some extent, I think, by what's coming out of Ukraine , that more focus on volume and the kind of lower cost capability is necessary to support and augment some of that more capable technology. And apart from the government's review of this, what do you think BAE has learnt from Ukraine? We're very proud of our support of Ukraine The pace of technology adoption is really high . There's been a great significant use of commercial capability in Ukraine. And you see that in a number of different places in the use of commercial drones , in the use of things like commercial satellite imagery , commercial communications . But those technologies tend to get competed out quickly. And we're talking about kind of days and weeks rather than months and years for those technologies to get effectively sort of out competed by the opposing technology . And so that pace of evolution , the pace of adaptation to be able to respond to new threats, embody that in hardware and software, and then deploy it is a real change, I think . There's always been that pace element in defence. We talk about urgent operational requirements, which is essentially the customer has a burning problem that needs to be solved and defense companies are very good at being able to respond to those things. But I think what we're seeing is probably more of that on a more consistent basis . And you know, obviously you make bombs and bullets and tanks. You also make bugs like cyber bugs, you know, because we're in this moment of AI and we just had all this strum and drag about Methos preview and how it can hack virtually anything and everything . And those are quite powerful weapons , right? Especially when you're talking about, you know, things that have been deployed to like hamstring Iran's nuclear program and things like this. Is that part of your operation of like beyond the kind of the big kit that you're also building kind of cyber weapons. We've got a really broad portfolio as I talked about earlier on and I'm not going to get into any specific capabilities if that's okay. Classified I can neither confirm it . Right. But I think what feels like really interesting and different about this moment is that it's kind of everything is being democratized. When you talk about a two hundred dollar drone that can go do real damage versus a two million doll ar Tomhawk missile . That feels like we're in the midst of this kind of qualitative and quantitative shift in how wars are fought. Is that how you guys view this moment? I mean that comparison is clearly true. Relatively low cost drones are being taken out by relatively expensive interceptors . I think what gets missed in that comparison though is what's the thing that you're defending . You know, if you're protecting a nuclear reactor or a city, actually you're going to spend a lot of money to do that regardless of the cost of the thing that's coming at you. So the straight kind of pound for pound comparison in terms of the cost of things I'm not sure is tells the whole story . That said , it's clearly important that given this volume game of large numbers of relatively low cost attack drones that we can respond to that. So one of the pieces of research that we've been doing and have just announced actually is taking a low cost rocket, attaching a laser guidance system onto the front of that and then firing that from both a drone and also combat air typhoon platform. So suddenly you've got a really lost interceptor that's able to respond to that. And I think that that kind of I was going to say arms race, that's exactly the right term. That kind of back and forth between technology and then the counter to that technology is going to keep going and is one of the things that drives innovation in the defense sector. And to Katie's earlier point around, you know how, AI has changed things . When there was the blow up between Anthropic and the Pentagon, we had a guest on Sean Gorley out here . And he said a lot of people like within the defense space view AI a little bit like nuclear weapons . Like if you have clear superiority in this very powerful technology, it is what they call the next kind of offset. Like you render your opponent defeated before you even have to fire a shot because they just know and you know that you're just going to win and win decisively and cause real damage. Is that accurate or is that how you guys view the world? I think what's really being talked about there is speed of decision making . So that concept that if you can make decisions faster your enemy that you can get inside their decision cycle, outthink them and therefore outmaneuver them and at some point you're so much faster than them that they're unable to respond . That's been a constant in warfare forever . And I think what we're seeing here with AI is the opportunity to really accelerate that. I'm not sure I would describe it in quite the same way in terms of that kind of life is fundament ally different. But clearly, what it is doing is creating opportunities to make decisions much more quickly to take in volumes of data that would have been harder previously and synthesize those, bring them together in order to make better decisions faster. And that does clearly have a strategic benefit. So we are in a geopolitical arms race then when it comes to developing AI . It sounds like from what you're say ing to try and get ahead of other people to get it was you say it described it get inside their heads. I mean that's sort of what we've got to make use of the best technology that we can in whatever space that we can in order to be able to out compete our adversaries. And AI is clearly a significant element of that. I don't think it's the only element. There are lots of other areas where technology is advancing. I'm going to ask you a question that you'll probably hate , but I have to ask it. How has your job changed with Donald Trump in the White House and the sort of split in the special relationship in the last year or so . I do hate that question. So I'd look at it from a couple of different angles . We have a very large US presence. Because of US federal legislation, that is entirely separate from the rest of the business . And so they are working with the US administration and working through the impact of that. For the rest of the business , you know, we're thinking about where our customers are going in terms of their decision making around new equipment, the types of capabilities they want. I think it's not entirely related but the issue of sovereignty , who has control , particularly who has the ability to make decisions about how you use equipment , how you can modify equipment. You know, that again tors ever thus in defence that's always been a concern, but certainly in the recent UK SDR strategic defence review, you see a much greater focus on sovereignty and the element of industry as part of the defence enterprise. And again, I think that's drawing on the lessons of Ukraine that deterrence is not just about the capability that you can deploy today. It's about how you can regenerate that, how you can iterate that and how you use industry and a close relationship with industry as a critical part of the overall defence estate, I guess. We'll be right back Julian, you mentioned control , which brings to mind autonomous weapons . And Palmer Lucky, who I'm sure you know, runs Androil, which is like worth thirteen billion dollars, you know, the defense tech startup. Yeah, I love that you describe it as a startup. Exactly. It's very big now . But he's his kind of line is I love killer robots. Like that's what they're building. And I'm just wondering how you guys think about that. Like where are we on the continuum of just you talk about decision making , control and especially in the context of China where they have this huge manufacturing base where they're building more drones than the rest of the world combined and all of it and they're racing again ahead in AI. Is this where we're going? And how do you guys think about killer robots? This idea of just letting the AIs go to war , make decisions , and blow stuff up . I don't really love the phrase killer robot s. What we're seeing at the moment is actually a lot greater use of remote controlled systems. So you've got human in the loop in most of the systems that have been deployed, certainly in Ukraine, and that reflects the fact that you've got a very mobile battlefield that's changing on a regular basis and therefore having humans actively engaged is the right choice. We will inevitably see more autonomous systems and indeed we are doing a lot of work looking at common autonomy systems and the deployments of those in all sorts of domains land sea and below the sea as well . You know, the use of autonomous systems is going to be a political decision as the acceptability of that and the role that humans play in that decision making process, whether you have a human in the loop or a human on the loop who is making the decision about where you deploy the system and the rules of engagement that are put around it. So I think we clearly will more autonomous systems over time . I have to say I'm not sure . I do share the vision of armies of autonomous systems fighting against each other to determine who wins it . I don't think that makes sense actually in a political context. But being clear around the rules that you can put around systems so you can have confidence how they're going to be used. That's where an enormous amount of thought in government and in ministries of defence is going on. And I think we will see that evolve over Presumably this is like , I don't know, self driving cars. Like the technology's already there, right? It's just the question of how do we roll it out? In other words, there has to be a decision to your point by governments the West or whatever to cross that rubicon to actually be like, okay , we're going to take our hands off the wheel. And maybe that moment never comes . Well, look, we do have autonomous systems now. So a defense of a maritime platform will be done Some of it will be being done autonomously that as a missile comes in, there will be systems that spin up, see that, and fire a response faster than a human could engage with. But there's a lot of testing around that clear understanding of the situations in which it will respond. But the rubicon, in that sense, has been crossed. There are autonomous systems. I think the question is how far you then go with that and ultimately that's a policy decision. And does it mean the end of boots on the ground. One of the things we can use autonomous systems for is trying to take humans out of harm's way wherever possible . But does it eliminate boots on the ground? At some point you have to be able to demonstrate political will and you that know,'s about being able to hold ground. Katie always gives me flat because I love a robot . It's just a male thing. That's I love robots. The humanoids. There's so many humanoids. And you know what, the humanoids are coming, et cetera, et cetera . And it feels a little bit ridiculous in science fiction, but to the point around boots on the ground, if you have built up an industrial base where you can pump out five hundred thousand million Star Wars . Yeah, exactly. Troopers . Is that a realistic thing? Is that like, you know, when you talk to the Pentagon, they're like, yeah, we're just we really love to have a Droid Army in ten years where we don't have to, and it sounds ridiculous, but also it's keeping humans out of harm's way. It's a little bit hard to know how to respond to that. We will clearly see more autonomous systems. I think it's unlikely we will see armies of humanoid robots because why would you design them to look like humans in the first place for a start? You would design for the mission, but you will see more autonomous land platforms, more autonom ous air platforms at working junction in order to take humans further back from danger where you can. But that will be I go back to my earlier point, that is in conjunction with other systems and that element of in the moment decision making, I think, will always be will always be necessary. What sense do you have about the way politicians and governments are leaning on that issue of sort of trying to use robots more and taking boots off the ground . Like which way do you think we're going? If you're a betting man. Yeah. The SDR was clear about more use reusable and attrableact platforms where you would expect to see autonomy. The Navy is talking about its future vision for the Navy, which is the hybrid navy which will have more autonomous platforms alongside leaner crewed vessels. So I think we will see that direction of travel continue, but I don't think we'll get to the point where the humans aren't there . Well, I thought he was incredibly diplomatic. I mean it is a really difficult thing to discuss. And that line that he said, you know, in defense, our motto is we protect those that protect us. I mean a lot of people, I think, will wonder about that issue of protection. But if we put that aside for one moment the future that he painted of the defense industry was really interesting. Yeah. And like I said, there's just a whole new wave of companies in defense , like a whole new wave of defense startups . And it's just it is quite extraordinary how dramatically has changed. And the one thing I would say two second history lesson is this is really the start of Silicon Valle . You know, coming out of World War two, there was a bunch of Pentagon contracts. You know, Lockheed Martin was out here, like a lot of the kind of the tech industries started with big military contracts building stuff, whether it's chips or missiles or bombs or radar systems or whatever kind of gear . And then over the course of the years, the kind of industry was like, yeah, we don't want to really do that anymore. If we do, we're not going to talk about it. And now it's kind of come full circle. And you have this whole new generation and this whole new attitude that is kind of proudly patriotic about this, whether you know, people can have their own opinions about it, but it is quite extraordinary how the kind of the shift has happened I would say again over the last five years going from, you know, big walkouts and protests to hey check out our new cool like you know bomb robot drone thing or whatever it may be On the tech front actually,, I mean, obviously bomb robot drone things are sort of interesting. But the most interesting thing to me was the question that he didn't answer when you asked him about cyber weapons. And you said, are you building cyber weapons? And he said, We've got a really broad portfolio . I actually wouldn't go into the details of that because I think you're spot on in terms of the future of warfare as quant um computing develops, you know, the acceleration of generative AI , it is absolutely that cyber warfare that not only governments, but obviously businesses all organisations absolutely terrified by. But yeah, he dodged that question quite neatly. Yes, I think we can infer what he really meant. Yes, exactly. And he has no kind of what's he going to say, right? It's like, yes, actually we are building cyber super weapons, but clearly that's part of the mix. Do you know what? I'm sorry to say I'm not sure we have answered that big question Is AI actually keeping us safe? I don't know how I feel about that actually feel like it's Yeah, I don't think we know I don't think we know. I think it's just like it's like everything with AI actually going back to something that Elon Musk said this week in court, he's like AI is double edged because you can do all of this new stuff, theoretically, you can have all these scientific breakthroughs , but you can also build really dangerous things . And I think that we're in the middle of this process of trying to figure out what we enable, what we're okay with, what we're not . And obviously when you're talking to BAE , which is the largest defense company, one of the largest in the world and certainly in Europe , you know, they're right at that bleeding edge of figuring out , you know, what are we going to this for? What level autonomy are we good with? What are we not? All that stuff. So it's really tricky. It's a really interesting, weird time to be alive. If you guys like the show, tell us go to techpod at the times.co. UK that is techpod at the times.co. UK . Leave a comment. Good or bad, whatever. We love it. We love it. We love feedback. And we will see you back here next week. See you next week. Bye bye