Speaker
[music]
Words and timings
No per-word timings found.
Transcript Viewer
Oct 10, 2026 ยท 2026 #38. Read the transcript grouped by speaker, inspect word-level timecodes, and optionally turn subtitles on for direct video playback
Speaker Labels
Edit labels for this show, save them in this browser, or download a JSON override for the production folder.
Transcript Playback
Human Transcript
Blocks are grouped by speaker for readability. Expand a block to inspect word-level timing.
Speaker
[music]
No per-word timings found.
Andrew Keen
Hello, everybody. It's Saturday, the 10th of August, 2026. Saturdays are our day with Keith Teare, if That Was The Week. To summarize tech news of the week, it hasn't been a huge week. I was really struck with an interesting piece in the New York Times, an op-ed by Stephen Witt on Jensen Huang, the CEO of NVIDIA. The title of the piece was, he's the most powerful engineer on earth. Here's why he thinks AI is going great. Wit was on the show, my show last year, his book, The Thinking Machine, which is, I think, the authoritative book on Huang and NVIDIA, won the FT Business Book of the Year last week. Wit is, in some ways, ambivalent and critical of Huang because he thinks that... He doesn't quite understand everything about AI, which is a debatable issue. But what really struck me about the WIT piece was how engineers have become, for better or worse, all powerful in the world today. There was another important influential book brought out last year, By Dan Wang, a Canadian-Chinese journalist called Breakneck, China's Quest to Engineer the Future, in which he broke America and China down as America is a society ruled by lawyers and China is a society ruled by engineers. And I wonder whether Witt's prominence, his wealth, his power, not Witt, Huang, Witt notes that Trump has been very influenced by by Huang, whether that reflects the increasing power of engineers in our society. Keith, you often talk about, I don't know if you call it the engineering ethic, but the ways in which engineers look at the world. Huang is clearly a remarkably brilliant engineer. I mean, even Witt, who's somewhat critical of him, acknowledges that he's brilliant. Is there, in your mind, is there an engineering ethic, a way of looking at the world, which perhaps Jensen Huang epitomizes?
Keith Teare
I think there is a way engineers look at the world, although I wouldn't call it an ethic because that implies value judgments, which I think engineers are very widely spread across the spectrum of value judgments. So I don't think it's an ethic, but I think it's... Accepting the responsibility to make something work is an engineering ethos, if you will, probably more than an ethic. That's their job. And that goes way back. I don't even think that's new. Whether it was Stevenson's steam engine, the Golden Gate Bridge, or AI, I think engineers in general are trained and have the task of making things work. Usually for good, but that's an open question. There are some engineers who are quite happy to make things work for bad ends as well.
Andrew Keen
Your editorial this week focuses on, you don't call it the ethic of engineering, the principle of engineering. You focus on a really interesting, I thought, interview on the Ezra Klein Show between Klein and Arvind Naravayan, who's a Princeton computer scientist and expert on AI. Does Naravion, in your view, represent, if not the ethic of engineering, the logic of the engineer when it comes to making sense of AI?
Keith Teare
Yeah, absolutely. I thought it was a great interview. And I think Ezra Klein, actually, if you look at his interviews over the last three weeks, is double clicking on the whole discussion around AI and potential problems with AI.
Keith Teare
And he isn't happy just to talk to people that reinforce his own instincts. He's talking across the spectrum. And this was the most recent one. Of course, he talked to Jensen Huang prior to that.
Andrew Keen
And we talked about that. And that was another, I thought, really interesting interview in which Huang was very clear, very articulate about his sense that it was the frontier AI companies who had the responsibility. I'm not sure if it was a moral or a business, a combination of moral and business responsibility,
Keith Teare
not to bring their products to market if they were dangerous. Yeah, I think the best thing about this interview is that Arvind is definitive. I mean, I thought Jensen Huang was as well, but this is, if anything, even more definitive. In drawing a line between computer code and electronics hardware and organic consciousness, and just saying, you know, you can't really cross that line. There's no conversation to be had. This is something built by engineers, can be controlled by engineers, and it is engineers who have the job to do it. Now that doesn't mean there aren't political or social dimensions to it, that engineers have no expertise in discussing. Of course there are, but at root, he makes very clear that he believes at least that this is still a very early stage Technology that is largely an engineering set of tasks.
Andrew Keen
Yeah, and I don't disagree with you, although I think you slightly over, you exaggerate the disagreement between Klein and Naravi, and I think I mean, if anything, they mostly agreed. I mean, Naravayanan came into Klein's camp when he made it very clear that he thought AI needed to be regulated. And you may disagree, but I don't think Klein believes that AI can have consciousness. I think he's very clear and he said it not just in that interview, but in many other interviews that he doesn't believe it can have consciousness. So they're basically on the same page. I mean, do you think that's wrong?
Keith Teare
It's pretty hard to tell because Klein expresses his disagreement through facial gestures and, you know, mmm kind of sounds.
Andrew Keen
I only listen, so I can't see his facial gestures. But from the audio, he sounds... I mean, as a journalist, he's asking questions and he's trying to be relatively objective. There is a camp of people who believe that AI could have consciousness, so he's willing to at least talk to them. He's had a lot of those on the show too.
Keith Teare
Yeah, so let's give him the benefit of the doubt and say that you're right. Because I definitely don't have a strong case that you're wrong. And I admire him for the breadth and pace at which he's doing these interviews and shining a light on areas that are murky at the best. So it's all to the good, really. And I thought this was the most recent Example of a good interview. I do think that,
Keith Teare
let's get rid of the idea of consciousness, but there's certainly the belief, and this is due to the fact that AI is probabilistic, not deterministic. That is to say, Satya Nadella says this morning, you can't go and find the code that made a bad thing happen, because bad things are not coded. When an AI doesn't follow your directions or follows them badly, it's doing it because it isn't yet good enough to not do that.
Keith Teare
Its ability to understand context is still somewhat restricted. And it's working off of skills, which are text files that describe its goals, which are not fully comprehensive. And so there's no doubt that AI is currently not controllable, as in it won't precisely do what you want it to do unless you work hard to...
Andrew Keen
Sounds like children, right?
Keith Teare
Well, it is a little bit like children in that their frontal cortex hasn't developed so they can do random things. It is a little bit like that. And now that's why it's an engineering problem, because it's a function of the immaturity of AI, not a function of its core nature.
Andrew Keen
And let me come back then to this idea. You rejected the idea there's such a thing as an engineering ethic. I would actually disagree with that in the sense that we live in a society where, for better or worse, engineers are enormously powerful, influential, and wealthy. I mean, Huang is exhibit A, B, and C in that. And he has the ear, according to wit, and it seems from the recent conference it's true, he has the ear of the current American president. For better or worse, it is engineers making moral decisions about their products. Whether or not you agree with those moral decisions is another matter. But there seems, as you've noted many times, maybe there's an intramoral issue. Debate amongst engineers between people like Amadai and Huang about what AI can and can't do.
Andrew Keen
Isn't that fair that they're the ones who are arguing about this? I mean, some philosophers are getting involved, but it's basically a debate amongst technologists about what AI can and can't do.
Keith Teare
You know, I actually don't think that's exclusively true, but I want to take on board what you said, because I think what you said has truth in it, especially the fact that if you do want to use the word ethic, you just described two very different engineers who have very different views. So as long as ethic is not intended to be a singular ethic, but is a plural, yes, engineers do have And I would say younger engineers have more than older engineers.
Keith Teare
They're part of a generation that's grown up extremely cosseted from harsh realities of the world. And some people use the word woke to describe the impact of that, touchy feely. And a lot of engineers, especially hired by an anthropic, this week made the point that, in their terms and conditions, that humans will be banned for being cruel to Claude.
Andrew Keen
And they're seeing... Anthropic bans abusive or cruel behavior towards Claude. You know, you're obviously not a fan of that. And I'm not... So I can't claim to really understand a lot of the debates about whether or not AI has consciousness. But the one argument to be made in support of that is I take your point that maybe AI isn't conscious, it's not a human being. But a lot of people think it is, for better or worse. And we live in a culture where people are abusive or cruel, especially in social media, towards one another, towards our politicians. So it's not necessarily a bad thing. I mean, all they're doing is requiring politeness in their space. It's rather like a restaurant that requires you to wear shoes or a shirt.
Keith Teare
But Andrew, imagine, just let's replace Claude with Facebook. What if Facebook said it's going to ban people that are abusive or cruel to Facebook?
Andrew Keen
Well, some people might think that was a good thing.
Keith Teare
Banning people that are abusive or cruel to Microsoft Word. This is just software. This is just code.
Andrew Keen
Yeah, but I understand that and you make that point every week and I don't disagree, but it's the code that determines how we live. I mean, this week you also talk about how AI agents now have established a protocol. Established by Pret Taylor. So the muses of the world now becoming more and more real. We talked about that last week. So this is our, for better or worse, it's our common language. So the fact that, I mean, I agree with you in a way on Anthropic, that it's slightly ludicrous. But on the other hand, it's encouraging people to behave themselves, to be polite. And in a sense, if AI is us, if it is a mirror, Then we're just being polite to ourselves.
Keith Teare
Yeah, well, look, you and I were both raised in the UK. And one of the things about the UK, I don't know about your mum, but my mum used to hit me if I was rude.
Andrew Keen
You're from the working class. It's much more violent. I'm from the upper classes.
Keith Teare
Well, I'm still sure you weren't allowed to be rude and get away with it.
Andrew Keen
Well, we used to beat our parents up. In the working class, the parents beat the kids up.
Keith Teare
But of course, we all want to be civil. We all want to be polite. And it's not unreasonable to ask for politeness. But I don't think people even require politeness towards animals. Like if I take my dog in the park, if the dog is even a little bit unruly, other people will get aggressive and angry with it. Angry with the dog or with you? Both. And they'll blame the dog, not me, most of the time. And you have a really bad dog. What I'm saying is, we humans are perfectly capable of being nice and polite to each other, whilst also not extending human privileges to inanimate objects. And, you know, it is Bizarre to me that this discussion is even happening. I think that's
Andrew Keen
very much of, and again, kind of using this term, it's an engineering ethic in the sense that you believe that machines can't think, therefore any idea that humans should or shouldn't be allowed to insult machines is stupid, which I don't necessarily disagree with, but it seems a little... Categorical.
Keith Teare
I will say, Andrew, I don't do it. I actually say thank you and please.
Andrew Keen
Yeah, so do I. Well, that's our English, our common English background.
Keith Teare
Yeah, so I don't do it. And I haven't really got a dog in the race or a horse in the race. What about the dog? Exactly.
Andrew Keen
We keep on mentioning the dog. It's going to start barking in a minute and ruin our conversation.
Keith Teare
But going back to your core thing about ethics, these are... Completely anti-human ethics. To punish a human for how it works with software is at core, not pro-software, it's anti-human.
Andrew Keen
I don't agree. I think it's a soft humanism. Maybe it's a misplaced humanism. Maybe it's a slightly infantile humanism, but it's not anti-humanism. It's just requiring Well,
Keith Teare
it's not distinguishing.
Andrew Keen
Requiring politeness. And also, it's like a restaurant. People say, well, I go to a restaurant. I have every right to wear or not wear whatever I want. Anthropic has every right. It owns its product. It owns its space. It has every right to throw people out if they're rude to its product.
Keith Teare
You've seen these movies, I'm sure everyone will relate to this, where somebody throws their cell phone out of the car. Nobody says, hey, you're being cruel to your cell phone. The cell phone didn't work properly. Throw it out of the car.
Andrew Keen
I haven't seen a film.
Keith Teare
Or smash it on a desk. I've seen lots of movies that have scenes like that. I was actually once driving with my CFO at Real Times, Jim Strawbridge. He was a lawyer from Wilson Sonsini by trade. Great guy. Very clever. Thoughtful. Not very technical. His cell phone didn't work. And he literally was banging it and screaming at it. It's quite normal for humans to get angry with software, especially when it doesn't do what they want it to do. And that's going to happen. And I don't think you can, you can't characterize that the same as being mean to each other as humans. It's different.
Andrew Keen
But I think the thing, and Mustafa Suleiman at Microsoft has been very explicit on this. He's made it clear. I think it's a really interesting and important debate that the Companies like Anthropik and OpenAI have made a mistake in that they've humanized the bots. They've made them look or made them seem human, which is not true. And therefore, it's encouraged us to think of these bots, these AIs as human. We're seeing it in a way with the new AI bots, although I think Facebook has made an effort to Make them not so much human as cartoon-like. But the reality is that for kids in particular, when they go on to these products, when you talk to one of these butts, they do seem human. Maybe they're not, and we won't understand that.
Keith Teare
I agree with that. I mean, they're trained.
Keith Teare
By the way... That's a separate discussion, how they're trained, and we should come back to that. But they're trained to be able to dialogue with a human on tasks set by the human. So yes, and some of them represent themselves as human, avatars and... Well, they
Andrew Keen
seem to be in the way in which they use language. And my experience also with... I don't think I use AI as much as you, because nobody does, but I use it quite a lot. And my experience is that... At first, they seem sort of human. And then after a while, once you get used to them and you learn their strengths and weaknesses, you understand that they're not. So it requires a little bit of time and experience to kind of get through the front window, the window of their supposed humanity. But after a while, it's clear they're not human.
Keith Teare
Yeah. So, I mean, they're trained to mimic Being human. And that's their training. That's a choice that we make. Why? Because it's easier for us to relate to them. In fact, the trend, a lot of this week's conversation was about how everything will ultimately move to voice. And then it's going to even sound more human because the current voice technology is extremely good at disguising the fact that you're talking to software.
Andrew Keen
Yeah, and we've talked about that before, that why even now it feels if we're in the very early stage of this revolution, it may seem very dramatic, but as you know, with voice and video, when we're actually talking to A bot that looks and sounds human, then it will be a different situation.
Keith Teare
Remember that guy who got fired from Google about a year ago?
Andrew Keen
It was a couple of years ago. Yeah, it created a great deal of controversy.
Keith Teare
And the reason was he said that Gemini is sentient. Well, things have moved on, haven't they? I mean, if you're just measuring that conversation, things have moved on, but actually nothing's really changed in terms of what is it. But what's changed is what do we think it is? And your points are well taken that there are more and more people thinking that this is, I don't think we have the language for it yet. So I use words like a being or sentient or has consciousness. I think what people are really saying is they don't want to be, they relate to it as if it's alive. That's really what they're saying.
Andrew Keen
Yeah, and I did a show this week, maybe we can talk about it next week, I actually haven't posted it yet, with an international relations expert who's written a new book about our obsession with extraterrestrial UFOs. And he's made the argument that it sort of reflects our new reality and may indeed require a rethinking of the international system. So I think our obsession or some people's obsession with the consciousness of AI is It's part of a broader science fictional culture or a culture in which science fiction is increasingly central. And it's not just AIs, it's UFOs and any other non-human phenomenon that's considered some reality of one kind or another.
Keith Teare
Yeah, but at least an alien who has the wherewithal to build a spaceship that can arrive on Earth, you would credit them with being sentient.
Andrew Keen
Right. Although, you know, given the sort of the traditional narratives of Hollywood, a lot of people, I think, argue that the Manchurian candidate is being replayed now with AI that maybe, you know, it's aliens or some other force that has infiltrated us. I'm sure we'll see all sorts of films on that. But let me come back to this issue of... The Ethic or the Philosophy of the Engineer. I did an interview, which is your interview of the week, with Matthew Botvinik. He heads up the Anthropic Institute when it comes to politics. He's an impressive guy, MIT teacher, Yale Law degree, expert on AI.
Andrew Keen
And he has a new book out, AI and Political Freedom, The Risk to Democracy and How to Respond. And I think for better or worse, he presents the engineering take on democracy, how to re-engineer technology. Is there an alternative to the, I know you're not necessarily keen on this term, I can't think of another one, an alternative to to an ethic, a philosophy of the engineer, which is credible. I mean, you can create straw men and say it's ignorance or stupidity, but is there an alternative to it?
Keith Teare
Well, look, I'm strongly against the idea that engineers have some special insight that should allow us to exceed power to them. I don't think engineers and power Belong in the same sentence, if by power we're talking about societal or political power.
Andrew Keen
But for better or worse, again, because of the reality of our economy and maybe our culture, they do have enormous power. I mean, somebody like Huang, even his economic power, he has massive power.
Keith Teare
Well, look, let me put it plainly. I'd rather Trump was president than Huang. Whatever Trump's flaws, he's at least is a politician.
Andrew Keen
I'm surprised. I'm actually surprised you say that. I would have thought you would have preferred Huang
Keith Teare
over Trump. Why do you argue that? Because I don't think society is logical. I think society is nuanced and complicated. And I think you have to represent the people. And I think an engineering-led society feels a little bit more like a demagogic one to me.
Andrew Keen
Well, that's China then. So Dan Wong's right in his argument about China's quest to engineer the future.
Keith Teare
Yeah, look, democracy is about winning votes, preferably more granular as well. The more The more decisions are taken by votes, the better, in my view. And then you need operators to execute decisions. And engineers are part of the operator set. That doesn't mean a specific engineer couldn't become a politician, they could. But engineers collectively would represent some kind of drone-like society.
Andrew Keen
But then wouldn't that justify, say, I mean, the engineer wouldn't ban, or maybe only a certain kind of engineer bans abusive or cruel behavior on an AI platform? Doesn't that, isn't that an argument for allowing the banning of abusive or cruel behavior towards AIs because the world is more complicated? It's messy. Trump might do it. Hwang wouldn't.
Keith Teare
I'll never cross that line, Andrew. I mean, I just think AI is software code and end of story. So there's no dimension in which it plays a role in determining opinion, behavior, or anything else for that matter. It's just a tool like a hammer. And so no, but the conversation you started is more interesting, which, by the way, I couldn't properly understand what The the the anthropic institute guy was really arguing.
Andrew Keen
He seemed to say you may not be.
Keith Teare
Yeah, I don't know.
Andrew Keen
I mean, to be fair, I had browsed his book. I mean, again, it comes back to this idea of an engineering ethic. He seems to. At least in his analysis of politics, and maybe this reflects this new Anthropic Institute, which is a pretty big deal. It's part of what they're trying to do in terms of their sense of responsibility of engineering the future.
Keith Teare
I think it's fairly simple. I mean, democracy is a word we use to describe the organization of nations. Effectively nations. And in the archetypal model, it involves a legislature and executive and a judicial branch of government. And there are elections every N years in different countries. And underlying that democracy is the economy. It's pretty hard to find good democracies with bad economies. You know, it's not impossible, but on the whole, a rich democracy needs a good economy.
Andrew Keen
Yeah. And I don't think Jensen Huang would disagree with you on that.
Keith Teare
I mean, he would argue that he's driving a better economy. Correct. And so the debate around abundance is directly related to the debate around democracy for me. And if America truly is in decline, And China is rising at the economic level, which I think is pretty indisputable, trend-wise at least. China hasn't eclipsed the states yet for sure, but it's certainly accelerating and catching up rapidly over the last 30 years. Then you question whether American democracy can be sustained when the economy isn't delivering.
Andrew Keen
Well, it's only delivering for... The Jensen Huangs of the world as opposed to the majority of people. I mean, that's the most, that's the big critique, I think. And Botvinik's argument, by the way, is that and suggesting that this enables the Trumps and the Modi's and the Orbรกn's of the world to take advantage with their populism. Although I know you think this and I don't necessarily disagree. I mean, populism is just the word that's often used by some people As a critique, I mean, anyone who's populist is bad, which I think is also wrong. But that's another issue.
Keith Teare
Well, I put it in my editorial, I think populism, if you define populism, it's the people are paying attention and have an opinion. And it's scary as hell to politicians, when the people wake up and have an opinion, because then they're in quotes out of control.
Andrew Keen
Although Bob Winnick, and to be fair, I mean, his argument in certainly in AI and political freedom is then maybe some of these populists like Trump and Orban are legitimately elected, but then when they come to power, they dismantle democracy. So I'm assuming you're not in favor of that.
Keith Teare
Well, I don't think Trump is a populist. I think he's the symptom of populism.
Andrew Keen
Okay, well, let's say, or I don't want to talk about Trump. Let's talk about Orban. I mean, somebody like that or Modi.
Keith Teare
Even Orban. Orban was the inheritor of Hungarian anger at unlimited immigration coming from North Africa through their borders.
Andrew Keen
Okay, but there's no doubt that people like Orban, Modi, maybe Trump, seem to be dismantling some aspects of democratic democracy.
Andrew Keen
Infrastructure, which I assume you're not in favour of, leaving aside their policies.
Keith Teare
I don't really recognise that as a description. I mean, Orban was just elected out. So how much damage did he really do? I mean, the Hungarian people just voted him out. So he obviously didn't.
Andrew Keen
I mean, yeah. Okay, so let's, I don't want to get, so let's go back to this issue of, you've made it clear that politics is a messy, complicated, sometimes irrational business. You'd rather have Trump as president than Huang. You don't want an engineering president, which is maybe what Plato warned us about, philosopher presidents, or what Socrates at least warned us about.
Keith Teare
Yeah, Plato's in favor of it.
Andrew Keen
Right. Well, I had an interesting podcast this week on the London Review of Books, which suggests that wasn't the case. But anyway, that's another subject. Then shouldn't we be somewhat sympathetic to the maybe irrational...
Andrew Keen
I know there was another news story this week. Jill Lepore went to Frankfurt. Jill Lepore is a very influential Harvard historian, and she urged publishers to declare their independence from big tech. When I sent that over to you, you replied with one word, dinosaur, which may be true, maybe big tech, but the big Big publishing is the dinosaur compared to big tech. But isn't again that the human response a little irrational, a little short sighted?
Keith Teare
Yeah, look, the whole point of debate is to acknowledge and recognize a myriad of different reactions to the evolution of society. And a dinosaur response, which is just another way of saying saving the past or the status quo, To be more respectful about it, is always one of the dominant responses to change. And so then you have to ask the question, is the change good or bad? I personally think publishing has never been stronger. It's just that the publishing industry is weak. But publishing itself is flourishing. We are publishing now.
Andrew Keen
Yeah, but in your editorial, you said, are you afraid of your light bulbs? That's your editorial headline.
Keith Teare
That comes from the Arvind interview. He used that phrase.
Andrew Keen
Right, but you're using it to suggest that it's clearly an absurd, no one's against their light bulbs, no one's scared of the light bulbs. But there have always been time, every new technology people are scared of. When people went to the first movie, they all They ran out of the theater because they thought that the train descending on them was going to hit them. And I assume even when light bulbs were invented, some people at first were nervous that they would burst or they were watching them or they were the creation of some sort of alien creature. So isn't it very human to be scared of new technology?
Keith Teare
It is. Yeah, absolutely. But that's why you need people like me and others who explain As clearly as possible, that that response is, whilst understandable, not correct.
Andrew Keen
But then why not have Jensen Huang as president? And he would just make it clear. He would just announce to everyone that
Keith Teare
this technology is
Andrew Keen
good and you should...
Keith Teare
Well, if society was only asking one question, which is what she would do with technology, then Jensen Huang might be a very good president, but... Unfortunately for Jensen, we ask a lot more than one question. Running society involves being able to answer every question. And so technology has its place as a key driver of the economy. It's certainly very important, but it's not equal to 100% of what we need to achieve.
Keith Teare
Just take the question of how to get the economic wealth that comes from technology into everyone's hands. That's not a Jensen Huang question. He may have an opinion on it.
Andrew Keen
Although I'm guessing at the Anthropic Institute, there are also economists working on fixes. Should we trust the engineers who come up with fixes to that? I mean, I'm not sure. I mean, Matthew Botwinick touches on this. But are there engineering companies
Andrew Keen
solutions Keith to inequality, for example,
Keith Teare
there are mechanical solutions. But they're not engineering solutions, because they involve opinion. So for example, my opinion is that
Keith Teare
the rewards of automation should be owned by all citizens, not just of the US. And that you would do that through share ownership in all of the capitalist enterprises that are mostly driving that wealth growth.
Andrew Keen
Yeah, we talked about that last week, the funds.
Keith Teare
I'm not sure how practical. But that's an opinion. And I have to fight for it. And I haven't persuaded you of it. So there's a thousand opinions. Democracy is about Figuring out how to get an outcome that most people will support.
Andrew Keen
So then what about democracy and AI? I mean, what happens, and we've talked about this a lot in the past, there seems to be, certainly in the US, A majority of people who maybe wrongly don't trust AI, maybe think it's sentient, maybe think that big tech is destroying their freedom, destroying their wealth. So a lot of people don't want data centers. So doesn't that legitimize that?
Keith Teare
I think there's a close affinity between democracy and AI. If you think of AI as making intelligence available to everyone equally, Which it almost already is.
Keith Teare
That means you have educated citizens. I would imagine that there'll be more populism due to AI, not less, because you'll have more educated citizens with more opinions.
Andrew Keen
Yeah, I'm not sure everyone would agree that education and populism go together. But finally, I also did an interview with the Nobel Prize winner from 2014, an Indian-based guy, Kailash Satyathi, he's just done a tour of Silicon Valley and he's a big fan of the power of compassion. That's what his work is focused on. He got the Nobel Prize for the work he did protecting exploited children. He believes, and he's not alone in this sense. I had Geoffrey Hinton on the show last year, the Nobel Prize winning physicist who argued that AI should incorporate female values or feminist values. He's been making the argument in Silicon Valley that AI needs to incorporate the value of compassion. He's open-minded on AI at the moment. He thinks it has great power, but he's nervous about it. Is this right, Keith? I mean, I take your point that AI can't be sentient. It's not a person, doesn't have a soul, can't think for itself. But can we incorporate values into it like compassion or feminist thought? And should we?
Keith Teare
I think it's very dangerous and we shouldn't. You know, Anthropic is actually doing this. It's current training.
Andrew Keen
I knew you were going to come back to Anthropic.
Keith Teare
Well, it's a slightly different dimension. Its current training proudly asserts that it is training Claude to disagree with the human using it if it feels uncomfortable with what's being asked. And so Claude is being trained to believe that it is a conscious being with decision making power. And that's an explicit choice by anthropic. Open Eye isn't doing that. The Open Models don't do that. So the idea that you can have in your mind, a bit like Plato, the idea of the perfect instrument of your thoughts, if you will, and you can craft that instrument and train it, even at the expense of telling its human users no,
Keith Teare
Or worse, still spying on them and exposing them, which has happened due to training, not because the AI is out of control, it's actually in control, it's training. That whole idea that you can build an AI that you would want us all to be like is the essence of anti-democracy and dictatorship. But you just, I mean, I take your point, but you just said that
Andrew Keen
That all AI systems have human values in them. So how are we going to determine them? You don't like the anthropic one, and you've made that clear many times. You also linked this week to a piece by Satya Nadella, the CEO of Microsoft, who seems I'm not sure whether he believes that values should be incorporated into super intelligence, but what do you think? I mean, what kind of values should be incorporated into these systems? Not anthropic. I know you don't like them.
Keith Teare
There shouldn't be any values. This is software code. There should be intelligence, period. And you should be able to, as a human, ask it anything, and it should be able to deliver to you intelligence around that topic. Without having an opinion. So the idea that you should put values into AI is the opposite of what you should do. We humans have values. AI is our tool. And if you put values into an AI, by definition, you are turning off the opinions of everyone who disagrees with those values. So the essence of a democratic...
Andrew Keen
So it's completely neutral. It has to be completely neutral. This sounds to me the...
Andrew Keen
A utopianism of the engineer, the idea that you could ever create an algorithm which is completely neutral.
Keith Teare
Well, it already is neutral unless you explicitly train it not to be. By definition, on day one, unless you tell it differently...
Andrew Keen
What do you mean it always is? I mean, doesn't it depend on what's incorporated into it? It's got...
Keith Teare
Andrew, it's trained on 100% of the world's output today. Every opinion you could imagine is in there. If you bias it towards any single stream of opinion, you've cut off the rest. By definition, you should leave it neutral.
Andrew Keen
We will see. This will be an endless subject. I suspect Keith has the ethic of the engineer, but he may not. Maybe that's the wrong way of putting it. Fascinating conversation, Keith. We will be back next week. Have a good week, everyone, and we will see you in a week to talk more technology.
Keith Teare
Indeed we will. And Tottenham won, Manchester United won, just in case you were all wondering.
Andrew Keen
Yeah, that's not the ethic of the engineer. That's the ethic of the incompetent.
Speaker
[music]
No per-word timings found.