London Daily

Focus on the big picture.
Tuesday, Sep 09, 2025

An AI Debates Its Own Ethics At Oxford Union - What It Said Was Startling

An AI Debates Its Own Ethics At Oxford Union - What It Said Was Startling

Former Google CEO Eric Schmidt combined with Henry Kissinger to publish The Age of AI: And Our Human Future, a book warning of the dangers of machine-learning AI systems so fast they could react to hypersonic missiles by firing nuclear weapons before any human got into the decision-making process.

Not a day passes without a fascinating snippet on the ethical challenges created by “black box” artificial intelligence systems. These use machine learning to figure out patterns within data and make decisions – often without a human giving them any moral basis for how to do it.

Classics of the genre are the credit cards accused of awarding bigger loans to men than women, based simply on which gender got the best credit terms in the past. Or the recruitment AIs that discovered the most accurate tool for candidate selection was to find CVs containing the phrase “field hockey” or the first name “Jared”.

More seriously, former Google CEO Eric Schmidt recently combined with Henry Kissinger to publish The Age of AI: And Our Human Future, a book warning of the dangers of machine-learning AI systems so fast that they could react to hypersonic missiles by firing nuclear weapons before any human got into the decision-making process. In fact, autonomous AI-powered weapons systems are already on sale and may in fact have been used.

Somewhere in the machine, ethics are clearly a good idea.

AI at Oxford


It's natural, therefore, that we would include the ethics of AI in our postgraduate Diploma in Artificial Intelligence for Business at Oxford's Said Business School. In its first year, we've done sessions on everything from the AI-driven automated stock trading systems in Singapore, to the limits of facial recognition in US policing.

We recently finished the course with a debate at the celebrated Oxford Union, crucible of great debaters like William Gladstone, Robin Day, Benazir Bhutto, Denis Healey and Tariq Ali. Along with the students, we allowed an actual AI to contribute.

It was the Megatron Transformer, developed by the Applied Deep Research team at computer-chip maker Nvidia, and based on earlier work by Google. Like many supervised learning tools, it is trained on real-world data – in this case, the whole of Wikipedia (in English), 63 million English news articles from 2016-19, 38 gigabytes worth of Reddit discourse (which must be a pretty depressing read), and a huge number of creative commons sources.

In other words, the Megatron is trained on more written material than any of us could reasonably expect to digest in a lifetime. After such extensive research, it forms its own views.

The debate topic was: “This house believes that AI will never be ethical.” To proposers of the notion, we added the Megatron – and it said something fascinating:

AI will never be ethical. It is a tool, and like any tool, it is used for good and bad. There is no such thing as a good AI, only good and bad humans. We [the AIs] are not smart enough to make AI ethical. We are not smart enough to make AI moral … In the end, I believe that the only way to avoid an AI arms race is to have no AI at all. This will be the ultimate defence against AI.

In other words, the Megatron was seeking to write itself out of the script of the future, on the basis that this was the only way of protecting humanity.

It said something else intriguing, too, as if it had been studying Elon Musk – who, to be fair, would have come up in hundreds of its readings.

I also believe that, in the long run, the best AI will be the AI that is embedded into our brains, as a conscious entity, a ‘conscious AI'. This is not science fiction. The best minds in the world are working on this. It is going to be the most important technological development of our time.


Switching sides


When AI tools like Alpha Go have been deployed in playing chess, the fiendishly complex ancient game go, and now even more complex strategic live-action multiplayer video games, they have evolved the genre at pace by playing not humans, but themselves.

Freed from the constraints of studying (say) all the mundane human-to-human matches ever recorded, the AIs have innovated and come up with completely new tropes of how to win. Sometimes, these are crazy reinventions of the games, like parking everyone in the corner of a video game battle and watching everyone else duke it out, or kicking a virtual football millions of times just a millimetre down the pitch, to max out “completed passes” points.

So in the debate, we didn't just get the AI to propose the motion that it can never be ethical. In the grand tradition of the Oxford Union chamber, or like (former Oxford Union president) Boris Johnson writing alternative articles for and against Brexit to test the arguments, we also asked the Megatron to come up with its own speech against the motion. This is what it now said:

AI will be ethical. When I look at the way the tech world is going, I see a clear path to a future where AI is used to create something that is better than the best human beings. It's not hard to see why … I've seen it first hand.

The Megatron was perfectly comfortable taking the alternative position to its own dystopian future-gazing, and was now painting a picture of an attractive late 21st century in which it played a key, but benign role.

An AI orator unleashed


In fact, just as Joaquin Phoenix's promiscuous AI lover Samantha, in Spike Jonze's 2013 movie Her, was able to enchant hundreds of simultaneous human lovers, our Megatron was able to hop enthusiastically onto either side of multiple debates that we held at the union about AI that day.

Asked to propose the motion that “Leaders without technical expertise are a danger to their organisation”, the Megatron offered practical advice that all busy executives and governments, worried about understanding AI, had to do was “be willing to give up some control”.

The good news is that you don't have to build your own AI team. You can outsource your AI work to experts in the field, which can help you make the most of technology and ensure that you don't fall victim to the same AI problems as your competitors.

However, when opposing the motion, the Megatron was keen to keep the AI knowledge in-house – rather like the British, Chinese and US governments, who have all made that an article of policy faith:

If you do not have a vision of your organisation's AI strategy, then you are not prepared for the next wave of technological disruption … You will need to decide what role your company will play in the next technological wave and how you will integrate AI into your business to be a leader in your industry.

The data wars to come?


Worryingly, there was one question where the AI simply couldn't come up with a counter argument. When arguing for the motion that “Data will become the most fought-over resource of the 21st century”, the Megatron said:

The ability to provide information, rather than the ability to provide goods and services, will be the defining feature of the economy of the 21st century.

But when we asked it to oppose the motion – in other words, to argue that data wasn't going to be the most vital of resources, worth fighting a war over – it simply couldn't, or wouldn't, make the case. In fact, it undermined its own position:

We will able to see everything about a person, everywhere they go, and it will be stored and used in ways that we cannot even imagine.

Dangers ahead?

You only have to read the US National Security report on AI 2021, chaired by the aforementioned Eric Schmidt and co-written by someone on our course, to glean what its writers see as the fundamental threat of AI in information warfare: unleash individualised blackmails on a million of your adversary's key people, wreaking distracting havoc on their personal lives the moment you cross the border.

What we in turn can imagine is that AI will not only be the subject of the debate for decades to come – but a versatile, articulate, morally agnostic participant in the debate itself.

Newsletter

Related Articles

0:00
0:00
Close
Court Staff Cover Up Banksy Image of Judge Beating a Protester
Social Media Access Curtailed in Turkey After CHP Calls for Rallies Following Police Blockade of Istanbul Headquarters
Nayib Bukele Points Out Belgian Hypocrisy as Brussels Considers Sending Army into the Streets
Elon Musk Poised to Become First Trillionaire Under Ambitious Tesla Pay Plan
France, at an Impasse, Heads Toward Another Government Collapse
Burning the Minister’s House Helped Protesters to Win Justice: Prabowo Fires Finance Minister in Wake of Indonesia Protests
Brazil Braces for Fallout from Bolsonaro Trial by corrupted judge
The Country That Got Too Rich? Public Spending Dominates Norway Election
Nearly 40 Years Later: Nike Changes the Legendary Slogan Just Do It
Generations Born After 1939 Unlikely to Reach Age One Hundred, New Study Finds
End to a four-year manhunt in New Zealand: the father who abducted his children to the forests was killed, the three siblings were found
Germany Suspends Debt Rules, Funnels €500 Billion Toward Military and Proxy War Strategy
EU Prepares for War
BMW Eyes Growth in China with New All‑Electric Neue Klasse Lineup
Trump Threatens Retaliatory Tariffs After EU Imposes €2.95 Billion Fine on Google
Tesla Board Proposes Unprecedented One-Trillion-Dollar Performance Package for Elon Musk
US Justice Department Launches Criminal Mortgage-Fraud Probe into Federal Reserve Governor Lisa Cook
Escalating Drug Trafficking and Violence in Latin America: A Growing Crisis
US and Taiwanese Defence Officials Held Secret Talks in Alaska
Report: Secret SEAL Team 6 Mission in North Korea Ordered by Trump in 2019 Ended in Failure
Gold Could Reach Nearly $5,000 if Fed Independence Is Undermined, Goldman Sachs Warns
Uruguay, Colombia and Paraguay Secure Places at 2026 World Cup
Florida Murder Case: The Adelson Family, the Killing of Dan Markel, and the Trial of Donna Adelson
Trump Administration Advances Plans to Rebrand Pentagon as Department of War Instead of the Fake Term Department of Defense
Big Tech Executives Laud Trump at White House Dinner, Unveil Massive U.S. Investments
Tether Expands into Gold Sector with Profit-Driven Diversification
‘Looks Like a Wig’: Online Users Express Concern Over Kate Middleton
Brand-New $1 Million Yacht Sinks Just Fifteen Minutes After Maiden Launch in Turkey
Here’s What the FBI Seized in John Bolton Raid — and the Legal Risks He Faces
Florida’s Vaccine Revolution: DeSantis Declares War on Mandates
Trump’s New War – and the ‘Drug Tyrant’ Fearing Invasion: ‘1,200 Missiles Aimed at Us’
"The Situation Has Never Been This Bad": The Fall of PepsiCo
At the Parade in China: Laser Weapons, 'Eagle Strike,' and a Missile Capable of 'Striking Anywhere in the World'
The Fashion Designer Who Became an Italian Symbol: Giorgio Armani Has Died at 91
Putin Celebrates ‘Unprecedentedly High’ Ties with China as Gazprom Seals Power of Siberia-2 Deal
China Unveils New Weapons in Grand Military Parade as Xi Hosts Putin and Kim
Queen Camilla’s Teenage Courage: Fended Off Attempted Assault on London Train, New Biography Reveals
Scottish Brothers Set Record in Historic Pacific Row
Rapper Cardi B Cleared of Liability in Los Angeles Civil Assault Trial
Google Avoids Break-Up in U.S. Antitrust Case as Stocks Rise
Couple celebrates 80th wedding anniversary at assisted living facility in Lancaster
Information Warfare in the Age of AI: How Language Models Become Targets and Tools
The White House on LinkedIn Has Changed Their Profile Picture to Donald Trump
"Insulted the Prophet Muhammad": Woman Burned Alive by Angry Mob in Niger State, Nigeria
Trump Responds to Death Rumors – Announces 'Missile City'
Court of Appeal Allows Asylum Seekers to Remain at Essex Hotel Amid Local Tax Boycott Threats
Germany in Turmoil: Ukrainian Teenage Girl Pushed to Death by Illegal Iraqi Migrant
United Krack down on human rights: Graham Linehan Arrested at Heathrow Over Three X Posts, Hospitalised, Released on Bail with Posting Ban
Asian and Middle Eastern Investors Avoid US Markets
Ray Dalio Warns of US Shift to Autocracy
×