London Daily

Focus on the big picture.
Wednesday, Oct 04, 2023

Stop the killer robots! Musk-backed lobbyists fight to save Europe from bad AI

Stop the killer robots! Musk-backed lobbyists fight to save Europe from bad AI

The Future of Life Institute is warning AI could kill us all, but its ideology is freaking some folks out. A lobby group backed by Elon Musk and associated with a controversial ideology popular among tech billionaires is fighting to prevent killer robots from terminating humanity, and it's taken hold of Europe's Artificial Intelligence Act to do so.

The Future of Life Institute (FLI) has over the past year made itself a force of influence on some of the AI Act's most contentious elements. Despite the group’s links to Silicon Valley, Big Tech giants like Google and Microsoft have found themselves on the losing side of FLI's arguments.

In the EU bubble, the arrival of a group whose actions are colored by fear of AI-triggered catastrophe rather than run-of-the-mill consumer protection concerns was received like a spaceship alighting in the Schuman roundabout. Some worry that the institute embodies a techbro-ish anxiety about low-probability threats that could divert attention from more immediate problems. But most agree that during its time in Brussels, the FLI has been effective. 

“They’re rather pragmatic and they have legal and technical expertise,” said Kai Zenner, a digital policy adviser to center-right MEP Axel Voss, who works on the AI Act. “They’re sometimes a bit too worried about technology, but they raise a lot of good points.” 

Launched in 2014 by MIT academic Max Tegmark and backed by tech grandees including Musk, Skype's Jaan Tallinn, and crypto wunderkind Vitalik Buterin, FLI is a nonprofit devoted to grappling with “existential risks” — events able to wipe out or doom humankind. It counts other hot shots like actors Morgan Freeman and Alan Alda and renowned scientists Martin (Lord) Rees and Nick Bostrom among its external advisers.

Chief among those menaces — and FLI’s priorities — is artificial intelligence running amok.

“We've seen plane crashes because an autopilot couldn't be overruled. We've seen a storming of the U.S. Capitol because an algorithm was trained to maximize engagement. These are AI safety failures today — as these systems become more powerful, harms might become worse,” Mark Brakel, FLI director of European policy, said in an interview.

But the lobby group faces two PR problems. First, Musk, its most famous backer, is at the center of a storm since he started mass firings at Twitter as its new owner, catching the eye of regulators, too. Musk's controversies could cause lawmakers to get skittish about talking to FLI. Second, the group's connections to a set of beliefs known as effective altruism are raising eyebrows: The ideology faces a reckoning and is most recently being blamed as a driving force behind the scandal around cryptocurrency exchange FTX, which has unleashed financial carnage. 


How FLI pierced the bubble


The arrival of a lobby group fighting off extinction, misaligned artificial intelligence and killer robots was bound to be refreshing to otherwise snoozy Brussels policymaking.

FLI's Brussels office opened in mid-2021, as discussions about the European Commission’s AI Act proposal were kicking off.

“We would prefer AI to be developed in Europe, where there will be regulations in place," Brakel said. “The hope is that people take inspiration from the EU.”

A former diplomat, the Dutch-born Brakel joined the institute in May 2021. He chose to work in AI policy as a field that was both impactful and underserved. Policy researcher Risto Uuk joined him two months later. A skilled digital operator — he publishes his analyses and newsletter from the domain artificialintelligenceact.eu — Uuk had previously done AI research for the Commission and the World Economic Forum. He joined FLI out of philosophical affinity: like Tegmark, Uuk subscribes to the tenets of effective altruism, a value system prescribing the use of hard evidence to decide how to benefit the largest number of people.

Since starting in Brussels, the institute’s three-person team (with help from Tegmark and others, including law firm Dentons) has deftly spearheaded lobbying efforts on little-known AI issues.

Exhibit A: general-purpose AI — software like speech-recognition or image-generating tools used in a vast array of contexts and sometimes affected by biases and dangerous inaccuracies (for instance, in medical settings). General-purpose AI was not mentioned in the Commission’s proposal, but wended its way into the EU Council’s final text and is guaranteed to feature in Parliament’s position.

“We came out and said, ‘There's this new class of AI — general-purpose AI systems — and the AI Act doesn't consider them whatsoever. You should worry about this,'" Brakel said. “This was not on anyone's radar. Now it is.”

The group is also playing on European fears of technological domination by the U.S. and China. “General-purpose AI systems are built mainly in the U.S. and China, and that could harm innovation in Europe, if you don't ensure they abide by some requirements,” Brakel said, adding this argument resonated with center-right lawmakers with whom he recently met. 

Another of FLI’s hobbyhorses is outlawing AI able to manipulate people’s behavior. The original proposal bans manipulative AI, but that is limited to “subliminal” techniques — which Brakel thinks would create loopholes. 

But the AI Act's co-rapporteur, Romanian Renew lawmaker Dragoș Tudorache, is now pushing to make the ban more comprehensive. “If that amendment goes through, we would be a lot happier than we are with the current text,” Brakel said. 


So smart it made crypto crash


While the group's input on key provisions in the AI bill was welcomed, many in Brussels' establishment look askance at its worldview.

Tegmark and other FLI backers adhere to what's referred to as effective altruism (or EA). A strand of utilitarianism codified by philosopher William MacAskill — whose work Musk called “a close match for my philosophy” — EA dictates that one should better the lives of as many people as possible, using a rationalist fact-based approach. At a basic level, that means donating big chunks of one’s income to competent charities. A more radical, long-termist strand of effective altruism demands that one strive to minimize risks able to kill off a lot of people — and especially future people, who will greatly outnumber existing ones. That means that preventing the potential rise of an AI whose values clash with humankind’s well-being should be at the top of one’s list of concerns.  

A critical take on FLI is that it is furthering this interpretation of the so-called effective altruism agenda, one supposedly uninterested in the world's current ills — such as racism, sexism and hunger — and focused on sci-fi threats to yet-to-be-born folks. Timnit Gebru, an AI researcher whose acrimonious exit from Google made headlines in 2020, has lambasted FLI on Twitter, voicing “huge concerns” about it.  

"They are backed by billionaires including Elon Musk — that already should make people suspicious," Gebru said in an interview. "The entire field around AI safety is made up of so many 'institutes' and companies billionaires pump money into. But their concept of AI safety has nothing to do with current harms towards marginalized groups — they want to reorient the entire conversation into preventing this AI apocalypse."

Effective altruism’s reputation has taken a hit in recent weeks after the fall of FTX, a bankrupt exchange that lost at least $1 billion in customers' cryptocurrency assets. Its disgraced CEO Sam Bankman-Fried used to be one of EA’s darlings, talking in interviews about his plan to make bazillions and give them to charity. As FTX crumbled, commentators argued that Effective Altruism ideology led Bankman-Fried to cut corners and rationalize his recklessness. 

Both MacAskill and FLI donor Buterin defended EA on Twitter, saying that Bankman-Fried’s actions contrasted with the philosophy’s tenets. “Automatically downgrading every single thing SBF believed in is an error,” wrote Buterin, who invented the Ethereum blockchain, and bankrolls FLI’s scholarship for AI existential risk research.

Brakel said that the FLI and EA were two distinct things, and FLI's advocacy was focused on present problems, from biased software to autonomous weapons, e.g. at the United Nations level. “Do we spend a lot of time thinking about what the world would look like in 400 years? No,” he said. (Neither Brakel nor the FLI’s EU representative, Claudia Prettner, call themselves effective altruists.)


Californian ideology


Another critique of FLI's efforts to stave off evil AI argues that they obscure a techno-utopian drive to develop benevolent human-level AI. At a 2017 conference, FLI advisers — including Musk, Tegmark and Skype's Tallinn — debated the likelihood and the desirability of smarter-than-human AI. Most panelists deemed “superintelligence” bound to happen; half of them deemed it desirable. The conference’s output was a series of (fairly moderate) guidelines on developing beneficial AI, which Brakel cited as one of FLI’s foundational documents.

That techno-optimism led Emile P. Torres, a Ph.D. candidate in philosophy who used to collaborate with FLI, to ultimately turn against the organization. “None of them seem to consider that maybe we should explore some kind of moratorium,” Torres said. Raising such points with an FLI staffer, Torres said, led to a sort of excommunication. (Torres’s articles have been taken down from FLI’s website.) 

Within Brussels, the worry is that going ahead, FLI might change course from its current down-to-earth incarnation and steer the AI debate toward far-flung scenarios. “When discussing AI at the EU level, we wanted to draw a clear distinction between boring and concrete AI systems and sci-fi questions,” said Daniel Leufer, a lobbyist with digital rights NGO Access Now. “When earlier EU discussions on AI regulation happened, there were no organizations in Brussels placing focus on topics like superintelligence — it’s good that the debate didn’t go in that direction.”

Those who regard the FLI as the spawn of Californian futurism point to its board and its wallet. Besides Musk, Tallinn and Tegmark, donors and advisers include researchers from Google and OpenAI, Meta co-founder Dustin Moskovitz’s Open Philanthropy, the Berkeley Existential Risk Initiative (which in turn has received funding from FTX) and actor Morgan Freeman. 

In 2020 most of FLI’s global funding ($276,000 out of $482,479) came from the Silicon Valley Community Foundation, a charity favored by tech bigwigs like Mark Zuckerberg; 2021 accounts haven't been released yet. 

Brakel denied that the FLI is cozy with Silicon Valley, saying that the organization's work on general-purpose AI made life harder for tech companies. Brakel said he had never spoken to Musk. Tegmark, meanwhile, is in regular touch with the members of the scientific advisory board, which includes Musk. 

In Brakel’s opinion, what the FLI is doing is akin to early-day climate activism. “We currently see the warmest October ever. We worry about it today, but we also worry about the impact in 80 years’ time,” he said last month. “[There] are AI safety failures today — and as these systems become more powerful, the harms might become worse.”

Newsletter

Related Articles

London Daily
Close
0:00
0:00
Paper straws found to contain long-lasting and potentially toxic chemicals - study
You Are So Beautiful
FTX's Bankman-Fried headed for jail after judge revokes bail
Postmodern Jukebox European Tour Version
Blackrock gets half a trillion dollar deal to rebuild Ukraine
An old French tune (by Georges Brassens) Pomplamoose ft. John Schroeder
Steve Jobs' Son Launches Venture Capital Firm With $200 Million For Cancer Treatments
Sattahip Motor Show 20
Greek PM offers tourists affected by wildfires a free stay in Rhodes next year.
SONATE AU CLAIR DE LUNE - Moonlight sonata
Google reshuffles Assistant unit, lays off some staffers, to 'supercharge' products with A.I.
A kiss to build a dream on
End of Viagra? FDA approved a gel against erectile dysfunction
Wonderful Tonight - Eric Clapton (Boyce Avenue acoustic cover)
UK sanctions Russians judges over dual British national Kara-Murza's trial
Mean Blues
US restricts visa-free travel for Hungarian passport holders because of security concerns
La Chansonnette
America's First New Nuclear Reactor in Nearly Seven Years Begins Operations
Pattaya Addicts
Southeast Asia moves closer to economic unity with new regional payments system
Franz Liszt - Liebestraum - Love Dream
Political leader from South Africa, Julius Malema, led violent racist chants at a massive rally on Saturday
Dream a little dream of me
Today Hunter Biden’s best friend and business associate, Devon Archer, testified that Joe Biden met in Georgetown with Russian Moscow Mayor's Wife Yelena Baturina who later paid Hunter Biden $3.5 million in so called “consulting fees”
Unchained Melody sung like you've NEVER heard!
How “peacekeepers” at the UN spend our American tax dollars.
Dave Brubeck - Take Five
'I am not your servant': IndiGo crew member, passenger get into row over airline meal
Édith Piaf - Non, Je Ne Regrette Rien (Sofie)
Singapore Carries Out First Execution of a Woman in Two Decades Amid Capital Punishment Debate
Rondo Alla Turca
Spanish Citizenship Granted to Iranian chess player who removed hijab
Kiss of fire
US Senate Republican Mitch McConnell freezes up, leaves press conference
Tom Jones - I´ll Never Fall In Love Again 1967, 1989, 2001
Speaker McCarthy says the United States House of Representatives is getting ready to impeach Joe Biden.
Israel Cachao López - Guajira Clásica
San Francisco car crash
Edward Maya - Stereo Love (feat. Vika Jigulina) (Extended Mix)
This camera man is a genius
Strauss - Radetzky March - Karajan
3D ad in front of Burj Khalifa
La vie en rose
Next level gaming
The Temptations - My Girl (Smokey Robinson Tribute) 2006 Kennedy Cent
BMW driver…
Orlando Cachaito Lopez Redencion
Google testing journalism AI. We are doing it already 2 years, and without Google biased propoganda and manipulated censorship
Edith Piaf - NON, JE NE REGRETTE RIEN
Unlike illegal imigrants coming by boats - US Citizens Will Need Visa To Travel To Europe in 2024
RADETZKY MARCH-2008-Wien, New Year Concert
Musk announces Twitter name and logo change to X.com
Only you (And you alone)
The future of sport
Strangers In The Night
New York City Agrees to Compensate Demonstrators Subjected to Excessive Force and Unlawful Arrests Amidst Widespread Protests
Charles Aznavour - La Boheme
Paul Simon: "I can't perform anymore due to hearing loss"
Summer time
The politician and the journalist lost control and started fighting on live broadcast.
Sting and Stevie Wonder - Fragile (from Sting's 60th birthday concert)
The future of sports
Aux Champs Elysees
Unveiling the Black Hole: The Mysterious Fate of EU's Aid to Ukraine
Stand By Me - Ben E. King (Boyce Avenue acoustic cover)
Farewell to a Music Titan: Tony Bennett, Renowned Jazz and Pop Vocalist, Passes Away at 96
La Mer (Beyond the Sea) – Avalon Jazz Band
Alarming Behavior Among Florida's Sharks Raises Concerns Over Possible Cocaine Exposure
She
Transgender Exclusion in Miss Italy Stirs Controversy Amidst Changing Global Beauty Pageant Landscape
Nathalie Song by Enzo Petrachi Stjepan Hauser Cello
Joe Biden admitted, in his own words, that he delivered what he promised in exchange for the $10 million bribe he received from the Ukraine Oil Company.
Shape of My Heart - Sting (Boyce Avenue acoustic cover)
Swedish Embassy in Baghdad Engulfed in Flames Amidst a Firestorm of Protests
Radiohead - Creep
TikTok Takes On Spotify And Apple, Launches Own Music Service
Quizás,Quizás,Quizás - Andrea Bocelli - Jennifer Lopez
Global Trend: Using Anti-Fake News Laws as Censorship Tools - A Deep Dive into Tunisia's Scenario
Perhaps, Perhaps, Perhaps - Multi-Couples
Arresting Putin During South African Visit Would Equate to War Declaration, Asserts President Ramaphosa
Pentatonix Havana
House of Commons rejects nine significant amendments from the Unelected, Privilaged House of Lord - Overturn Crucial Migration Bill Amendments in a Bid to Curb Unauthorized Maritime Immigration
Paula Cole - Autumn Leaves
Hacktivist Collective Anonymous Launches 'Project Disclosure' to Unearth Information on UFOs and ETIs
Oscar Benton Bensonhurst Blues
Typo sends millions of US military emails to Russian ally Mali
OH NANANA vs ABUSADAMENTE
Muslim Tycoon Asif Aziz Receives Approval for the Transformation of the iconic London Trocadero Landmark into Mosque
Nina Simone - ”I Put A Spell On You”. Vezi aici cum cântă Jeremy Ragsd
Server Arrested For Theft After Refusing To Pay A Table's $100 Restaurant Bill When They Dined & Dashed
NIGHTWISH - The Phantom Of The Opera
The Changing Face of Europe: How Mass Migration is Reshaping the Political Landscape
Motorshow 2016 Tanjay Negros Oriental
China Urges EU to Clarify Strategic Partnership Amid Trade Tensions
Monica Bellucci - Ti Amo
Europe is boiling: Extreme Weather Conditions Prevail Across the Continent
Michael Jackson - Billie Jean Milena The Voice France 2018
Israeli Prime Minister Netanyahu Hospitalized Due to Dehydration Amidst Summer Heatwave
Michael Buble (Help Me Make It Through The Night) feat Loren Allred
Memories Canon In D - Maroon 5 (Boyce Avenue piano acoustic cover)
Matteo Simoni - Marina
Maroon 5 - One More Night
Maroon 5 - Memories
Mark Knopfler - Brothers In Arms (Berlin 2007 Live)
Mark Knopfler & Emmylou Harris - Romeo And Juliet (Real Live Roadrunni
Marina, Marina - The LUCKY DUCKIES intimist live concert at Guimarães
Major Lazer & DJ Snake – Lean On Mauranne The Voice France 2016
Love Theme from Romeo and Juliet - Joslin - Henri Mancini, Nino Rota
LoLa & Hauser - Love Story
Linkin Park Jay-Z - Numb Encore (Live 8 2005)
Hallelujah Mennel Ibtissem, The Voice France Leonard Cohen
Leonard Cohen - Dance Me to the End of Love
Leonard Cohen & Natasha Rostova - Dance me to the end of love
La casa de papel - Bella Ciao
La Camisa Negra
L'italiano (Toto Cutugno) - The Gypsy Queens
Juanes - La Camisa Negra
Jonathan and Charlotte - Britain's Got Talent 2012 Live Semi Final - U
John Powell - Assassin's Tango
Joe Cocker - You Can Leave Your Hat On (LIVE in Dortmund)
Joe Cocker - Unchain My Heart 2002 Live
Joe Cocker - A Whiter Shade Of Pale
Jay Z & Alicia Keys - Empire State of Mind LIVE
Jason Mraz - Im Yours (live)
Jarrod Radnich - Bohemian Rhapsody - Virtuosic Piano Solo
James Blunt - You're Beautiful
James Blunt - You're Beautiful & Bonfire Heart (Live at The Nobel Peac)
If You Go Away - Helen Merrill & Stan Getz (Tribute to Virna Lisi)
I'LL BE MISSING YOU
I Say a Little Prayer
Hotel California ( Eagles ) 1994 Live
Historia de un amor - Luz Casal. Vezi interpretarea Biancăi Sumanariu
Here Comes The Sun - The Beatles (Boyce Avenue acoustic cover) on Spot
Heart - Stairway to Heaven Led Zeppelin - Kennedy Center Honors
HAVANA by Camila Cabello Zumba Pre Cooldown TML Crew Kramer Pastra
HAUSER and Señorita - I Will Always Love You
HAUSER - Waka Waka
HAUSER - Sway
HAUSER - Lambada
HAUSER - Historia de un Amor
HAUSER - Despacito
Great Pretender
Georgia May Foote & Giovanni Pernice Samba to 'Volare' - Strictly Come
Gary Moore - Still Got The Blues
GIPSY KINGS VOLARE Penelope Cruz
Fugees - Killing Me Softly With His Song
French Latino - Historia de un Amor
For A Few Dollars More The Danish National Symphony Orchestra (Live)
Flashdance • What a Feeling • Irene Cara
Filip Rudan - “Someone You Loved” Audicija 4 The Voice Hrvatska Sez
Eric Clapton - Wonderful Tonight
Enya - Only Time
Enrique Iglesias - Bailando (English Version) ft. Sean Paul
Enrique Iglesias - Bailamos
Elena Yerevan Historia de un amor
Ed Sheeran - Shape of You (Official Music Video)
Ed Sheeran - Perfect Symphony [with Andrea Bocelli]
Ed Sheeran - Perfect (Official Music Video)
Easy On Me - Adele (Boyce Avenue 90’s style piano acoustic cover) on S
ERA - Ameno
ELENA YEREVAN- Cancion Del Mariachi-IN STUDIO-2017 DPR
Dust In The Wind - Kansas (Boyce Avenue acoustic cover)
Don't Let Me Be Misunderstood
Despacito x Shape Of You - Pentatonix
Deep Purple - Child In Time - Live (1970)
David Foster When A Man Loves A WomanIt's A Mans World (SealMichael Bo
Dance me to the end of Love ( Pi-Air Design )
Coolio - Gangsta's Paradise (feat. L.V.) [Official Music Video]
Conquest Of Paradise (Vangelis), played on Böhm Emporio organ
Cielito Lindo
Chico & The Gypsies - Bamboleo
Canción Del Mariachi - Antonio Banderas, Los Lobos • Desperado
Camila Cabello - Havana (Audio) ft. Young Thug
Camila Cabello - Havana ( cover by J.Fla )
California Dreamin' - The Mamas & The Papas José Feliciano (Boyce Ave
Buster Benton - Money Is The Name of The Game
Hallelujah Pentatonix
Bobby McFerrin - Don't Worry Be Happy (Official Music Video)
Bob Dylan - Knockin' On Heaven's Door Emilia The Voice Kids France
Besame Mucho - Cesaria Evora
Ben E. King - Stand by Me Sax Cover Alexandra Ilieva Thomann
Bella Ciao
Bella Ciao - INSTRUMENTAL
Beautiful in White x Canon in D (Piano Cover by Riyandi Kusuma)
Bad Romance - Vintage 1920's Gatsby Style Lady Gaga Cover ft. Ariana Savalas & Sarah Reich(1)
BELLA CIAO 2020 - KARAOKE ITALIANO
BAMBOLEO - Gipsy Kings • Antonio Banderas, Katya Virshilas
BAILANDO (original)
Awesome Ukrainian yodeler - SOFIA SHKIDCHENKO (with English subtitles)
Avicii - The Nights
Atom - The Great Gig in the Sky
Aretha Franklin - (You Make Me Feel Like) A Natural Woman (Official Ly
Antonio Banderas - Cancion del Mariachi (Desperado)
André Rieu - Zorba's Dance (Sirtaki)
André Rieu - Can't Help Falling In Love
André Rieu & Mirusia - Ave Maria
Andrew Reyes Elton John - Don't Let The Sun Go Down The Voice 2020 (
Andreas Kümmert Whiter Shade Of Pale The Voice of Germany 2013 Showd
And I Love You So
All About That Bass - Postmodern Jukebox European Tour Version
Alan Walker - Faded (Piano Cover)
Ain't No Sunshine -- Bill Withers (cover by Canen 12 y.o.)
African music
Adriana Vidović - “Creep” Audicija 4 The Voice Hrvatska Sezona 3
Adriana Vidović - “Believer” Nokaut 3 The Voice Hrvatska Sezona 3
A Fistful of Dollars - The Danish National Symphony Orchestra and Tuva
4 Beautiful Soundtracks Relaxing Piano [10min]
2CELLOS - Whole Lotta Love vs. Beethoven 5th Symphony [OFFICIAL VIDEO]
2CELLOS - Smooth Criminal (Live at Suntory Hall, Tokyo)
2CELLOS - Smells Like Teen Spirit [Live at Sydney Opera House]
2CELLOS - Despacito [OFFICIAL VIDEO]
13 Year Old Girl Playing Il Silenzio (The Silence) - André Rieu
094.All About That Bass
00 - SADNESS PART 1
(Ghost) Riders In the Sky (American Outlaws Live at Nassau Coliseum, 1
(Everything I Do) I Do It For You - Bryan Adams (Boyce Avenue ft. Conn
What a wonderful world
Moon river
×