London Daily

Focus on the big picture.

Why your voice assistant might be sexist

Why your voice assistant might be sexist

From reinforcing entrenched gender roles to potentially even fuelling misogyny, choosing the right voice for a particular task can be a minefield.

James Bond flings open the door of his new BMW – which comes with hidden machine guns as standard – and immediately a feminine computerised voice announces, "Welcome! Please fasten seatbelt and obey all instructions for a safe trip."

Bond’s MI6 colleague and master of gadgets, Q, pipes up to explain: "Thought you’d pay more attention to a female voice." But, predictably, Bond later ignores repeated commands to wear his seatbelt and, using his mobile phone as a remote control, he subsequently drives the car off the top of a multi-storey car park in the 1997 blockbuster Tomorrow Never Dies.

Q's market research was wrong – and so was BMW’s. The firm famously recalled a feminine-voiced GPS system from its cars when German drivers complained that they didn't want to take instructions "from a woman".

But why won’t German men, British secret agents, or anyone else often follow directions delivered in feminine tones? Today, navigation systems with feminine voices are actually quite common. But multiple studies suggest that digital voices continue to reinforce deeply problematic gender stereotypes. The smart speaker with a feminine voice that politely does your bidding versus the masculine-sounding recorded message that takes charge and orders you to stay clear of a reversing truck.

Gender bias is rife in artificial intelligence (AI) systems, according to a widely discussed 2019 report from Unesco. The report’s title, "I'd blush if I could," refers to the response that Apple’s voice assistant Siri used to give when people remarked to it, "Hey Siri, you're a b****."
While some

improvements have been made to AI voice systems since then, many argue there is still a way to go. So how did gender bias get so deeply embedded in these systems in the first place – and how do we go about getting rid of it?

The history of digital voices, and how we have used and abused them, doesn’t make for easy reading. Take the computer systems in aircraft that talk to pilots and provide information or warnings. One such system, which used voice recordings made by the singer and actor Joan Elms, was dubbed "Sexy Sally". A more recent system, originally featuring the voice of actor Kim Crow, was informally named "B******* Betty". And in the UK, the term "Nagging Nora " is sometimes used.

Similarly, staff on the London Underground are also reported to refer to an automated announcement system as "Sonya" because it "gets onya nerves".

One day AI voice assistants might be genderless or gender-ambiguous


A masculine equivalent of aircraft voice systems is called "Barking Bob" by some pilots – though, noticeably, that phrase doesn't connote the same gender-based prejudice as the other epithets.

It's not just whether or not people have accepted feminine voices in certain roles, it's also how developers have designed synthetic voices in the past to perform those roles that’s an issue, says Verena Rieser at Heriot-Watt University. Voice assistants have sometimes been incapable of recognising and challenging inappropriate behaviour.

"These systems are gendered and anthropomorphised," she explains. “There is basically a reinforcement cycle here."

The default voice of assistants such as Siri or Alexa was always feminine in the past, though in recent years Apple and Amazon have made other options available. Despite this, you might find feminine synthesised voices to be more common than masculine ones. But why? It's partly down to the fact that companies spent decades acquiring many more recordings of women’s voices than of men's. This mass of data has influenced subsequent technologies, including AI.

Instead of promoting gender equality, voice assistants have often done quite the opposite


Women have operated telephone exchanges and loaned their voices to lots of pre-digital message systems, meaning that a feminine voice is what many have come to expect from helpful, compliant technologies.

Research indicates that this fits with our misogynistic expectations of what tasks are "suitable" for women versus men. And yet other work suggests that there is actually little or no practical reason to prioritise feminine voices over masculine ones for certain applications – the two are more or less equally intelligible and both are capable of delivering information effectively.

Despite that, instead of promoting gender equality, voice assistants have often done quite the opposite. Journalist Leah Fessler tested virtual voice assistants’ responses to sexual harassment back in 2017 and found multiple issues. When told “You're hot", Amazon’s Alexa replied obsequiously, "That's nice of you to say". To the remark, "You're a slut", Microsoft’s Cortana delivered a web search result with an article entitled: "30 signs you're a slut".

In 2020, researchers from the Brookings Institution re-tested these interactions and found that they had improved somewhat. The voice assistants were more likely to push back against abuse than before, if not always very clearly.

Many of the disembodied voices that people hear in public places, such as on the London Underground, are female


Big tech companies have also diversified the voices that users can select for their virtual assistants. There are more masculine options than before and Apple, for example, no longer pre-selects a feminine voice as the default for Siri.

But researchers who study gender argue that simply offering masculine voices as an alternative, and tweaking assistants' responses to inappropriate language, still leaves us far from resolving the wider problem. A lack of diversity and sophistication remains in these disembodied voices, they say. Not least because of the identities that are often left out by virtual assistant systems. Some people identify as non-binary or gender fluid and it is increasingly accepted that gender identities are the sum of many factors, including social and cultural influences.

Can a digital voice capture this? The answer is "maybe", partly because it’s difficult to synthesise an adult human voice that sounds anything other than either masculine or feminine. Plus, although we tend to think of masculine voices as deeper than feminine voices, this is not always true, says Selina Sutton at Northumbria University.

Just because a digital voice's gender isn't obvious doesn’t mean it can’t also be sexist


"There's this middle range of pitches, fundamental frequencies, that’s the same for men and women," she explains.

Various projects have attempted to synthesise "gender-neutral" voices with varying success. Consulting firm Accenture produced an experimental gender-neutral voice, though it may simply sound masculine or feminine depending on how the listener perceives it.

In 2019, a team of designers and researchers came up with a project called Q (no connection to James Bond), which was billed as a "genderless voice". Co-creator Ryan Sherman, who now works for design lab Space10, says he was inspired to develop Q after noticing the subservient feminine voices that often characterised virtual assistants – even when they were faced with aggression from human users.

"It's usually in a way that’s submissive and reinforcing this idea that women are available to help at the touch of a button," he says.

James Bond didn't listen to his car's digital voice assistant's instruction to wear a seatbelt in one particularly perilous scene in the film Tomorrow Never Dies


Although Q is yet to be developed into a fully working synthetic voice system, the demo created by Sherman and his collaborators illustrated what it might sound like. They recorded the voices of people who identify as non-binary and adjusted the pitch to between 145 Hz and 175 Hz, which straddles many feminine and masculine human voices.

The result was played to 4,500 different people, Sherman says, and while some thought it sounded feminine while others perceived it as masculine, many judged it to be neither. Given this mix of responses, Sutton says Q is best described as "gender ambiguous" rather than neutral.

While a greater diversity of voices in computer systems could help move technologies away from stereotypical feminine performances, just because a digital voice's gender isn't obvious doesn't mean it can’t also be sexist, notes Sutton. Much depends on what the voice says and the functions it performs.

Designers of synthetic voices could offer even more outlandish options – voices that sound like weird cartoon characters or non-human animals. Mark West, lead author of the Unesco report suggested this approach last year.

"A way out of this conundrum is to project voice assistants and other AI applications as non-humans—a sort of 'let’s keep AI artificial' ethic," he said, noting that "non-human" sounding voices can be designed to be pleasant and intelligible.

There's mounting concern that misogyny towards AI voice assistants might spill over to affect real humans in the metaverse


But Sutton points out that people are now highly accustomed to anthropomorphised technologies.

"We are so conditioned to hear certain types of voices in these devices, moving even a little bit away from that can be difficult for users," she says.

Clearly, part of the problem here is that gender bias and prejudice exists across society and synthetic voices – like any cultural artefact – run the risk of reflecting that. Although still a worthwhile exercise, you can’t get rid of gender biases just by redesigning Siri’s voice. That won’t reverse people’s misogynistic attitudes overnight or suddenly equalise the number of women and men working in the AI industry.

There's another point to be made here. And that’s that virtual assistants – by definition – will always be subservient entities. They are more or less digital servants, after all, so how could we ever speak to them on a level playing field? That’s really what we would need in order to get away from all the awkward power dynamics and problematic, domineering behaviour that we currently throw their way.

"If they're primarily designed to help people search and shop, how far can you go with meaningful representations and relationships?" quizzes Charlotte Webb, co-founder of Feminist Internet.

In the near future, we are likely to encounter even more technologies that speak to us. Webb says she is concerned about how voice assistants could continue to perpetuate gender stereotypes once they embody avatars in the "metaverse" – virtual reality spaces. People have already been accused of sexually harassing others in the metaverse. Will virtual assistants serve to, inadvertently or not, enable and encourage such behaviour?

The history of synthetic voices, and our attitudes towards them, may have perpetuated and even deepened gender biases – like a feedback loop amplifying some of our worst intentions. And yet awareness of such issues has rocketed in recent years, with investigations into the output of AI technologies and changes in social attitudes thanks to the #MeToo movement and similar campaigns.

You could argue that’s the crux of all this, in the end. A more enlightened approach to one another and the wonderful array of human identities that exists in the world begins with us, not a database. In order to vanquish gender-based prejudices, we can’t just update the software. Or return the car to the manufacturer.

"I certainly don’t see a technological solution to it," says Webb. "I think it's a human problem."

Newsletter

Related Articles

London Daily
0:00
0:00
Close
Unelected PM of the UK holds an emergency meeting because a candidate got voted in… which he says is a threat to democracy…
You Are So Beautiful
Rob Schneider explains California reparations legislation.
Postmodern Jukebox European Tour Version
Who knew badminton could get so intense?
An old French tune (by Georges Brassens) Pomplamoose ft. John Schroeder
Farmers break through police barriers in Brussels.
Sattahip Motor Show 20
London's Iconic British Telecom Tower Sold To Become Hotel
SONATE AU CLAIR DE LUNE - Moonlight sonata
Ukraine Arrests Father-Son Duo In Lockbit Cybercrime Bust
A kiss to build a dream on
US Offers $15 Million For Info On Leaders Of Cybercrime Group Lockbit
Wonderful Tonight - Eric Clapton (Boyce Avenue acoustic cover)
Russia Claims UK Cultural Agency Spied for Ukraine
Mean Blues
Apple warns against drying iPhones with rice
La Chansonnette
Alexei Navalny: UK sanctions Russian prison chiefs after activist's death
Pattaya Addicts
German economy is in 'troubled waters' - ministry
Franz Liszt - Liebestraum - Love Dream
In a recent High Court hearing, the U.S. argued that Julian Assange endangered lives by releasing classified information.
Dream a little dream of me
New video
Unchained Melody sung like you've NEVER heard!
Tucker Carlson says Boris Johnson wants "a million dollars, in Bitcoin or cash, from Tucker Carlson to talk about Ukraine.
Dave Brubeck - Take Five
Russia is rebuilding capacity to destabilize European countries, new UK report warns
Édith Piaf - Non, Je Ne Regrette Rien (Sofie)
EU Commission wants anti-drone defenses at Brussels HQ
Rondo Alla Turca
Von der Leyen’s 2nd-term pitch: More military might, less climate talk
Kiss of fire
Global Law Enforcement Dismantles Lockbit Ransomware Operation
Tom Jones - I´ll Never Fall In Love Again 1967, 1989, 2001
Prince William Urges End to Gaza Conflict
Israel Cachao López - Guajira Clásica
UK court to hear Assange's final appeal against extradition to the US, where he faces charges related to his journalistic work—the publication of a classified video in 2010 that exposed US war crimes against humanity.
Edward Maya - Stereo Love (feat. Vika Jigulina) (Extended Mix)
About 50-60% kids either chose to be YouTuber or influencer
Strauss - Radetzky March - Karajan
A viral video of Nationals MP Barnaby Joyce lying on a Canberra footpath is celebrated by his media mates.
La vie en rose
European Countries React to Navalny's Death by Summoning Russian Diplomats
The Temptations - My Girl (Smokey Robinson Tribute) 2006 Kennedy Cent
Israel has gone ‘beyond self-defence’ in Gaza, says Labour’s Streeting
Orlando Cachaito Lopez Redencion
English farmers to be offered ‘largest ever’ grant scheme amid food security concerns
Edith Piaf - NON, JE NE REGRETTE RIEN
Cameron government knew Post Office ditched Horizon IT investigation
RADETZKY MARCH-2008-Wien, New Year Concert
EU Calls for Immediate Ceasefire in Gaza Conflict
Only you (And you alone)
EU Vows To Hold Putin "Accountable" After Meeting Alexei Navalny's Wife
Strangers In The Night
EU Launches Probe Into TikTok Over Child Protection Under Digital Content Law
Charles Aznavour - La Boheme
The EU Initiates Naval Mission to Defend Red Sea Trade Routes
Summer time
EU and UK Announce Joint Effort on Migration
Sting and Stevie Wonder - Fragile (from Sting's 60th birthday concert)
Brazil's Lula Likens Gaza Operation to Holocaust, Israel Says "Red Line" Crossed
Aux Champs Elysees
Ministers Confirm Proposal to Prohibit Mobile Phone Usage in English Schools
Stand By Me - Ben E. King (Boyce Avenue acoustic cover)
Microsoft-backed OpenAI valued at $80bn after company completes deal
La Mer (Beyond the Sea) – Avalon Jazz Band
‘Alexei would want to tell Russia not to give up fighting’
She
Rwandan Footballer's Dismissal Sparks Concerns Over UK Asylum Plan
Nathalie Song by Enzo Petrachi Stjepan Hauser Cello
Whisky Challenges China's Baijiu Market During New Year Celebrations
Shape of My Heart - Sting (Boyce Avenue acoustic cover)
Avdiivka - Symbol Of Ukrainian Resistance Now In Control Of Russian Troops
Radiohead - Creep
Putin Critic Alexei Navalny's "Killers" Refusing To Hand Over Body, Say Allies
Quizás,Quizás,Quizás - Andrea Bocelli - Jennifer Lopez
"Historic Step": Zelensky Signs Security Pact With Germany
Perhaps, Perhaps, Perhaps - Multi-Couples
"Historic Step": Zelensky Signs Security Pact With Germany
Pentatonix Havana
20 Tech Giants Sign Effort To Fight AI Election Interference Across Globe
Paula Cole - Autumn Leaves
Joe Biden Accuses Putin of Causing Navalny's Death
Oscar Benton Bensonhurst Blues
Russian opposition leader Alexey Navalny has died at the Arctic prison colony
OH NANANA vs ABUSADAMENTE
Tucker Carlson grocery shopping in Russia. This is so interesting.
Nina Simone - ”I Put A Spell On You”. Vezi aici cum cântă Jeremy Ragsd
Julian Assange's Wife Warns of His Death if Extradited to US
NIGHTWISH - The Phantom Of The Opera
‘A lot higher than we expected’: Russian arms production worries Europe’s war planners
Motorshow 2016 Tanjay Negros Oriental
Greece Legalizes Same-Sex Marriage and Adoption Rights
Monica Bellucci - Ti Amo
Hungarian Foreign Minister: Europeans will lose Europe, the Union's policy must change drastically
Michael Jackson - Billie Jean Milena The Voice France 2018
In Britain Homeowners are receiving CPO’s (Compulsory Purchase Orders) so their homes can be redistributed to migrants
Michael Buble (Help Me Make It Through The Night) feat Loren Allred
Memories Canon In D - Maroon 5 (Boyce Avenue piano acoustic cover)
Matteo Simoni - Marina
Maroon 5 - One More Night
Maroon 5 - Memories
Mark Knopfler - Brothers In Arms (Berlin 2007 Live)
Mark Knopfler & Emmylou Harris - Romeo And Juliet (Real Live Roadrunni
Marina, Marina - The LUCKY DUCKIES intimist live concert at Guimarães
Major Lazer & DJ Snake – Lean On Mauranne The Voice France 2016
Love Theme from Romeo and Juliet - Joslin - Henri Mancini, Nino Rota
LoLa & Hauser - Love Story
Linkin Park Jay-Z - Numb Encore (Live 8 2005)
Hallelujah Mennel Ibtissem, The Voice France Leonard Cohen
Leonard Cohen - Dance Me to the End of Love
Leonard Cohen & Natasha Rostova - Dance me to the end of love
La casa de papel - Bella Ciao
La Camisa Negra
L'italiano (Toto Cutugno) - The Gypsy Queens
Juanes - La Camisa Negra
Jonathan and Charlotte - Britain's Got Talent 2012 Live Semi Final - U
John Powell - Assassin's Tango
Joe Cocker - You Can Leave Your Hat On (LIVE in Dortmund)
Joe Cocker - Unchain My Heart 2002 Live
Joe Cocker - A Whiter Shade Of Pale
Jay Z & Alicia Keys - Empire State of Mind LIVE
Jason Mraz - Im Yours (live)
Jarrod Radnich - Bohemian Rhapsody - Virtuosic Piano Solo
James Blunt - You're Beautiful
James Blunt - You're Beautiful & Bonfire Heart (Live at The Nobel Peac)
If You Go Away - Helen Merrill & Stan Getz (Tribute to Virna Lisi)
I'LL BE MISSING YOU
I Say a Little Prayer
Hotel California ( Eagles ) 1994 Live
Historia de un amor - Luz Casal. Vezi interpretarea Biancăi Sumanariu
Here Comes The Sun - The Beatles (Boyce Avenue acoustic cover) on Spot
Heart - Stairway to Heaven Led Zeppelin - Kennedy Center Honors
HAVANA by Camila Cabello Zumba Pre Cooldown TML Crew Kramer Pastra
HAUSER and Señorita - I Will Always Love You
HAUSER - Waka Waka
HAUSER - Sway
HAUSER - Lambada
HAUSER - Historia de un Amor
HAUSER - Despacito
Great Pretender
Georgia May Foote & Giovanni Pernice Samba to 'Volare' - Strictly Come
Gary Moore - Still Got The Blues
GIPSY KINGS VOLARE Penelope Cruz
Fugees - Killing Me Softly With His Song
French Latino - Historia de un Amor
For A Few Dollars More The Danish National Symphony Orchestra (Live)
Flashdance • What a Feeling • Irene Cara
Filip Rudan - “Someone You Loved” Audicija 4 The Voice Hrvatska Sez
Eric Clapton - Wonderful Tonight
Enya - Only Time
Enrique Iglesias - Bailando (English Version) ft. Sean Paul
Enrique Iglesias - Bailamos
Elena Yerevan Historia de un amor
Ed Sheeran - Shape of You (Official Music Video)
Ed Sheeran - Perfect Symphony [with Andrea Bocelli]
Ed Sheeran - Perfect (Official Music Video)
Easy On Me - Adele (Boyce Avenue 90’s style piano acoustic cover) on S
ERA - Ameno
ELENA YEREVAN- Cancion Del Mariachi-IN STUDIO-2017 DPR
Dust In The Wind - Kansas (Boyce Avenue acoustic cover)
Don't Let Me Be Misunderstood
Despacito x Shape Of You - Pentatonix
Deep Purple - Child In Time - Live (1970)
David Foster When A Man Loves A WomanIt's A Mans World (SealMichael Bo
Dance me to the end of Love ( Pi-Air Design )
Coolio - Gangsta's Paradise (feat. L.V.) [Official Music Video]
Conquest Of Paradise (Vangelis), played on Böhm Emporio organ
Cielito Lindo
Chico & The Gypsies - Bamboleo
Canción Del Mariachi - Antonio Banderas, Los Lobos • Desperado
Camila Cabello - Havana (Audio) ft. Young Thug
Camila Cabello - Havana ( cover by J.Fla )
California Dreamin' - The Mamas & The Papas José Feliciano (Boyce Ave
Buster Benton - Money Is The Name of The Game
Hallelujah Pentatonix
Bobby McFerrin - Don't Worry Be Happy (Official Music Video)
Bob Dylan - Knockin' On Heaven's Door Emilia The Voice Kids France
Besame Mucho - Cesaria Evora
Ben E. King - Stand by Me Sax Cover Alexandra Ilieva Thomann
Bella Ciao
Bella Ciao - INSTRUMENTAL
Beautiful in White x Canon in D (Piano Cover by Riyandi Kusuma)
Bad Romance - Vintage 1920's Gatsby Style Lady Gaga Cover ft. Ariana Savalas & Sarah Reich(1)
BELLA CIAO 2020 - KARAOKE ITALIANO
BAMBOLEO - Gipsy Kings • Antonio Banderas, Katya Virshilas
BAILANDO (original)
Awesome Ukrainian yodeler - SOFIA SHKIDCHENKO (with English subtitles)
Avicii - The Nights
Atom - The Great Gig in the Sky
Aretha Franklin - (You Make Me Feel Like) A Natural Woman (Official Ly
Antonio Banderas - Cancion del Mariachi (Desperado)
André Rieu - Zorba's Dance (Sirtaki)
André Rieu - Can't Help Falling In Love
André Rieu & Mirusia - Ave Maria
Andrew Reyes Elton John - Don't Let The Sun Go Down The Voice 2020 (
Andreas Kümmert Whiter Shade Of Pale The Voice of Germany 2013 Showd
And I Love You So
All About That Bass - Postmodern Jukebox European Tour Version
Alan Walker - Faded (Piano Cover)
Ain't No Sunshine -- Bill Withers (cover by Canen 12 y.o.)
African music
Adriana Vidović - “Creep” Audicija 4 The Voice Hrvatska Sezona 3
Adriana Vidović - “Believer” Nokaut 3 The Voice Hrvatska Sezona 3
A Fistful of Dollars - The Danish National Symphony Orchestra and Tuva
4 Beautiful Soundtracks Relaxing Piano [10min]
2CELLOS - Whole Lotta Love vs. Beethoven 5th Symphony [OFFICIAL VIDEO]
2CELLOS - Smooth Criminal (Live at Suntory Hall, Tokyo)
2CELLOS - Smells Like Teen Spirit [Live at Sydney Opera House]
2CELLOS - Despacito [OFFICIAL VIDEO]
13 Year Old Girl Playing Il Silenzio (The Silence) - André Rieu
094.All About That Bass
00 - SADNESS PART 1
(Ghost) Riders In the Sky (American Outlaws Live at Nassau Coliseum, 1
(Everything I Do) I Do It For You - Bryan Adams (Boyce Avenue ft. Conn
What a wonderful world
Moon river
×