London Daily

Focus on the big picture.
Wednesday, Nov 04, 2026

Face masks are screwing up facial recognition software

Face masks are screwing up facial recognition software

Face masks are already known to stop the spread of coronavirus. Apparently, they can also make it much harder for facial-recognition software to identify you, too.
This is the key finding of a new report released Monday from federal researchers at the National Institute of Standards and Technology, or NIST, which is a branch of the US Commerce Department whose functions include measuring the accuracy of facial-recognition algorithms that companies and researchers submit to the lab.

When tasked with matching a picture of a person wearing a digitally added face mask to a different photo of the person without one, the most accurate facial-recognition algorithms failed to make a correct match between 5% and 50% of the time, according to the report. Generally speaking, most of the algorithms tested had failure rates of between 20% and 50%, Mei Ngan, a computer scientist at NIST and an author of the report, told CNN Business.

The identification issues make sense, as facial-recognition systems typically work by comparing measurements between different facial features in one image to those in another. Blocking off part of the face means there is less information for the software to use to make a match.

It highlights a unique challenge the tech industry is already working to confront as the pandemic continues. While the technology is controversial, with a number of companies recently rethinking providing this technology to law enforcement, it's used in a range of products and services, from using your face to unlock your smartphone to passing through a security checkpoint.

For their report, the researchers created nine different black and light blue mask shapes to account for the ways mask shapes vary in the real world and used them to hide part of a person's face in a photo. They then compared a digitally masked photo of each person with another, unmasked photo of the same person. They also conducted a test of the algorithms on both sets of photos with no virtual masks.

In all, they tested 89 algorithms on more than 6 million photos featuring a million different people. The photos came from two sources: applications for US immigration benefits, which were used as the unmasked images, and photos of travelers crossing a border to enter the US, which were given a digital mask.

NIST found that the best of these algorithms -— which were submitted to the lab before mid-March — failed just 0.3% of the time when tested on these same sets of photos without the digital masks. With the digital masks on, however, error rates climbed to 5% among these same algorithms.

An obvious shortcoming of the report is that NIST didn't test the algorithms on images of people who were actually wearing masks — Ngan said the digital approximations of masks were used due to time and resource constraints. On the plus side, it allowed researchers to quickly get a sense of the effect of masks on the algorithms, but real masks fit differently on different people. It's still unknown how texture or patterns might affect accuracy of facial recognition software.

"That's something we want to look at," Ngan said.

Some companies have said their facial-recognition technology can work with masks, and Ngan said she's heard from developers who are working on algorithms meant to make this possible — perhaps by training an algorithm with lots of images of people wearing actual masks, or by targeting the region of the face above the middle of the nose.

That's a focus for Marios Savvides, a professor at Carnegie Mellon University who studies biometric identification. He said a person who's wearing a mask can be essentially invisible to a facial-recognition system, as it doesn't even detect a face in the first place. He thinks the region of the face that includes the eyes and eyebrows tends to change the least over time, which makes it a good part of the face to use when trying to identify a person whose mouth and nose are hidden.

The NIST report is the first of several that the lab plans to issue about how facial-recognition algorithms identify masked faces. In the fall, Ngan said, NIST expects to release a report on the accuracy of algorithms that were specifically created with the intention of spotting people in masks.
Newsletter

Related Articles

0:00
0:00
Close
Northern Ireland Executive Agrees on Multi-Year Public Sector Pay Restructuring Framework at Stormont
Department for Transport Confirms Acceleration of Electric Vehicle Charging Infrastructure Rollout Along Strategic Motorways
Welsh Government Announces Emergency Funding Package to Support Agricultural Sector Facing Severe Weather Impacts
High Court Rules in Favor of Environmental Coalition Over Government Carbon Reduction Plan Deficiencies
Office for National Statistics Reports Stable Retail Sales Growth Supported by Strong Digital Commerce Volumes
Scottish First Minister John Swinney Secures Cross-Party Support for Renewable Energy Export Expansion
National Health Service Digital Reports Major Breakthrough in Reducing Elective Waiting Lists Across England
Chancellor Rachel Reeves Outlines Infrastructure Spending Reforms to Boost Regional Economic Growth Across Northern England
Bank of England Holds Baseline Interest Rate at Five Percent Amid Persistent Core Inflation Pressures
House of Lords Advances Representation of the People Bill to Modernize Electoral Law Ahead of General Election
Financial Markets and Private Equity Assess Tax and Corporate Realignment Following Recent Chancellor Budget Adjustments
Justice Committee Warns Legal Aid Is a Service in Managed Decline Due to Inadequate Government Funding Responses
Royal Navy Intercepts Russian Intelligence Vessel and Warships Across Intensive North Sea Operations
Business and Trade Committee Slams Government Policy on China as Fragmented and Lacking Strategic Direction
Home Secretary Shabana Mahmood Softens Immigration Plans Following Intensive Cabinet Backlash Over Settlement Timelines
Automotive Industry Data Reveals Continued Acceleration in Battery Electric Vehicle Registrations Across British Dealerships
High Court of England and Wales Rules on Landmark Legal Challenge Regarding Local Government Housing Mandates
Department for Energy Security and Net Zero Approves Expanded Offshore Wind Infrastructure Along Scottish Coastline
Competition and Markets Authority Launches Broad Investigation Into Artificial Intelligence Infrastructure and Cloud Partnerships
United Kingdom and European Union Launch High-Level Preparations for Bilateral Defense and Security Summit in Brussels
National Health Service England Unveils Emergency Workforce Reforms to Alleviate Winter Accident and Emergency Pressures
Chancellor Rachel Reeves Finalizes Autumn Budget Adjustments to Meet Fiscal Rules and Fund Public Services
Bank of England Prepares for Interest Rate Decision Amid Rising Bond Yields and Inflationary Pressures
House of Lords Begins Detailed Legislative Scrutiny of Representation of the People Bill and Cyber Security Laws
Metropolitan Police Detain More Than Three Hundred Individuals Following Large-Scale Demonstration Outside London Embassy
Home Office Prepares Stricter Residency Rules Requiring Vulnerable Migrants to Wait Decade for Settlement Rights
Professional Mental Health Bodies Demand Statutory Regulation for Counsellors and Psychotherapists
National Grid Confirms Construction of Britain's Largest Electrical Substation to Power Teesside Data Centre
Prime Minister Keir Starmer Travels to Samoa for Commonwealth Summit Amid Debates on Economic Cooperation and Reparations
Home Office Implements Enhanced Digital Border Controls and Visa Processing Systems at Major Airports
Office for National Statistics Reports Stable Employment Participation Rates Across Regional Labor Markets
Department for Business and Trade Announces Strategic Partnership to Secure Critical Mineral Supply Chains
Scottish Government Unveils Regional Economic Development Strategy to Boost Advanced Manufacturing in Glasgow and Dundee
Treasury Officials Review Taxation Frameworks and Capital Gains Rules Ahead of Autumn Budget Disclosures
National Health Service Leaders Warn of Winter Capacity Pressures Across Acute Care Facilities
Bank of England Prepares for Key Interest Rate Decision Amid Sticky Inflation and Fiscal Policy Pressures
Home Office Expands Border Security Operations and Intelligence Sharing With European Partners
Office for National Statistics Reports Modest Retail Sales Growth Ahead of Crucial Christmas Trading Season
Welsh Government Unveils Strategic Plan to Boost Regional Technology Innovation and Digital Skills Training
Department for Environment Food and Rural Affairs Implements New Agricultural Subsidies Framework for English Farmers
Scottish First Minister John Swinney Announces Major Regional Infrastructure and Green Energy Investment Strategy
National Health Service Leaders Warn of Severe Winter Pressures and Mounting Accident and Emergency Backlogs
Bank of England Monetary Policy Committee Signals Cautious Interest Rate Path Amid Persistent Services Inflation
Chancellor of the Exchequer Rachel Reeves Finalizes Autumn Budget Framework Aiming to Close Public Sector Fiscal Gap
Department for Science, Innovation and Technology Prepares Enhanced Artificial Intelligence Safety and Cyber Defense Frameworks
United Kingdom Government Expands International Sanctions Framework Against Russian Shadow Fleet and Financial Enablers
Institute of Directors Reports Sharp Post-Budget Drop in Business Confidence Despite Long-Term Investment Intention Shifts
Chancellor John Healey Defends Sweeping Fiscal Adjustments and Household Support Packages Following Autumn Budget
Parliamentary Petitions Committee Schedules Major Legislative Debates on Special Educational Needs and Non-Stun Meat Labelling
Regional Devolution and Good Growth Fund Frameworks Reshape Local Government Funding Across English Regions
×