London Daily

Focus on the big picture.
Saturday, May 31, 2025

Google Lookout: App reads grocery labels for blind people

Google Lookout: App reads grocery labels for blind people

Google's AI can now identify food in the supermarket, in a move designed to help the visually impaired.

It is part of Google's Lookout app, which aims to help those with low or no vision identify things around them.

A new update has added the ability for a computer voice to say aloud what food it thinks a person is holding based on its visual appearance.

One UK blindness charity welcomed the move, saying it could help boost blind people's independence.

Google says the feature will "be able to distinguish between a can of corn and a can of green beans".

Eye-catching, not easy


Many apps, such as calorie trackers, have long used product barcodes to identify what you're eating. Google says Lookout is also using image recognition to identify the product from its packaging.

The app, for Android phones, has some two million "popular products" in a database it stores on the phone - and this catalogue changes depending on where the user is in the world, a post on Google's AI blog said.

In a kitchen cupboard test by a BBC reporter, the app had no difficulty in recognising a popular brand of American hot sauce, or another similar product from Thailand. It could also correctly read spices, jars and tins from British supermarkets - as well as imported Australian favourite Vegemite.

But it fared less well on fresh produce or containers with irregular shapes, such as onions, potatoes, tubes of tomato paste and bags of flour.

If it had trouble, the app's voice asked the user to twist the package to another angle - but still failed on several items.

The UK's Royal National Institute of Blind People (RNIB) gave a cautious welcome to the new feature.

"Food labels can be challenging for anyone with a visual impairment, as they are often designed to be eye-catching rather than easy to read," said Robin Spinks from the charity.

"Ideally, we would like to see accessibility built into the design process for labels so that they are easier to navigate for partially sighted people."

But along with other similar apps - such as Be My Eyes and NaviLens, which are also available on iPhones - it "can help boost independence for people with sight loss by identifying products quickly and easily".


Be My Eyes: How smartphones became ‘eyes’ for blind people



Lookout uses similar technology to Google Lens, the app that can identify what a smartphone camera is looking at and show the user more information. It already had a mode that would read any text it was pointed at, and an "explore mode" that identifies objects and text.

Launching the app last year, Google recommended placing a smartphone in a front shirt pocket or on a lanyard around the neck so the camera could identify things directly in front of it.

Another new function added in the update is a scan document feature, which takes a photo of letters and other documents and sends it to a screen reader to be read aloud.

Google also says it has made improvements to the app based on feedback from visually impaired users.

Newsletter

Related Articles

0:00
0:00
Close
Satirical Sketch Sparks Political Spouse Feud in South Korea
Indonesia Quarry Collapse Leaves Multiple Dead and Missing
South Korean Election Video Pulled Amid Misogyny Outcry
Asian Economies Shift Away from US Dollar Amid Trade Tensions
Netflix Investigates Allegations of On-Set Mistreatment in K-Drama Production
US Defence Chief Reaffirms Strong Ties with Singapore Amid Regional Tensions
Vietnam Faces Strategic Dilemma Over China's Mekong River Projects
Malaysia's First AI Preacher Sparks Debate on Islamic Principles
White House Press Secretary Criticizes Harvard Funding, Advocates for Vocational Training
France to Implement Nationwide Smoking Ban in Outdoor Spaces Frequented by Children
Meta and Anduril Collaborate on AI-Driven Military Augmented Reality Systems
Russia's Fossil Fuel Revenues Approach €900 Billion Since Ukraine Invasion
U.S. Justice Department Reduces American Bar Association's Role in Judicial Nominations
U.S. Department of Energy Unveils 'Doudna' Supercomputer to Advance AI Research
U.S. SEC Dismisses Lawsuit Against Binance Amid Regulatory Shift
Alcohol Industry Faces Increased Scrutiny Amid Health Concerns
Italy Faces Population Decline Amid Youth Emigration
U.S. Goods Imports Plunge Nearly 20% Amid Tariff Disruptions
OpenAI Faces Competition from Cheaper AI Rivals
Foreign Tax Provision in U.S. Budget Bill Alarms Investors
Trump Accuses China of Violating Trade Agreement
Gerry Adams Wins Libel Case Against BBC
Russia Accuses Serbia of Supplying Arms to Ukraine
EU Central Bank Pushes to Replace US Dollar with Euro as World’s Main Currency
Chinese Woman Dies After Being Forced to Visit Bank Despite Critical Illness
President Trump Grants Full Pardons to Reality TV Stars Todd and Julie Chrisley
Texas Enacts App Store Accountability Act Mandating Age Verification
U.S. Health Secretary Ends Select COVID-19 Vaccine Recommendations
Vatican Calls for Sustainable Tourism in 2025 Message
Trump Warns Putin Is 'Playing with Fire' Amid Escalating Ukraine Conflict
India and Pakistan Engage Trump-Linked Lobbyists to Influence U.S. Policy
U.S. Halts New Student Visa Interviews Amid Enhanced Security Measures
Trump Administration Cancels $100 Million in Federal Contracts with Harvard
SpaceX Starship Test Flight Ends in Failure, Mars Mission Timeline Uncertain
King Charles Affirms Canadian Sovereignty Amid U.S. Statehood Pressure
Trump Threatens 25% Tariff on iPhones Amid Dispute with Apple CEO
Putin's Helicopter Reportedly Targeted by Ukrainian Drones
Liverpool Car Ramming Incident Leaves Multiple Injured
Australia Faces Immigration Debate Following Labor Party Victory
Iranian Revolutionary Guard Founder Warns Against Trusting Regime in Nuclear Talks
Macron Dismisses Viral Video of Wife's Gesture as Playful Banter
Cleveland Clinic Study Questions Effectiveness of Recent Flu Vaccine
Netanyahu Accuses Starmer of Siding with Hamas
Junior Doctors Threaten Strike Over 4% Pay Offer
Labour MPs Urge Chancellor to Tax Wealthy Over Cutting Welfare
Publication of UK Child Poverty Strategy Delayed Until Autumn
France Detains UK Fishing Vessel Amid Post-Brexit Tensions
Calls Grow to Resume Syrian Asylum Claims in UK
Nigel Farage Pledges to Reinstate Winter Fuel Payments
Boris and Carrie Johnson Welcome Daughter Poppy
×