London Daily

Focus on the big picture.
Monday, Jun 30, 2025

Digital forensics experts prone to bias, study shows

Digital forensics experts prone to bias, study shows

Participants found more or less evidence on hard drive depending on what contextual information they had
Devices such as phones, laptops and flash drives are becoming increasingly central to police investigations, but the reliability of digital forensics experts’ evidence has been called into question.

A study found that experts tended to find more or less evidence on a suspect’s computer hard drive to implicate or exonerate them depending on the contextual information about the investigation that they were given.

Even those presented with the same information often reached different conclusions about the evidence.

Such biases are known to be a problem in other forensic disciplines including fingerprint analysis, but this is the first time it has been demonstrated in digital forensics.

“I cannot overemphasise the importance of forensic scientists understanding the potential for unintentional bias, and of ensuring they take measures to minimise the risks,” said Dr Gillian Tully, a professor of practice for forensic science policy and regulation at King’s College London and former UK forensic science regulator.

Digital evidence now features in around 90% of criminal cases. Digital examiners working in police and private laboratories use specialised software and other techniques to secure, retrieve and analyse data from suspects’ communications, photos and other digital interactions that could shed light on their activities.

However, the field’s rapid growth means that has not been subjected to the same scientific scrutiny as other forensic techniques. “It has been described as the wild west because it wasn’t developed systematically and scientifically before it went into the criminal justice system,” said Dr Itiel Dror, an expert in cognitive bias at University College London who carried out the study.

Ian Walden, a professor of information and communications law at Queen Mary, University of London, said there was a tendency to believe the machine. “This study shows that we need to be careful about electronic evidence,” Walden said. “Not only should we not always trust the machine, we can’t always trust the person that interprets the machine.”

Dror and Nina Sunde at the University of Oslo, Norway, gave 53 digital forensics examiners from eight countries including the UK the same computer hard drive to analyse. Some of the examiners were provided with only basic contextual information about the case, while others were told the suspect had confessed to the crime, had a strong motive for committing it or that the police believed she had been framed.

The study, soon to be published in Forensic Science International: Digital Investigation, found that the examiners who had been led to believe the suspect might be innocent documented the fewest traces of evidence in the files, while those who knew of a potential motive identified the most traces.

It also found low levels of consistency between examiners who were given the same contextual information, in terms of the observations, interpretations and conclusions they drew from the files.

“Digital forensics examiners need to acknowledge that there’s a problem and take measures to ensure they’re not exposed to irrelevant, biased information,” said Dror. “They also need to be transparent to the courts about the limitations and the weaknesses, acknowledging that different examiners may look into the same evidence and draw different conclusions.”

In her final report before stepping down as forensic science regulator earlier this year, Tully called for improved compliance with quality standards for digital forensic labs, many of which have not been accredited, and greater scrutiny of scientific evidence in court.

Dr David Gresty, a senior lecturer in computer forensics at the University of Greenwich, said: “We have every reason to believe that an expert acting in good faith, but through a mistake of interpretation, could easily mislead a courtroom. Without the defence instructing another expert to review the evidence it is entirely possible this could go unnoticed, and realistically it is likely there are undetected miscarriages of justice where cases have relied heavily on digital evidence.”

A report published by the Police Foundation in January recommended that training in digital forensics be provided for everyone working within the criminal justice system, including judges, prosecutors and defence barristers, to help reduce instances of misinterpretation and better understand the limits of what can be achieved.

The Police Foundation’s director, Rick Muir, said: “There may always an element of subjectivity in this, but we could try to reduce the room for error through effective training and the use of common standards across digital forensics work. Most examination is done in-house, so I think there’s a real onus on the police to make sure that consistent standards are applied.

“If it loses credibility, that’s a massive problem because almost any criminal case these days will have some kind of digital evidence. You could have people who were wrongly convicted or people who are guilty going free, and there’s a wider issue of undermining public confidence in digital forensics if you don’t get this right.”

A spokesperson for the National Police Chiefs’ Council said: “Digital forensics is a growing and important area of policing which is becoming increasingly more prominent as the world changes. This report is from a very small sample size and is not representative of the operational environment police in this country work in. We are always looking at how technology can add to our digital forensic capabilities and a national programme is already working on this.”
Newsletter

Related Articles

0:00
0:00
Close
Robots Compete in Football Tournament in China Amid Injuries
Trump Administration Considers Withdrawal of Funding for Hospitals Providing Gender Treatment to Minors
Texas Enacts Law Allowing Gold and Silver Transactions
China Unveils Miniature Insect-Like Surveillance Drone
OpenAI Secures Multimillion-Dollar AI Contracts with Pentagon, India, and Grab
Marc Marquez Claims Victory at Dutch Grand Prix Amidst Family Misfortune
Germany Votes to Suspend Family Reunification for Asylum Seekers
Elon Musk Critiques Senate Budget Proposal Over Job Losses and Strategic Risks
Los Angeles Riots ended with Federal Investigations into Funding
Budapest Pride Parade Draws 200,000 Participants Amid Government Ban
Southern Europe Experiences Extreme Heat
Xiaomi's YU7 SUV Launch Garners Record Pre-Orders Amid Market Challenges
Jeff Bezos and Lauren Sanchez's Lavish Wedding in Venice
Russia Launches Largest Air Assault on Ukraine Since Invasion
Education Secretary Announces Overhaul of Complaints System Amid Rising Parental Grievances
Massive Anti-Government Protests Erupt in Belgrade
Trump Ends Trade Talks with Canada Over Digital Services Tax
UK Government Softens Welfare Reform Plans Amid Labour Party Rebellion
Labour Faces Rebellion Over Disability Benefit Reforms Ahead of Key Vote
Jeff Bezos and Lauren Sánchez Host Lavish Wedding in Venice Amid Protests
Trump Asserts Readiness for Further Strikes on Iran Amid Nuclear Tensions
North Korea to Open New Beach Resort to Boost Tourism Economy
UK Labour Party Faces Internal Tensions Over Welfare Reforms
Andrew Cuomo Hints at Potential November Comeback Amid Democratic Primary Results
Curtis Sliwa Champions His Vision for New York City Amid Rising Crime Concerns
Federal Reserve Proposes Changes to Capital Rule Affecting Major Banks
EU TO HUNGARY: LET THEM PRIDE OR PREP FOR SHADE. ORBÁN TO EU: STAY IN YOUR LANE AND FIX YOUR OWN MESS.
Trump Escalates Criticism of Media Over Iran Strike Coverage
Trump Announces Upcoming US-Iran Meeting Amid Controversial Airstrikes
Trump Moves to Reshape Middle East Following Israel-Iran Conflict
Big Four Accounting Firms Fined in Exam Cheating Scandal
NATO Members Agree to 5% Defense Spending Target by 2035
Australia's Star Casino Secures $195 Million Rescue Package Amid Challenges
UK to Enhance Nuclear Capabilities with Acquisition of F-35A Fighter Jets
Russian Shadow Payments via Cryptocurrency Reach $9 Billion
Explosions Rock Doha as Iranian Missiles Target Qatar
“You Have 12 Hours to Flee”: Israeli Threat Campaign Targets Surviving Iranian Officials
Macron and Merz: Europe must arm itself in an unstable world
Germany and Italy Under Pressure to Repatriate $245bn of Gold from US Vaults
Airlines Evaluate Flight Cancellations Amid Escalating US-Iran Tensions
Starmer Invites Innovators to Join Government Talent Scheme
UK Economy’s Strong Opening Quarter Shows Signs of Cooling
Harrods Seeks Court Order to Secure Al Fayed Estate for Victims
BA and Singapore Airlines Cancel Dubai Flights Amid Middle East Tensions
Trump Faces Backlash from MAGA Base Over Iran Strikes
Meta Bets $14 B on Alexandr Wang to Drive AI Ambitions
WATCH: Israeli forces show the aftermath of a massive airstrike at Iran's Isfahan nuclear site
FedEx Founder Fred Smith, ‘Heart and Soul’ of the Company, Dies at 80
Chinese Factories Shift Away from U.S. Amid Trump‑Era Tariffs
Pimco Seizes Opportunity in Japan’s Dislocated Bond Market
×