London Daily

Focus on the big picture.
Thursday, Apr 24, 2025

Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."
Researchers found students to have fared better at accounting exams than ChatGPT, OpenAI's chatbot product.

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."

The researchers from Brigham Young University (BYU), US, and 186 other universities wanted to know how OpenAI's technology would fare on accounting exams. They have published their findings in the journal Issues in Accounting Education.

In the researchers' accounting exam, students scored an overall average of 76.7 per cent, compared to ChatGPT's score of 47.4 per cent.

While in 11.3 per cent of the questions, ChatGPT was found to score higher than the student average, doing particularly well on accounting information systems (AIS) and auditing, the AI bot was found to perform worse on tax, financial, and managerial assessments. Researchers think this could possibly be because ChatGPT struggled with the mathematical processes required for the latter type.

The AI bot, which uses machine learning to generate natural language text, was further found to do better on true/false questions (68.7 per cent correct) and multiple-choice questions (59.5 per cent), but struggled with short-answer questions (between 28.7 and 39.1 per cent).

In general, the researchers said that higher-order questions were harder for ChatGPT to answer. In fact, sometimes ChatGPT was found to provide authoritative written descriptions for incorrect answers, or answer the same question different ways.

They also found that ChatGPT often provided explanations for its answers, even if they were incorrect. Other times, it went on to select the wrong multiple-choice answer, despite providing accurate descriptions.

Researchers importantly noted that ChatGPT sometimes made up facts. For example, when providing a reference, it generated a real-looking reference that was completely fabricated. The work and sometimes the authors did not even exist.

The bot was seen to also make nonsensical mathematical errors such as adding two numbers in a subtraction problem, or dividing numbers incorrectly.

Wanting to add to the intense ongoing debate about how how models like ChatGPT should factor into education, lead study author David Wood, a BYU professor of accounting, decided to recruit as many professors as possible to see how the AI fared against actual university accounting students.

His co-author recruiting pitch on social media exploded: 327 co-authors from 186 educational institutions in 14 countries participated in the research, contributing 25,181 classroom accounting exam questions.

They also recruited undergraduate BYU students to feed another 2,268 textbook test bank questions to ChatGPT. The questions covered AIS, auditing, financial accounting, managerial accounting and tax, and varied in difficulty and type (true/false, multiple choice, short answer).
Newsletter

Related Articles

0:00
0:00
Close
Trump administration moves to BAN essentially ALL artificial food dyes in the USA food supply at RFK Jr.'s direction
Woman slaps man at sports game and gets herself and husband beat up
Pope Francis: head of the Catholic church who pushed for social and economic justice
China do not pay these tariffs - you pay it. This is new 145% tax you pay to the US government.
Nightlife in the streets of Manchester
In God We Profit
Cultural Battles in the Vatican: The Candidates in the Battle for the Holy See and Pope Francis's Testament
Global Leaders Pay Tribute to Pope Francis Following His Death
Wild Chimpanzees Observed Bonding Over Alcoholic Fruit
US Federal Reserve Chair Issues Warning on Tariff Impact
UK Prison Officers Demand Electric Stun Guns Amid Safety Concerns
China, China, China!
Australian National Charged as Mercenary for Fighting in Ukraine
Israel Considers Limited Strikes on Iran's Nuclear Facilities Amid Diplomatic Efforts
Prince Andrew Joins Royal Family Attends Easter Sunday Service at Windsor Castle
Saudi Arabia Offers Max Verstappen Unprecedented Deal to Join Aston Martin
Global Pistachio Shortage Amid Rising Demand for 'Dubai Chocolate'
Trump is assembling a coalition of Western leaders aligned with the MAGA vision, strengthening a unified front for global change
IMF Predicts No Global Recession Amid Trade Tensions
Here’s a police officer with a brilliant gift for swift education
"Some complain that we put thousands in prison. In reality, we set millions free."
This is Vienna, Austria in 2025.
Boeing Jet Returns to US from China Amid Tariff War
Canadian Federal Election: Candidates' Positions on US-Canada Relations and Donald Trump
Resentencing Hearing for Menendez Brothers Who Killed Their Parents Delayed Amid Legal Disputes
Australian Woman Gives Birth To Stranger's Baby In IVF Mix-up
US Sets Deadline for Russia-Ukraine Peace Deal Brokerage
Italy Introduces 'Sex Rooms' in Prisons for Inmates
California Launches Legal Challenge Against Trump Administration's Tariffs
"Groundless": China Dismisses Zelensky's Claims It's Supplying Arms To Russia
UK Psytrance Festival Cancelled Amid Local Protests Over Noise Concerns
French Far-Right Writer Renaud Camus Denied Entry to UK
UK Police Force Updates Search Policy for Trans Individuals in Custody
Italian Prime Minister Giorgia Meloni Meets with Donald Trump to Discuss EU-US Trade Tensions
Canada's Federal Party Leaders Engage in Final Debate Ahead of General Election
Ukraine and US Sign Outline of Minerals Deal
Fast Food Chain Refuses to Apologize for Online Comment About Katy Perry's Space Voyage
New York Attorney General Letitia James Faces Criminal Referral for Alleged Mortgage Fraud
Mark Cuban admits support for Trump executive order: ‘Gotta be honest’
US Senator Meets with Deported Immigrant in El Salvador Amid Custody Dispute
U.S. State Department Raises El Salvador’s Safety Ranking, Making It Safer Than France and Other European Nations
UK Government Assumes Control of British Steel's Scunthorpe Plant Amid Shutdown Threat
UK MP Wera Hobhouse Denied Entry to Hong Kong During Family Visit
Bangladesh Issues Arrest Warrant for UK MP Tulip Siddiq
China Urges United States to Cancel Tariffs Amid Escalating Trade Tensions
The Empire’s USD Pyramid Scheme Is Working Brilliantly—So Why ‘Fix’ It?
China Raises Tariffs on U.S. Goods to 125% Amid Escalating Trade Dispute
Elon Musk Reports $150 Billion in Projected Government Savings Amid Fraud Investigations
U.S. and Panama Finalize Defense Agreements Amid Canal Access and Chinese Influence Concerns
China Stands Firm Amidst Trade Disputes with the US: A Factual Analysis
×