The Times Australia
Fisher and Paykel Appliances
The Times Australia
.

AI in the classroom is hard to detect – time to bring back oral tests

  • Written by Shahper Richter, Senior Lecturer in Digital Marketing, University of Auckland, Waipapa Taumata Rau

News that several New Zealand universities have given up using detection software[1] to expose student use of artificial intelligence (AI) underlines the challenge higher education is facing.

With AI tools such as ChatGPT now able to produce essays, reports and case studies in seconds, the old assessment model is breaking down. For decades, that model was valued for testing not just knowledge, but also analysis, argumentation and communication.

Now, however, its reliability is under pressure. If a machine can generate a plausible essay on demand, how can we be sure we are assessing a student’s own understanding and reasoning?

We have been exploring another way forward. Instead of doubling down on plagiarism software, we have gone back to something surprisingly simple: talking to students.

For the past two years, we have been running “interactive oral assessments[2]” (IOAs). They are proving to be one of the most effective and authentic ways to see what students really know in the age of AI.

Think of it as a structured conversation. Students meet with a lecturer or tutor, individually or in a small group, and answer questions about work they have already submitted.

Examiners do not just check for memorised facts. Using the Socratic method of questioning[3], they probe the reasoning behind students’ answers, drawing out genuine understanding rather than rehearsed responses.

It is not a performance or a speech. Because the questions are tailored to each student and unfold in real time, IOAs are difficult to outsource: a chatbot may produce text, but it cannot sustain a probing conversation about your own work.

Face-to-face assessment

We first trialled IOAs[4] in a postgraduate marketing course with 42 students. Each sat a seven-minute conversation based on their course work. The grading guide covered both content (do they understand the concepts?) and communication (can they explain clearly and logically?).

The results were encouraging. Where grades had previously skewed toward the upper range under written assessment, likely reflecting increased AI assistance on take-home assignments, IOAs produced a more balanced spread of marks across grade bands.

Students reported the process felt fairer, and lecturers heard richer demonstrations of understanding and critical thinking. One lecturer put it neatly:

The dialogue revealed what students actually understood, rather than what they could memorise or outsource.

To ensure nerves did not get in the way, we built practice runs into tutorials during the semester so expectations were clear long before the final assessment.

Running one-on-one conversations for hundreds of students isn’t realistic, so we adapted the format. In larger undergraduate courses with over 200 students, we run IOAs in group settings: students attend together, but each answers individually.

We also use multiple assessors running simultaneous IOA sessions. This lets us assess large cohorts in the same timeframe as a traditional exam without overloading a single lecturer or tutor.

This model has two big advantages: logistics are manageable and anxiety is reduced. Seeing peers go through the same process normalises the experience. The group format still preserves the essence of the IOA.

Back to the future?

Two years in, clear patterns have emerged. IOAs reveal qualities written exams and essays often mask. Students must explain, apply and defend their ideas in real time, so we can see whether they truly grasp the material, not just whether they can structure an essay or reproduce text.

Importantly, IOAs also develop work-ready skills: clear communication, critical thinking and defending a position under questioning. These abilities are needed in interviews, client meetings and professional discussions. As one student said:

It felt like a job interview, not just an exam.

IOAs are not effort-free. Examiners benefit from training in how to ask probing yet fair questions, and in applying grading guides consistently, especially when student and session numbers increase.

Scheduling and recording at scale requires careful planning, from coordinating rooms to examiner availability and recording options. With the right support, however, these challenges are manageable.

IOAs are not a silver bullet, but they are a promising response to the realities of AI. They make it harder to outsource work, help staff see genuine understanding, and give students practice in the kinds of discussions that dominate modern workplaces.

In many ways, IOAs take us back to the future: they revive the oldest oral form of examination, reimagined for today’s classrooms. Crucially, they do more than safeguard academic integrity, they build the capabilities employers expect.

If universities want to prepare students for the real world while protecting the credibility of their courses, it may be time to do what seems counterintuitive: stop writing and start talking.

References

  1. ^ given up using detection software (www.rnz.co.nz)
  2. ^ interactive oral assessments (teachwell.auckland.ac.nz)
  3. ^ Socratic method of questioning (www.law.uchicago.edu)
  4. ^ first trialled IOAs (www.youtube.com)

Read more https://theconversation.com/ai-in-the-classroom-is-hard-to-detect-time-to-bring-back-oral-tests-265955

Unmoored Ley has the appearance of a dead woman walking

Opposition Leader Sussan Ley is looking like a dead woman walking. The latest devastating Newspoll[1], which ...

Active Wear

Times Magazine

Myer celebrates 70 years of Christmas windows magic with the LEGO Group

To mark the 70th anniversary of the Myer Christmas Windows, Australia’s favourite department store...

Kindness Tops the List: New Survey Reveals Australia’s Defining Value

Commentary from Kath Koschel, founder of Kindness Factory.  In a time where headlines are dominat...

In 2024, the climate crisis worsened in all ways. But we can still limit warming with bold action

Climate change has been on the world’s radar for decades[1]. Predictions made by scientists at...

End-of-Life Planning: Why Talking About Death With Family Makes Funeral Planning Easier

I spend a lot of time talking about death. Not in a morbid, gloomy way—but in the same way we d...

YepAI Joins Victoria's AI Trade Mission to Singapore for Big Data & AI World Asia 2025

YepAI, a Melbourne-based leader in enterprise artificial intelligence solutions, announced today...

Building a Strong Online Presence with Katoomba Web Design

Katoomba web design is more than just creating a website that looks good—it’s about building an onli...

The Times Features

Research uncovering a plant based option for PMS & period pain

With as many as eight in 10 women experiencing period pain, and up to half reporting  premenstru...

Trump presidency and Australia

Is Having Donald Trump as President Beneficial to Australia — and Why? Donald Trump’s return to...

Why Generosity Is the Most Overlooked Business Strategy

When people ask me what drives success, I always smile before answering. Because after two decades...

Some people choosing DIY super are getting bad advice, watchdog warns

It’s no secret Australians are big fans[1] of a do-it-yourself (DIY) project. How many other cou...

Myer celebrates 70 years of Christmas windows magic with the LEGO Group

To mark the 70th anniversary of the Myer Christmas Windows, Australia’s favourite department store...

Pharmac wants to trim its controversial medicines waiting list – no list at all might be better

New Zealand’s drug-buying agency Pharmac is currently consulting[1] on a change to how it mana...

NRMA Partnership Unlocks Cinema and Hotel Discounts

My NRMA Rewards, one of Australia’s largest membership and benefits programs, has announced a ne...

Restaurants to visit in St Kilda and South Yarra

Here are six highly-recommended restaurants split between the seaside suburb of St Kilda and the...

The Year of Actually Doing It

There’s something about the week between Christmas and New Year’s that makes us all pause and re...