The Times Australia
Google AI
The Times Australia
.

AI in the classroom is hard to detect – time to bring back oral tests

  • Written by Shahper Richter, Senior Lecturer in Digital Marketing, University of Auckland, Waipapa Taumata Rau

News that several New Zealand universities have given up using detection software[1] to expose student use of artificial intelligence (AI) underlines the challenge higher education is facing.

With AI tools such as ChatGPT now able to produce essays, reports and case studies in seconds, the old assessment model is breaking down. For decades, that model was valued for testing not just knowledge, but also analysis, argumentation and communication.

Now, however, its reliability is under pressure. If a machine can generate a plausible essay on demand, how can we be sure we are assessing a student’s own understanding and reasoning?

We have been exploring another way forward. Instead of doubling down on plagiarism software, we have gone back to something surprisingly simple: talking to students.

For the past two years, we have been running “interactive oral assessments[2]” (IOAs). They are proving to be one of the most effective and authentic ways to see what students really know in the age of AI.

Think of it as a structured conversation. Students meet with a lecturer or tutor, individually or in a small group, and answer questions about work they have already submitted.

Examiners do not just check for memorised facts. Using the Socratic method of questioning[3], they probe the reasoning behind students’ answers, drawing out genuine understanding rather than rehearsed responses.

It is not a performance or a speech. Because the questions are tailored to each student and unfold in real time, IOAs are difficult to outsource: a chatbot may produce text, but it cannot sustain a probing conversation about your own work.

Face-to-face assessment

We first trialled IOAs[4] in a postgraduate marketing course with 42 students. Each sat a seven-minute conversation based on their course work. The grading guide covered both content (do they understand the concepts?) and communication (can they explain clearly and logically?).

The results were encouraging. Where grades had previously skewed toward the upper range under written assessment, likely reflecting increased AI assistance on take-home assignments, IOAs produced a more balanced spread of marks across grade bands.

Students reported the process felt fairer, and lecturers heard richer demonstrations of understanding and critical thinking. One lecturer put it neatly:

The dialogue revealed what students actually understood, rather than what they could memorise or outsource.

To ensure nerves did not get in the way, we built practice runs into tutorials during the semester so expectations were clear long before the final assessment.

Running one-on-one conversations for hundreds of students isn’t realistic, so we adapted the format. In larger undergraduate courses with over 200 students, we run IOAs in group settings: students attend together, but each answers individually.

We also use multiple assessors running simultaneous IOA sessions. This lets us assess large cohorts in the same timeframe as a traditional exam without overloading a single lecturer or tutor.

This model has two big advantages: logistics are manageable and anxiety is reduced. Seeing peers go through the same process normalises the experience. The group format still preserves the essence of the IOA.

Back to the future?

Two years in, clear patterns have emerged. IOAs reveal qualities written exams and essays often mask. Students must explain, apply and defend their ideas in real time, so we can see whether they truly grasp the material, not just whether they can structure an essay or reproduce text.

Importantly, IOAs also develop work-ready skills: clear communication, critical thinking and defending a position under questioning. These abilities are needed in interviews, client meetings and professional discussions. As one student said:

It felt like a job interview, not just an exam.

IOAs are not effort-free. Examiners benefit from training in how to ask probing yet fair questions, and in applying grading guides consistently, especially when student and session numbers increase.

Scheduling and recording at scale requires careful planning, from coordinating rooms to examiner availability and recording options. With the right support, however, these challenges are manageable.

IOAs are not a silver bullet, but they are a promising response to the realities of AI. They make it harder to outsource work, help staff see genuine understanding, and give students practice in the kinds of discussions that dominate modern workplaces.

In many ways, IOAs take us back to the future: they revive the oldest oral form of examination, reimagined for today’s classrooms. Crucially, they do more than safeguard academic integrity, they build the capabilities employers expect.

If universities want to prepare students for the real world while protecting the credibility of their courses, it may be time to do what seems counterintuitive: stop writing and start talking.

References

  1. ^ given up using detection software (www.rnz.co.nz)
  2. ^ interactive oral assessments (teachwell.auckland.ac.nz)
  3. ^ Socratic method of questioning (www.law.uchicago.edu)
  4. ^ first trialled IOAs (www.youtube.com)

Read more https://theconversation.com/ai-in-the-classroom-is-hard-to-detect-time-to-bring-back-oral-tests-265955

Subcategories

Australia is flooded with climate misinformation

Australia is facing a wave of misinformation and disinformation on climate change and energy. This is being fu...

Times Magazine

The Voltx Topband V1200 Portable Power Station Review

When we received a Voltx Topband V1200 portable power station for review, a staff member at The Time...

Is E10 fuel bad for my car? And could it save me money?

Fuel has become a precious, and increasingly expensive, commodity. The ongoing Middle East co...

Efficient Water Carts for Dust Control

Managing dust effectively is a critical challenge across numerous industries in Australia. From sp...

How new rules could stop AI scrapers destroying the internet

Australians are among the most anxious in the world[1] about artificial intelligence (AI). This...

Why Car Enthusiasts Are Turning to Container Shipping for Interstate Moves

Moving across the country requires careful planning and plenty of patience. The scale of domestic ...

What to know if you’re considering an EV

Soaring petrol prices are once again making many Australians think seriously[1] about switching ...

The Times Features

Shou Sugi Ban: The Ancient Japanese Timber Technique Transforming Australian Architecture

There is something quietly extraordinary about a building material that has been refined over cent...

The Complete Guide to LED Installation: What Homeowners and Business Owners Need to Know

Electricity bills in Australia are among the highest in the developed world, and lighting accounts...

I’m close to retirement age. What are my options for drawing on my super savings?

Retiring well means making a series of decisions to ensure a financially secure post-work life. ...

Samsung expands B2B Mobile eXperience distribution with Ingram Micro Australia

The channel diversification reinforcers the Australian B2B division’s positive trajectory SYDNE...

Focusing on how and why you eat – not just what – may be the key to healthy eating

When most people think about “healthy eating”, they usually focus on what they eat. That might...

HARRY POTTER™: THE EXHIBITION TICKETS NOW ON SALE!

An Enchanting Exhibition Celebrating the world of Harry Potter Opens in SYDNEY on 14 MAY Get r...

Leader of The Nationals Matt Canavan - Sky News Interview

SKY NEWS TRANSCRIPT WITH HOST PETER STEFANOVIC; FUEL CRISIS; PAGE RESEARCH CENTRE REPORT ON LIQUID F...

Taste Port Douglas 10-year celebration

Serving up more than 40 events across four days, the anniversary edition  promises a vibrant cel...

Is dark chocolate healthier than milk chocolate? 2 dietitians explain

Easter chocolate is all over supermarket shelves. Some people reach straight for milk chocolat...