The Times Australia
News From Asia

.

Hong Kong Baptist University at the forefront of human-AI symbiotic art creation with innovative performance

HONG KONG SAR - Media OutReach - 2 August 2022 - A pioneering and bold attempt to apply artificial intelligence (AI) technologies in the performing arts was carried out by Hong Kong Baptist University (HKBU) in a public concert held on 14 July in Hong Kong.



Caption
The HKBU Symphony Orchestra and an AI virtual choir perform a newly arranged choral-orchestral version of the song Pearl of the Orient, with an accompanying cross-media visual narrative based on the lyrics and music created by an AI media artist.

The innovative performance was the first human-AI collaboration of its kind in the world, and it showcased how AI can be a creative force that can perform music, create cross-media art, and dance.

The performance was powered by the AI technologies developed by HKBU scientists under the "Building Platform Technologies for Symbiotic Creativity in Hong Kong" research project. The concert, dubbed "A Lovers' Reunion", was the Annual Gala Concert of the HKBU Symphony Orchestra, and it was conducted by its music director, Professor Johnny M Poon.

The research project is led by Professor Guo Yike, Vice-President (Research and Development) of HKBU, and supported by HK$52.84 million (US$6.77 million) in funding from the Theme-based Research Scheme under the Research Grants Council. Its deputy project coordinator, Professor Johnny M Poon, is the Associate Vice-President (Interdisciplinary Research) and the Founding Dean of HKBU's School of Creative Arts.

The project team also comprises computer scientists from HKBU's Augmented Creativity Lab. The unique mix of scientists and artists in the project team enables them to merge their cross-disciplinary knowledge and come up with sparkling ideas on how to unleash the endless possibilities of art creation with the infusion of cutting-edge technologies.

At the Concert, the project team presented a performance that marked the first time in the world that an AI choir had combined with an AI-generated visual storyteller to perform interactively with a conductor and an orchestra. The HKBU Symphony Orchestra shared the stage with an AI virtual choir to perform a newly arranged version of the song Pearl of the Orient with the voices of 320 virtual performers.

The AI virtual choir was "trained" by HKBU researchers using the generative models of singing that they built by extracting and disentangling key contributing features of vocal singing from a collection of songs recorded by professional singers.

An AI media artist learnt from the lyrics of the Pearl of the Orient, and it created a stunning cross-media visual narrative of the song according to its interpretation of the underlying meaning of the lyrics. Unlike the conventional AI machines that import images as a reference for the algorithms to mimic, it used textual lyrics as the sole input so that it can associate the underlying meaning of the lyrics with an appreciation of the beauty of Hong Kong.

Another highlight of the Concert was a ballet performance featuring AI virtual dancers in Ravel's Daphnis et Chloé, accompanied live by the HKBU Symphony Orchestra. With the help of professional dancers from the Hong Kong Dance Company, the AI virtual dancers interpreted the underlying emotional and aesthetic connections between the music and the dance. The dance movements, inspired by a newly discovered species of box jellyfish in Hong Kong, were then choreographed.

Please click here to view highlights of the performance, and click here for more production details of the performance.

The AI-driven performance is one of the many milestone deliverables of the "Building Platform Technologies for Symbiotic Creativity in Hong Kong" research project, and others include an art data repository, a generative AI algorithms system, a research theatre, a digital art and policy network, and some unique and creative application projects, to name but a few.

Another important initiative HKBU is organising is the "Human, Machine, Art, Creativity: International Symposium" in the Hong Kong Convention and Exhibition Centre on 9 August.

"AI is revolutionising numerous fields of knowledge, and it is playing a more and more significant role in many creative processes like music, visual arts and architecture. The Symposium will gather world-renowned researchers from academia and industry, crossing different expertise areas, to jointly discuss emerging topics in human-AI symbiotic art creativity," said Professor Guo.

The Symposium will cover topics including the enabling technologies of symbiotic art creation and manifestation, the aesthetics and cognitive values of symbiotic art creativity, the new trend of the art economy with Web 3.0, new issues raised by the new forms of art in society, and the impact on art community stakeholders, among others.

Interested parties can visit the Symposium's website for more details.

Hashtag: #HongKongBaptistUniversity #HKBU

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

The Role of Your GP in Creating a Chronic Disease Management Plan That Works

Living with a long-term condition, whether that is diabetes, asthma, arthritis or heart disease, means making hundreds of small decisions every day. You plan your diet against m...

Troubleshooting Flickering Lights: A Comprehensive Guide for Homeowners

Image by rawpixel.com on Freepik Effectively addressing flickering lights in your home is more than just a matter of convenience; it's a pivotal aspect of both home safety and en...

My shins hurt after running. Could it be shin splints?

If you’ve started running for the first time, started again after a break, or your workout is more intense, you might have felt it. A dull, nagging ache down your shins after...

Metal Roof Replacement Cost Per Square Metre in 2025: A Comprehensive Guide for Australian Homeowners

In recent years, the trend of installing metal roofs has surged across Australia. With their reputation for being both robust and visually appealing, it's easy to understand thei...

Why You’re Always Adjusting Your Bra — and What to Do Instead

Image by freepik It starts with a gentle tug, then a subtle shift, and before you know it, you're adjusting your bra again — in the middle of work, at dinner, even on the couch. I...

How to Tell If Your Eyes Are Working Harder Than They Should Be

Image by freepik Most of us take our vision for granted—until it starts to let us down. Whether it's squinting at your phone, rubbing your eyes at the end of the day, or feeling ...