ARCTIC
A live A-cappella performance with real-time voice interactive animation.
ROLE
Concept
Design
Development
Performance
SKILLS
Physical Computing
Unity 3D
TYPE
Personal
DATE
Nov - Dec 2018

About

This is an experimental live performance with voice interactive animation. In this visualised a-cappella performance, different voice part controls different elements in the animation scene with pitch or volume. I combined animation, music composing, singing and programming together to design for improving aesthetic experience, and explore future live A-cappalle form at the same time.

Credits

CUCA Accapella Groups

Process

Design sketch

In order to easily detect pitch of voice, I re-arranged a slow song Arctic by Sleeping at Last with simple melody to a cappella version.

Set-up & Test

Set-up: 5 wireless microphones, 5 sound cards & receivers
Mic for tenor controls the undersea fog with volume.
The fog gets thicker when the voice become louder.
Mic for alto controls the ball's movement with her pitch.
The ball moves higher as her pitch is getting higher.

Performance

I invited my a-cappella singing group to give the performance. In this visualised a-cappella performance, different voice part controls different elements in the animation scene with pitch or volume.

Colorful bubbles appear when soprano1 starts to sing "dm dm dm"
A high pitch of soprano2 active the colorful plasma
The ball breaks through the clouds through a designed motion trail

Visual outcome

discover more projects