Dreaming of Time and Space

Photo by Regula Bearth © ZHdK 2020

The installation and immersive performance took place between October 6th and 9th 2021

See trailer of the performance here

In the ongoing research project “The Umbrella Project” the use of 3D audio and projection mapping are explored in order to achieve a sense of immersion without isolating participants from the real world, essentially, enabling an imaginary fantasy world to come to life in our own. We employ multiple levels of 3D audio and projection mapping (both directly within and on the umbrella, as well as throughout the room itself) in order to transport the participant into this virtual world. 

As such, we can consider the umbrellas, and the overall system of which they are a part, to be an instrument of sorts, in that they literally allow us to compose and explore reactive sonic environments in 6 degrees of freedom (6 DoF). Additionally, the umbrellas can also function as a measurement instrument, much as a stethoscope does as a sonic instrument for medical examination; however, in this case, through the immersive experiences they purvey, the umbrellas enable us to examine the nature of our own perception of reality. 

The end goal of the project is to create a series of navigable compositions in the form of exploratory sonic worlds, as well as interactive experiences where the participants’ behaviors (relative to each other and the world) shape the sonic and visual environment. Furthermore, we are investigating sonic and visual paradigms where the umbrellas can function both as objects existing in and can interact with the virtual world, as well as being windows onto these other worlds.

Crew: Eric Larrieux (direction, 3D audio) , Stella Speziali (projection mapping), Mariana Vieira Grünig (scenography)