The Umbrella Project

Photo by Regula Bearth © ZHdK 2020

Installation/performance, October 8th and 9th 2021, in the context of Swiss Digital Days

The Umbrella Project is an ongoing research project that explores the use of 3D audio and projection mapping to achieve a sense of immersion without isolating participants from the real world, essentially, enabling an imaginary fantasy world to come to life in our own. We employ multiple levels of 3D audio and projection mapping (both directly within and on the umbrella, as well as throughout the room itself) in order to transport the participant into this virtual world. The end goal of the project is to create a series of navigable compositions in the form of exploratory sonic worlds, as well as interactive experiences where the participants’ behaviours (relative to each other and the world) shape the sonic and visual environment. Furthermore, we are investigating sonic and visual paradigms where the umbrellas can function both as objects existing in and can interact with the virtual world, as well as being windows onto these other worlds. Naturally, these environments are best experienced from directly underneath the umbrella, where one can best appreciate the various levels of MR.

Shows:
08/10/2021, 18:30 – 19:15
09/10/2021, 14:00 – 14:45
09/10/2021, 16:00 – 16:45
09/10/2021, 18:00 – 18:45
Immersive Arts Space, Pfingsweidstr. 95, 8005 Zurich

Team:
Eric Larrieux
Stella Speziali
Mariana Vieira Grünig


Emerging Talents: Chris Elvis Leisi

ZHdK Talent Talk, November 4th 2021, in the context of Swiss Digital Days

Chris Elvis Leisi, research associate in the Immersive Arts Space and a graduate of the ZHdK Game Design program, talks about his graduation project Virtual Real World.

In today’s VR games, the body often serves as the controller. However, when the player enters the virtual world, the connection to the physical environment is often lost. This master’s thesis deals with immersion mechanics in Virtual Reality and reveals the potentials that arise when one’s own home can be integrated into the virtual world as a play area.

17:15-18:15h, Kino Toni, ZHdK, Pfingstweidstrasse 96, 8005 Zurich
Speaker: Chris Elvis Leisi
Host: Christian Iseli


ZFICTION.21 – Virtual Production

The first edition of the feature film conference ZFICTION took place in June 2021 and focused the versatile promises of the new tools for film production. Filmmakers and researchers explored the question of how virtual production will change the near future of fictional storytelling in film and what new challenges this will bring.

In the conference exhibition Immersive Arts Space hosted a virtual production shooting situation, offered hands-on experiences with the cineDesk and showcased the virtual production method that filmmaker in residence Andreas Dahn had applied for his animation film and VR experience Home in the Distance.

On the conference website www.zfiction.ch the talks, discussions and elements of the exhibtion can be revisited


Power and Presence

Diploma project, MA Game Design, by Oliver Sahli

Power and Presence explores meaningful and empowering interaction in virtual reality and how it can be implemented as game mechanics without breaking the feeling of being in another world.  A critical analysis of game design theories and how they need to be applied to VR is demonstrated through a game that uses phonetic interaction.

Oliver Sahli, research associate at the Immersive Arts Space and graduation student in Master in Game Design, showcased his project Power and Presend within the diploma exhibition of the ZHdK in June.

Virtual Real World

Diploma project, MA Game Design, by Chris Elivis Leisi

In today’s VR games, the body often serves as the controller. However, when the player enters the virtual world, the connection to the physical environment is often lost. This master’s thesis deals with immersion mechanics in VR and reveals the potentials that arise when one’s own home can be integrated into the virtual world as a play area.

Chris Elvis Leisi, research associate in the Immersive Arts Space and graduate student in Master in Game Design, exhibited his graduation project Virtual Real World within the diploma exhibition of the ZHdK in June.

black box fading

© 2020 Meldoy Chua

Diploma performance, MA Transdisciplinarity by Melody Chua

black box fading, a performance for human, sensor-augmented flute (chaosflöte), and improvisation machine (AIYA), is an immersive experience that draws upon the performance interplay between human and machine to craft a narrative that manipulates perceptions of human-machine agency and human-machine interactions in a neosurrealist environment. The work is a hybrid setting between performance and installation, and between virtual reality and live events, where live reactive sounds and visual projections, shifting perceptions of space and scale, and unconventional 360° editing techniques contribute to the sensation of continuously negotiable dynamics between human and machine as well as the disruption of traditional performance hierarchies.

Crew

Melody Chua – concept, instrument, performance
Valentin Huber: cinematographer 360° camera
Eric Larrieux: sound engineer
Sébastien Schiesser: technical manager, IAS


Chimaera

Diploma project, Master Transdisciplinarity, by Bojan Milosevic

The use of human data in combination with computer algorithms creates a kind of post-human entity. In form of an improvisational dance performance, Chimaera explores the interaction between a performer and his avatar – a human-machine hybrid. The performance took place in March in the Immersive Arts Space and was streamed live.

Crew

Bojan Milosevic (project leader, audio and video coding)
Petra Rotar (dance, choreography)
Carmen Stüssi (dramaturgy)
Patrick Müller (mentoring)
Tobias Baumann (support motion capture)
Eric Larrieux (support 3D sound)
Schiesser Sébastien (IAS technician)
Martin Fröhlich (support projection mapping)


Floating in Dancing Lights

Photo by Regula Bearth © ZHdK 2020

Floating in Dancing Lights is a mesmerizing dance performance featuring a dancer and a flying swarm of objects, illuminated by means of Spatial Augmented Reality. The performance represents the tentative culmination of an internal project of the Immersive Arts Space which offers a do-it-yourself framework for designing and building remotely controllable helium drones.

Crew:
Martin Fröhlich (project lead), Max Kriegleder (robotics, motion control), Roman Jurt (rapid prototyping, construction), Serena Cangiano (ideation).

Performance:
Denise Lampart, (choreography), Naomi Khamihigashi (dancer), David Peña (assistant to choreographer), Ben Vorhar (costume design), Luca Magni, Eric Larrieux (sound).

Floating in Dancing Lights is part of the artistic research project Helium Drones. The performances premiered at the REFRESH#3 conference in September 2020.

Preview video by Urs Berlinger & Hubert Schmelzer, ZHdK ©2020

A Day at the Beach

Photo by Regula Bearth, ZHdK ©2020

REFRESH #3 Sept 18, 2020, 19:30, Immersive Arts Space

The performance A Day at the Beach explores the use of 3D audio and projection mapping to achieve a sense of immersion without isolating the participants from the real world and thus enabling an imaginary fantasy world to come to life. In in order to transport the participants into this virtual world, multiple levels of 3D audio and projection mapping are employed, both directly onto umbrellas, as well as throughout the room itself.
The goal is to create exploratory, interactive sonic worlds, where the participants’ behaviour (relative to each other and the environment) shape the sonic and visual experience. These environments are best experienced from directly underneath the umbrellas.

At the REFRESH conference, A Day at the Beach demonstrated some early results of the ongoing research project The Umbrella Project. – Watch the teaser video.

Crew: Eric Larrieux (project lead), Stella Speziali, Martin Fröhlich, Corinne Soland, Mariana Vieira Grünig