Immersive Landscapes in the Arts and Film (2023)

Module from 11th to 15th September 2023

Screenshot from presentation documentation, September 2022 © ZHdK

In painting, photography and film, landscapes are transformed into dream images and stylized into archetypes. Landscapes are contemporary witnesses of collective longings and dystopias.
With immersive technologies such as video mapping, virtual reality and spatial audio, these become multimodal experiences. In interdisciplinary groups the module aims to work on scenes for spatial or object projections in the Immersive Arts Space and test possible interactions with the motion capture system. Getting to know the workflows and experimenting with immersive media are the main focus. In this short week, experimental installations, sketches and small projects will be created, exploring diverse approaches and perspectives on digitally designed landscapes through immersive media.

Team: Eric Larrieux, Valentin Huber, Stella Speziali, Thomas Isler, Miriam Loertscher


Immersive Arts Practices (Autum semester 2023)

Immersive Arts Practices Doubles, Twins and Avatars

Tuesdays: 26.09. / 03.10. / 10.10. / 17.10. / 24.10. / 31.10. / 14.11. / 21.11. / 28.11. / 05.12.2023
Immersive Arts Space (1.J30) | 18:45-20:30

The Immersive Arts Practices aims to provide a general introduction to the current use of doubles, twins and avatars in films, games, the arts, and social media. Using the technologies that are available in the Immersive Arts space, the course also provides a basic understanding of creating 3D representations of humans and integrating avatars in digital media environments and immersive experiences, such as virtual and augmented reality (VR, AR) photogrammetry and 3D scan, volumetric capture, motion capture, and projection mapping. In small interdisciplinary groups, the participants then develop their own projects and implement their double, twin and avatar within the range of their own capacity and the available technologies.

Registration via Vorlesungsverzeichnis

Lecturers: Stella Speziali and other members of the IAS


Tanz der fliegenden Lichtobjekte

Module from 4th to 15th September 2023

The module is aimed at students from all departments at ZHdK who want to artistically explore the available technology in Immersive Arts Space and in particular the potential of three-dimensional media installations.

Autonomous flying helium drones will be realized within two weeks. Students will work in groups composed of as many different disciplines as possible to cover as broad a range of expertise as possible. The groups will have time for experiments, for the development and construction of a helium drone (airship or balloon with drone control) and for the development of a spatial installation concept.
The team of lecturers from different disciplines (Scenography, Industrial Design, Spacial Projection) is available to advise on the concept development and support the planning of possible further developments.

Lead: Martin Fröhlich, Roman Jurt
Further lecturers: Stella Speziali, Mariana Grünig, Melody Chua


Illuminated Flying Objects (2021)

Photo by Christian Iseli © ZhdK, 2021

Interdisciplinary workshop with BA students (Z-module), Sept. 2021

The workshop with the German title Tanz der fliegenden Lichtobjekte offered an introduction into the basic technical infrastructure and into current research activities of the Immersive Arts Space. The students designed and implemented prototypes of three-dimensional media installations with helium drones, spatial projections and 3D audio. They constructed their own zeppelin models, developed control modalities and designed video textures for them. After two weeks three immersive experiences were presented with a variety of different artistic and narrative approaches. The workshop is based on the findings and methods of the artistic research project Helium Drones.

Photo by Christian Iseli © ZhdK, 2021

Students:
Micaela Brazerol, Julia Huerlimann, Jana Meyer, Tamina Kronenberg, Yannick Meyer, Laura Nan, Carla Opetnik, Fabio Saccani, Michael Schlapbach, Sophia Strickerschall, Janosch Tillich, Violetta Vigh

Teaching staff:
Martin Fröhlich (head of the workshop, Immersive Arts Space)
Roman Jurt (Design & Technology Lab)
Serena Cangiano (Head of Fablab Supsi, Lugano)
Stella Speziali, (Immersive Arts Space)
Lukas Sander (MA Stage Design)
Johannes Schütt (Institute for Computer Music and Sound Technology)

Illuminated Flying Objects are featured in the Annual Report 2021 by ZHdK. Read full article [here]


Immersive Landscapes in Art and Film

Photo by Jyrgen Üeberschär

In the Z-Module “Immersive Landscapes in Art and Film” in September 2021, students from the fields of design, film, theatre and fine arts dealt with photogrammetry, virtual reality and 3D sound. Within two weeks, the groups developed three different immersive landscapes:

– Using virtual reality glasses, an actor could discover a walk-in visual scenery by means of the sense of touch and change it by interacting with virtual objects.
– Real hands became moving digital sculptures in a planetary virtual reality landscape using photogrammetry and motion capture.
– White rigid bodies became transformers of an abstract soundscape via motion capture in a participatory performance in immersive arts space.

In addition to engaging with transdisciplinary art and film projects, the students were able to test and evaluate the latest ‘interactive experience’ with Birdly at Somniacs in a field trip.

Photo by Jyrgen Üeberschär

Teaching Staff:
Miriam Loertscher (Institute for Performing Arts and Film)
Thomas Isler (Department Fine Arts)
Jyrgen Ueberschär (Departement Fine Arts)
Valentin Huber (Department Performing Arts and Film/ Immersive Arts Space)
Stella Speziali (Immersive Arts Space) 
Eric Larrieux (Immersive Arts Space)

Dreams & Dystopia

Photo by Thomas Isler ©ZHdK 2020

Interdisciplinary module with BA students, Aug/Sept. 2020 

The two-week workshop Dreams & Dystopia (Immersive Landscapes II) focused on the creation of cinematic landscapes (artificial, urban or natural spaces) for three-dimensional media such as spatial projection or virtual reality. Artistic approaches from painting, photography, film and CGI were taught and the differences worked out interactively with the students.

Teaching staff:
Thomas Isler, Department of Fine Arts
Miriam Loertscher, Department of the Performing Arts and Film
Jyrgen Ueberschär, Department of Fine Arts,
Valentin Huber, Stella Speziali, Immersive Arts Space


Illuminated Flying Objects (2020)

Photo by Urs Berlinger ©ZHdK 2020

Interdisciplinary workshop with BA students (Z-module), Aug/Sept. 2020

Over the course of two weeks, groups of students from different art and design programs, conceived and constructed helium drones (airships or balloons with drone navigation control) and developed a spatial installation concept including a 3D sound design. The illumination of the helium drones is achieved either by remote controlled moving lights or by projection mapping. The movement of the drones is controlled by a computer-aided tracking system.

The Z-module with the German title Tanz der fliegenden Lichtobjekte resulted in a variety of exciting flying objects, including a large floating manta ray. The workshop is based on the findings and methods of the artistic research project Helium Drones.

Teaching staff:
Martin Fröhlich (Immersive Arts Space)
Roman Jurt (Design & Technology Lab)
Nadia Fistarol (MA&BA stage design)
Johannes Schütt (Institute for Computer Music and Sound Technology)


BATVISION

© ZHdK 2020

«Have you ever wondered how a bat perceives the world?» BATVISION offers the chance to playfully explore how bats use echo-location to detect their surroundings. The VR-experience visualizes the bat’s auditory sensation and makes it more tangible. Surrounded by complete darkness, the virtual world only becomes visible when the users start shouting. BATVISION simulates the ultrasonic navigation of bats, enables new forms of perception and raises the awareness for an endangered species.

BATVISION is a collaboration between the ZHdK Industrial Design program and the Immersive Arts Space. In their bachelor thesis Eliane Zihlmann and Raffaele Grosjean developed the concept of the VR experience and the associated hardware design. They were supported by IASpace staff members Oliver Sahli (programming, visual implementation, interaction control), Chris Elvis Leisi (implementation of multi-user functionality) and Florian Bruggisser (3D scanning and point-cloud processing).


Performance Capture Workshop

Neil Newbon and participants during the workshop. ZHdK © 2019

The UK based company Performance Captured Academy (PCAUK) was invited to introduce the basics of Motion and Performance Capture to the participants. Neil Newbon, Performance Capture Artist and Director together with his team gave an inspiring look into the possibilities of creating characters through body language. The participants got used to their tracked body movement, played with different somatic types and shapes and learned a new on set vocabulary. Creature work as well as basic walk cycles were part of the training.The workshop endend with a performance of Newbon at the Actor/Avatar conference, where he invited performers from the workshop to join in.

The technical setup included the motion capture tracking system, guaranteeing real time performance of up to eight virtual characters in virtual environments. Furthermore, a face performance tracking system was used with a face rigging software.

Cast & Crew
Performance Capture Mentor Team: Neil Newbon, Saleta Losada, Frazer Blaxland (PCAUK)
Motion Capture & Unity: Tobias Baumann, Norbert Kottmann, Benjamin Thoma, Oliver Sahli, Chris Elvis Leisi
Overall Support: Martin Fröhlich
Project Lead: Corinne Soland


Immersive Landscapes

Photo by Christian Iseli © ZHdK 2019

Interdisciplinary workshop with BA students , September 2019 (Z-module)

In painting, photography and film, landscapes are often transformed into dream images and stylized into archetypes. Landscapes are contemporary witnesses of collective longings and dystopias. With the new possibilities of virtual reality and immersive media, they can become overwhelming media experiences. In the workshop, real landscapes or self-built miniature landscapes were captured and prepared for VR experiences or spatial projection mapping. In both formats, the results appeared in the three-dimensional space.

Project lead: Thomas Isler, Miriam Loertscher
Lecturers: Jyrgen Ueberschär, Norbert Kottmann, Simon Peter Pfaff, Martin Fröhlich
In cooperation with the Immersive Arts Space.
Students: Giulia Hess, Yangzom Sharlhey, José Manuel Zacate Lizárraga, Aylin Cagri Acikel, Nemo Bleuer, Suphansa Buraphalit, Yvonne Haberstroh, Sonjoi Nielsen, Vanja Victor Tognola, Danuka Ana Tomas, Flavia Trachsler.