{"id":8579,"date":"2024-07-30T08:58:00","date_gmt":"2024-07-30T08:58:00","guid":{"rendered":"https:\/\/blog.zhdk.ch\/immersivearts\/?p=8579"},"modified":"2026-03-16T13:23:57","modified_gmt":"2026-03-16T13:23:57","slug":"conversations-with-puppets-the-revived-puppets-of-fred-schneckenburger","status":"publish","type":"post","link":"https:\/\/blog.zhdk.ch\/immersivearts\/conversations-with-puppets-the-revived-puppets-of-fred-schneckenburger\/","title":{"rendered":"Conversations with Puppets"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Conversations with Puppets\" src=\"https:\/\/player.vimeo.com\/video\/1171822771?dnt=1&amp;app_id=122963\" width=\"525\" height=\"295\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write; encrypted-media; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Part of the exhibition <strong>&#8220;The Museum of the Future &#8211; 17 Digital Experiments&#8221;<\/strong><br>29th August 2025 untill 1st February 2026, Museum f\u00fcr Gestaltung Z\u00fcrich<\/p>\n\n\n\n<p><br>The exhibition \u2018The Museum of the Future &#8211; 17 Digital Experiments\u2019 examined the potential, areas of application, forms of content expansion and implementation options relating to digitality in forward-looking museum and educational work. <\/p>\n\n\n\n<p><strong>About the project<\/strong><br>The Immersive Arts Space` contributing project is called \u2018Conversations with Puppets\u2019. It offers an innovative and interactive experience in which the visitors become an integral part of Fred Schneckenburger&#8217;s puppet cabaret. After World War II, the versatile artist Fred Schneckenburger founded the \u201cPuppencabaret Fred Schneckenburger\u201d in Zurich and enjoyed success throughout Europe with his sketches. His expressionistic, surreal stick puppets were characterized by their idiosyncratic and unique design. In terms of content, his pieces criticized the hypocrisy and contradictions of the conservative bourgeoisie, with stereotypical Swiss characters in the form of puppets. <\/p>\n\n\n\n<p><strong>Technical architecture<\/strong><br>Three of the original stick puppets &#8211; Kaspar, der Polizist and die Moral\/das Fr\u00e4ulein &#8211; from the collection of the Museum f\u00fcr Gestaltung Z\u00fcrich have been photogrammetrically captured and digitized. 3D artists worked out the details of the textures and cloths to recreate and animate the physical appearance of the puppets surfaces. In addition, Motion Capture recordings were used to add more puppet-like movement to the avatars. <br><br>Large Language Models (LLMs) and generative AI form the basis of the interaction and conversations. In order to create a character prompt for each puppet, the original audio recordings of the pieces in which the specific puppets appeared, were transcribed and analyzed. The result of the analysis were distillations of the most characteristic words and\/or expressions of the puppets, which were then inserted in the prompt. In addition, to the character references the prompts were further developed to fit the role of each puppets within the exhibition and its dramaturgy.<\/p>\n\n\n\n<p>Further, the interaction is supported by different systems, aiming at a flawless interaction and conversation. SAR motion, a system internally developed by Florian Bruggisser, detects via a camera the movement and body of a visitor. This triggers the interaction and the puppet starts to talk.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"683\" height=\"1024\" data-id=\"8801\" src=\"https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-683x1024.png\" alt=\"\" class=\"wp-image-8801\" srcset=\"https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-683x1024.png 683w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-200x300.png 200w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-768x1152.png 768w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-1024x1536.png 1024w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-1365x2048.png 1365w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_0-1-scaled.png 1707w\" sizes=\"auto, (max-width: 683px) 100vw, 683px\" \/><figcaption class=\"wp-element-caption\">Photo credits: Chris Elvis Leisi, <strong>\u00a9<\/strong>ZHdK 2025<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"683\" height=\"1024\" data-id=\"8799\" src=\"https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-683x1024.png\" alt=\"\" class=\"wp-image-8799\" srcset=\"https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-683x1024.png 683w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-200x300.png 200w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-768x1152.png 768w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-1024x1536.png 1024w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-1365x2048.png 1365w, https:\/\/blog.zhdk.ch\/immersivearts\/files\/2024\/07\/Puppets_keyVisual_4-1-scaled.png 1707w\" sizes=\"auto, (max-width: 683px) 100vw, 683px\" \/><figcaption class=\"wp-element-caption\">Photo credits: Chris Elvis Leisi, <strong>\u00a9<\/strong>ZHdK 2025<\/figcaption><\/figure>\n<\/figure>\n\n\n\n<p><br>Team:<br>Florian Bruggisser: Technical Lead and Software Development <br>Oliver Sahli: Idea, Interaction and System Integration<br>Chris Elvis Leisi: Interaction and Experience Design&nbsp;&nbsp;<br>Stella Speziali: 3D Artist, Animation<br>Johannes K\u00f6berle: 3D Artist<br>Corinne Soland: Motion Capture&nbsp;<br>Pascal Lund-Jensen: Audio Engineering&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<br>S\u00e9bastien Schiesser: Technical support<br>Kristina Jungi\u0107: Project coordination<br>Prof. Christopher Salter: Initiative \/ Director IAS<\/p>\n\n\n\n<p>Photo credits: Chris Elvis Leisi, <strong>\u00a9<\/strong>ZHdK 2025<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n","protected":false},"excerpt":{"rendered":"<p>Part of the exhibition &#8220;The Museum of the Future &#8211; 17 Digital Experiments&#8221;29th August 2025 untill 1st February 2026, Museum f\u00fcr Gestaltung Z\u00fcrich The exhibition \u2018The Museum of the Future &#8211; 17 Digital Experiments\u2019 examined the potential, areas of application, forms of content expansion and implementation options relating to digitality in forward-looking museum and educational &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/blog.zhdk.ch\/immersivearts\/conversations-with-puppets-the-revived-puppets-of-fred-schneckenburger\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Conversations with Puppets&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3675,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[576169],"tags":[],"class_list":["post-8579","post","type-post","status-publish","format-standard","hentry","category-archive-projects"],"_links":{"self":[{"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/posts\/8579","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/users\/3675"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/comments?post=8579"}],"version-history":[{"count":12,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/posts\/8579\/revisions"}],"predecessor-version":[{"id":9162,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/posts\/8579\/revisions\/9162"}],"wp:attachment":[{"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/media?parent=8579"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/categories?post=8579"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.zhdk.ch\/immersivearts\/wp-json\/wp\/v2\/tags?post=8579"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}