By
Xinzhen (April) Yang

"Shadow the Shadow" is an immersive projection installation exploring the cultural significance of shadows, traditionally viewed as symbolic representations of our souls or inner struggles in a darker realm. Inspired by traditional shadow play and childhood folk games like "Step the Shadow," the project aims to disrupt conventional methods by enabling real-time interaction with participants' shadows. In response to the evolving desires of audiences for active engagement, the project seeks to redefine the role of shadows in storytelling and personal expression, bridging the gap between passive observation and active participation in shaping the shadow world.

Project Video

 

Abstract

The project is built using a state-of-the-art body tracking system to control the real-time projection of shadows onto the wall surface. As individuals move closer, the machine learning system dynamically adjusts the confidence level, controlling the representation of another world—a fusion of nature and technology embodied by robots—in response to human interaction. Audience are also able to influence the brightness of the light sources as they move close. Furthermore, as human figures approach, any physical contact with the robots leads to further deconstruction within the projection. This intricate technical setup not only creates an immersive experience but also underscores the project's exploration of the intersection between human presence, technology, and the representation of alternate realities. “Shadow the shadow” 's design embodies a profound philosophical shift, recreating traditional modes of interaction and narrative construction in shadow art. Through its innovative approach, the project seeks to breathe new life into the ancient art of shadow play, break the limitations of the shadow's inability to recreate or influence another world, fostering deeper connections between past and present while paving the way for future experimentation and exploration in Chinese shadow arts. By prioritizing audience engagement and agency, it not only redefines the role of viewers but also prompts reflection on the evolving relationship between technology, storytelling, and cultural heritage. In essence, it represents a reimagining of tradition for the digital age, inviting audiences to actively participate in the creation of a shadow narration.

Images

 

Project Logbook

Websites: Canva (with all the videos) | Notion

Keywords: Shadow art, Immersive experience, Interactive projection

Copyright Statement
“Face, Hand, Pose Tracking & More in Touchdesigner with @mediapipe GPU Plugin.” YouTube, YouTube, 9 Sept. 2023, www.youtube.com/watch?v=Cx4Ellaj6kk&t=830s.
“Real-Time Diffusion in Touchdesigner - STREAMDIFFUSIONTD Setup + Install + Settings.” YouTube, YouTube, 12 Jan. 2024, www.youtube.com/watch?v=X4rlC6y1ahw&t=43s.