This project reimagines the “True and Fake Monkey King” tale from Journey to the West through an interactive digital shadow play. By combining traditional Chinese shadow puppetry with real-time motion tracking and projection, it explores the tension and harmony between cultural heritage and new media expression.
Project Video
Abstract
This project reimagines the classic tale of “The True and Fake Monkey King” from Journey to the West, using interactive digital technology to breathe new life into traditional Chinese shadow puppetry. It explores how ancient narratives can be revitalized and made relevant through the fusion of cultural heritage and modern media. By framing the two Monkey Kings as metaphors for tradition and innovation, the piece reflects the tension, conflict, and potential harmony between old and new forms of expression.
Rather than tracking the viewer’s body, the installation focuses on the puppets themselves. Viewers engage physically with the puppets, pulling them by hand, while a posture recognition system tracks their movements in real time. These gestures trigger dynamic digital projections that respond interactively, creating a performance space where physical craftsmanship and digital storytelling converge.
This project is not only a technical exploration but also a cultural inquiry. It poses the question: how can we preserve the symbolic depth of traditional stories while inviting new forms of audience engagement? By merging handmade art with motion capture and projection, this work transforms a familiar myth into an interactive visual experience, inviting reflection on identity, authenticity, and the evolving life of cultural forms in the digital age.
Photos
Project Logbook
Keywords: Shadow Puppetry, Cultural Heritage, Motion Recognition, Digital Storytelling, Immersive Environment
Copyright Statement
https://www.mixamo.com
https://mediapipe-studio.webapps.google.com/demo/gesture_recognizer?hl=…