Motion capture technology have been fundamentally and popularly used in interactive artworks. For motion capture technology, evolving from works integrating physical touch sensors to contactless sensor interactions, interactive art now emphasizes using naturally interactive interfaces, which allow the participants to naturally use their bodys'' motion to engage with the artwork. This thesis discusses“Kinect motion capture technology for text and language cognition” based on two pieces of artwork: “Make ''Heart''” and “Hesitation in Translation”. The purposes of the artworks focus on the advantages of human natural interactive motion.
The first artwork, “Make ''Heart''”, is an interactive artwork through Chinese traditional hieroglyphs and human body action. It is based on our perception of space and body motion sensory and the words are wiewed as biomimetics. When the participants squat down and interact with the words projected on the floor, the words start to change shape. Through this deform, the causes and effects of the process begin to resonate with the participants.
The second artwork, “Hesitation in Translation”, explores the hesitation when people get through the reasoning of the translation into different languages in Chinese poets. The artwork asks the participants to translate Chinese poets from Mandarin into Taiwanese, and speak out. The goal of the artwork is to let participants to realize and comprehend the beauty of the reality in hesitation when they learn the result from other people interacting with the artwork. The artwork dissociates the expressions from the translation and presents them separately to represent the instability of the thought processes associated with translation. The artwork is detected and recorded by Kinec. It records the reactions of participants who speak Taiwanese for the Chinese poets. This work is presented by performance video art.
This thesis aims to use these two artworks to bring a new level of interactive experience to its participants. By using existing technology in creative ways, it make people use the most natural action to interact with the artworks.