Gesture is one kind of message to body movement. The gesture-based technology detects various human beings’ gesture through image recognition technology and provides interactive feedback. The purpose of this study is to apply this technology in interactive learning system and in the concept of learning in “space installation” to make participants interact naturally in the systems and to allow users to immerse themselves in the learning system and to get the appropriate feedback from learning.

In this thesis, we used “Visual illusion artistic” and “Dunhuang running fresco” as the context of learning topics in our system. By using natural movements such as “walking” or “hand gestures”, we designed two interactive learning systems: “Walking through Dunhuang running fresco” and “Using hand movements to control optical illusions”. Integrating with the form of installation art and interactive media technology, the basic idea of the two systems is to conform to natural interaction essence. We hope that in the future the application in our systems can be used as a reference of digital artists and learning experts.