Home    精品项目    Interactive learning system based on Augmented Reality and gesture recognition

Interactive learning system based on Augmented Reality and gesture recognition

Interactive learning system based on Augmented Reality and gesture recognition

 

Overview

Because of the abstraction of celestial movement, magnetic lines of force, microscopic particle structure, and medicine, it is impossible to intuitively understand the content of the textbook through textbook images and texts, which will inevitably reduce students’ interest in learning. We combined Augmented Reality (AR) technology and gesture recognition on the platform of Xilinx ZYNQ-7020. Firstly, for the purpose of making the book content become “active” and “alive”, the AR technology integrated multiple elements such as sound, animation, and interactive modules on the APP and PC. Then, we built a mobile control platform on ZYNQ-7020, allowing the users to connect to APP or PC through Bluetooth or WIFI. Besides, we designed a camera model attached to the control system to perform gesture recognition, which allows users to operate the AR model to move, zoom, rotate, combine, etc., and that makes the learning process become more interactive and funny.

 

 

System Architecture

39

Fig 1. The architecture of our system

 

40

Fig 2. The architecture of the Programmable Logic

41

Fig 3. The architecture of the Processor System

 

 

 

创建时间:2018-09-19 17:37
点赞
浏览量:0