Interactive E-Learning System Using Pattern Recognition and Augmented Reality Sang Hwa Lee, Junyeong Choi, and Jong-Il Park, Member, IEEE 報告者：謝宏偉

大綱 前言 研究目的 研究方法 結果

前言 This paper proposes an interactive e-learning system using pattern recognition and augmented reality. The proposed e-learning system augments the audio-visual contents as the students interact with the objects in the textbook.

研究目的 The proposed e-learning system consists of image/object recognition, polka-dot pattern recognition, color-band marker recognition, augmented reality engine, audio-visual contents, and some learning scenarios of textbooks. The scenarios combine the educational contents with information technologies to maximize the learning efficiency. And the augmented reality engine realizes the scenarios.

研究目的

研究方法 We design two markers using polka-dot pattern or color-band. The markers are put on the fingers as bands, and act like the computer mouse. The markers indicate their locations in the video frame, which enables the students to interact according to the objects in the textbook.

研究方法 1. Polka-dot Pattern Recognition We exploit the polka-dot marker for interactive augmentation of contents and menu selection.

研究方法 2. Color-band Recognition Some interactions in the educational scenarios require two or more markers simultaneously to manipulate multiple objects. Since the polka-dot patterns have little distinct difference between them, it is difficult to operate the multiple markers independently.

研究方法

3. RECOGNITION OF IMAGE AND OBJECT Image recognition is designed for identification of current text page or objects. When the text page or objects are identified, the related audio-visual contents are automatically played on the PC.

研究方法 A.Feature Extraction In the scale space structure, the point at x and σ is the distinct feature point, if the determinant value is largest in the 26 neighbors.

研究方法 B. Feature Matching RANSAC 匹配除錯

研究方法 C. Image and Object Recognition

研究方法

結果

This interactive augment reality made the students have more interest in learning. Therefore, the proposed e-leaning system not only provides with audio-visual contents, but also improves the learning efficiency and concentration of students.

謝謝聆聽 !