Augmenting VR/AR applications with EEG/EOG monitoring and oculo-vestibular recoupling


Conference Paper

© Springer International Publishing Switzerland 2016. Head-mounted virtual reality and augmented reality displays (a.k.a. VR/AR goggles) created a revolutionary multimedia genre that is seeking ever-broadening applications and novel natural human interfaces. Adding neuromonitoring and neurofeedback to this genre is expected to introduce a new dimension to user interaction with the cyber-world. This study presents the development of a Neuromonitoring VR/AR Goggle armed with electroencephalo- gram and electrooculogram sensors, programmable milli-Ampere current stimulators and wireless fog/cloud computing support. Beside of its potential use in mitigating cybersickness, this device may have potential applications in augmented cognition ranging from feedback-controlled perceptual training to on-line learning and virtual social interactions. A prototype of the device has been made from a Samsung Gear VR for S6. This study explains its technical design to ensure precision data sampling, synchronous event marking, real-time signal processing and big data cloud computing support. This study also demonstrates the effective-ness in measuring the event-related potentials during a visual oddball experiment.

Full Text

Duke Authors

Cited Authors

  • Zao, JK; Jung, TP; Chang, HM; Gan, TT; Wang, YT; Lin, YP; Liu, WH; Zheng, GY; Lin, CK; Lin, CH; Chien, YY; Lin, FC; Huang, YP; Méndez, SJR; Medeiros, FA

Published Date

  • January 1, 2016

Published In

Volume / Issue

  • 9743 /

Start / End Page

  • 121 - 131

Electronic International Standard Serial Number (EISSN)

  • 1611-3349

International Standard Serial Number (ISSN)

  • 0302-9743

International Standard Book Number 13 (ISBN-13)

  • 9783319399546

Digital Object Identifier (DOI)

  • 10.1007/978-3-319-39955-3_12

Citation Source

  • Scopus