Low-cost gaze and pulse analysis using realsense

Conference Paper

Intel's newly-Announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invari-ant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1 cm at 20-30 cm for the gaze tracker and 2:26 bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.

Full Text

Duke Authors

Cited Authors

  • Qiu, Q; Chang, Z; Draelos, M; Chen, J; Bronstein, A; Sapiro, G

Published Date

  • December 22, 2015

Published In

  • Mobihealth 2015 5th Eai International Conference on Wireless Mobile Communication and Healthcare Transforming Healthcare Through Innovations in Mobile and Wireless Technologies

International Standard Book Number 13 (ISBN-13)

  • 9781631900884

Digital Object Identifier (DOI)

  • 10.4108/eai.14-10-2015.2261657

Citation Source

  • Scopus