Intel realsense = Real low cost gaze

Conference Paper

Intel's newly-announced low-cost RealSense 3D camera claims significantly better precision than other currently available low-cost platforms and is expected to become ubiquitous in laptops and mobile devices starting this year. In this paper, we demonstrate for the first time that the RealSense camera can be easily converted into a real low-cost gaze tracker. Gaze has become increasingly relevant as an input for human-computer interaction due to its association with attention. It is also critical in clinical mental health diagnosis. We present a novel 3D gaze and fixation tracker based on the eye surface geometry captured with the RealSense 3D camera. First, eye surface 3D point clouds are segmented to extract the pupil center and iris using registered infrared images. With non-ellipsoid eye surface and single fixation point assumptions, pupil centers and iris normal vectors are used to first estimate gaze (for each eye), and then a single fixation point for both eyes simultaneously using a RANSAC-based approach. With a simple learned bias field correction model, the fixation tracker demonstrates mean error of approximately 1 cm at 20-30 cm, which is sufficiently adequate for gaze and fixation tracking in human-computer interaction and mental health diagnosis applications.

Full Text

Duke Authors

Cited Authors

  • Draelos, M; Qiu, Q; Bronstein, A; Sapiro, G

Published Date

  • December 9, 2015

Published In

Volume / Issue

  • 2015-December /

Start / End Page

  • 2520 - 2524

International Standard Serial Number (ISSN)

  • 1522-4880

International Standard Book Number 13 (ISBN-13)

  • 9781479983391

Digital Object Identifier (DOI)

  • 10.1109/ICIP.2015.7351256

Citation Source

  • Scopus