Skip to main content

Salgaze: Personalizing gaze estimation using visual saliency

Publication ,  Journal Article
Chang, Z; DI Martino, JM; Qiu, Q; Espinosa, S; Sapiro, G
Published in: Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
October 1, 2019

Traditional gaze estimation methods typically require explicit user calibration to achieve high accuracy. This process is cumbersome and recalibration is often required when there are changes in factors such as illumination and pose. To address this challenge, we introduce SalGaze, a framework that utilizes saliency information in the visual content to transparently adapt the gaze estimation algorithm to the user without explicit user calibration. We design an algorithm to transform a saliency map into a differentiable loss map that can be used for the optimization of CNN-based models. SalGaze is also able to greatly augment standard point calibration data with implicit video saliency calibration data using a unified framework. We show accuracy improvements over 24% using our technique on existing methods.

Duke Scholars

Published In

Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

DOI

Publication Date

October 1, 2019

Start / End Page

1169 / 1178
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chang, Z., DI Martino, J. M., Qiu, Q., Espinosa, S., & Sapiro, G. (2019). Salgaze: Personalizing gaze estimation using visual saliency. Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, 1169–1178. https://doi.org/10.1109/ICCVW.2019.00148
Chang, Z., J. M. DI Martino, Q. Qiu, S. Espinosa, and G. Sapiro. “Salgaze: Personalizing gaze estimation using visual saliency.” Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, October 1, 2019, 1169–78. https://doi.org/10.1109/ICCVW.2019.00148.
Chang Z, DI Martino JM, Qiu Q, Espinosa S, Sapiro G. Salgaze: Personalizing gaze estimation using visual saliency. Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019. 2019 Oct 1;1169–78.
Chang, Z., et al. “Salgaze: Personalizing gaze estimation using visual saliency.” Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, Oct. 2019, pp. 1169–78. Scopus, doi:10.1109/ICCVW.2019.00148.
Chang Z, DI Martino JM, Qiu Q, Espinosa S, Sapiro G. Salgaze: Personalizing gaze estimation using visual saliency. Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019. 2019 Oct 1;1169–1178.

Published In

Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

DOI

Publication Date

October 1, 2019

Start / End Page

1169 / 1178