Skip to main content

Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder.

Publication ,  Journal Article
Babu, PRK; Di Martino, JM; Chang, Z; Perochon, S; Carpenter, KLH; Compton, S; Espinosa, S; Dawson, G; Sapiro, G
Published in: IEEE Trans Affect Comput
2023

Atypical facial expression is one of the early symptoms of autism spectrum disorder (ASD) characterized by reduced regularity and lack of coordination of facial movements. Automatic quantification of these behaviors can offer novel biomarkers for screening, diagnosis, and treatment monitoring of ASD. In this work, 40 toddlers with ASD and 396 typically developing toddlers were shown developmentally-appropriate and engaging movies presented on a smart tablet during a well-child pediatric visit. The movies consisted of social and non-social dynamic scenes designed to evoke certain behavioral and affective responses. The front-facing camera of the tablet was used to capture the toddlers' face. Facial landmarks' dynamics were then automatically computed using computer vision algorithms. Subsequently, the complexity of the landmarks' dynamics was estimated for the eyebrows and mouth regions using multiscale entropy. Compared to typically developing toddlers, toddlers with ASD showed higher complexity (i.e., less predictability) in these landmarks' dynamics. This complexity in facial dynamics contained novel information not captured by traditional facial affect analyses. These results suggest that computer vision analysis of facial landmark movements is a promising approach for detecting and quantifying early behavioral symptoms associated with ASD.

Duke Scholars

Published In

IEEE Trans Affect Comput

DOI

ISSN

1949-3045

Publication Date

2023

Volume

14

Issue

2

Start / End Page

919 / 930

Location

United States

Related Subject Headings

  • 4608 Human-centred computing
  • 4603 Computer vision and multimedia computation
  • 4602 Artificial intelligence
  • 1702 Cognitive Sciences
  • 0806 Information Systems
  • 0801 Artificial Intelligence and Image Processing
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Babu, P. R. K., Di Martino, J. M., Chang, Z., Perochon, S., Carpenter, K. L. H., Compton, S., … Sapiro, G. (2023). Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder. IEEE Trans Affect Comput, 14(2), 919–930. https://doi.org/10.1109/taffc.2021.3113876
Babu, Pradeep Raj Krishnappa, J Matias Di Martino, Zhuoqing Chang, Sam Perochon, Kimberly L. H. Carpenter, Scott Compton, Steven Espinosa, Geraldine Dawson, and Guillermo Sapiro. “Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder.IEEE Trans Affect Comput 14, no. 2 (2023): 919–30. https://doi.org/10.1109/taffc.2021.3113876.
Babu PRK, Di Martino JM, Chang Z, Perochon S, Carpenter KLH, Compton S, et al. Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder. IEEE Trans Affect Comput. 2023;14(2):919–30.
Babu, Pradeep Raj Krishnappa, et al. “Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder.IEEE Trans Affect Comput, vol. 14, no. 2, 2023, pp. 919–30. Pubmed, doi:10.1109/taffc.2021.3113876.
Babu PRK, Di Martino JM, Chang Z, Perochon S, Carpenter KLH, Compton S, Espinosa S, Dawson G, Sapiro G. Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder. IEEE Trans Affect Comput. 2023;14(2):919–930.

Published In

IEEE Trans Affect Comput

DOI

ISSN

1949-3045

Publication Date

2023

Volume

14

Issue

2

Start / End Page

919 / 930

Location

United States

Related Subject Headings

  • 4608 Human-centred computing
  • 4603 Computer vision and multimedia computation
  • 4602 Artificial intelligence
  • 1702 Cognitive Sciences
  • 0806 Information Systems
  • 0801 Artificial Intelligence and Image Processing