Skip to main content
Journal cover image

Highly efficient facial blendshape animation with analytical dynamic deformations

Publication ,  Journal Article
You, X; Tian, F; Tang, W
Published in: Multimedia Tools and Applications
September 30, 2019

Adding physics to facial blendshape animation is an active research topic. Existing physics-based approaches of facial blendshape animation are numerical, so they require special knowledge and skills, additional preprocess, large computer capacity, and expensive calculations leading to low animation frame rates, and are not easy to learn, implement and use. To tackle these problems, we propose an analytical approach and develop a blending force-based framework for physics-based facial animation. The proposed approach introduces the equation of motion to consider inertial effects, damping effects and the resistance against deformations, combines them with source and target facial shapes to formulate the mathematical model of dynamic deformations, and develops a simple and efficient closed-form solution. The blending force-based framework incorporates the new proposed slider force-based, exponentiation force-based and random force-based methods built on the obtained closed form solution to achieve highly efficient facial animation. Compared with facial blendshape animation using geometric linear interpolation, the proposed approach is physics-based. It not only creates all the blended shapes generated by linear interpolation, but also a much larger superset of blended shapes. Unlike linear interpolation which can only generate blended shapes with a same deformation rate, the proposed approach can generate blended shapes with different deformation rates, resulting in special effects of acceleration and deceleration. Compared to existing physics-based approaches of facial blendshape animation which are numerical, the proposed approach is the first time to develop an analytical approach of physics-based facial blendshapes. It does not require any special knowledge and skills and is easy to learn, implement and use. More importantly, it can avoid the additional preprocess of numerical methods and create various physics-based facial blendshape animations highly efficiently. Moreover, it can be used to estimate physical parameters from real shapes and developed into an interactive and real-time physics-based shape manipulation tool.

Duke Scholars

Published In

Multimedia Tools and Applications

DOI

EISSN

1573-7721

ISSN

1380-7501

Publication Date

September 30, 2019

Volume

78

Issue

18

Start / End Page

25569 / 25590

Related Subject Headings

  • Software Engineering
  • Artificial Intelligence & Image Processing
  • 4606 Distributed computing and systems software
  • 4605 Data management and data science
  • 4603 Computer vision and multimedia computation
  • 4009 Electronics, sensors and digital hardware
  • 0806 Information Systems
  • 0805 Distributed Computing
  • 0803 Computer Software
  • 0801 Artificial Intelligence and Image Processing
 

Citation

APA
Chicago
ICMJE
MLA
NLM
You, X., Tian, F., & Tang, W. (2019). Highly efficient facial blendshape animation with analytical dynamic deformations. Multimedia Tools and Applications, 78(18), 25569–25590. https://doi.org/10.1007/s11042-019-7671-8
You, X., F. Tian, and W. Tang. “Highly efficient facial blendshape animation with analytical dynamic deformations.” Multimedia Tools and Applications 78, no. 18 (September 30, 2019): 25569–90. https://doi.org/10.1007/s11042-019-7671-8.
You X, Tian F, Tang W. Highly efficient facial blendshape animation with analytical dynamic deformations. Multimedia Tools and Applications. 2019 Sep 30;78(18):25569–90.
You, X., et al. “Highly efficient facial blendshape animation with analytical dynamic deformations.” Multimedia Tools and Applications, vol. 78, no. 18, Sept. 2019, pp. 25569–90. Scopus, doi:10.1007/s11042-019-7671-8.
You X, Tian F, Tang W. Highly efficient facial blendshape animation with analytical dynamic deformations. Multimedia Tools and Applications. 2019 Sep 30;78(18):25569–25590.
Journal cover image

Published In

Multimedia Tools and Applications

DOI

EISSN

1573-7721

ISSN

1380-7501

Publication Date

September 30, 2019

Volume

78

Issue

18

Start / End Page

25569 / 25590

Related Subject Headings

  • Software Engineering
  • Artificial Intelligence & Image Processing
  • 4606 Distributed computing and systems software
  • 4605 Data management and data science
  • 4603 Computer vision and multimedia computation
  • 4009 Electronics, sensors and digital hardware
  • 0806 Information Systems
  • 0805 Distributed Computing
  • 0803 Computer Software
  • 0801 Artificial Intelligence and Image Processing