Real-time Muscle-based Facial Animation using Shell Elements and Force Decomposition

Jungmin Kim, Min Gyu Choi, Young J. Kim

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a novel algorithm for physics-based real-time facial animation driven by muscle deformation. Unlike the previous works using 3D finite elements, we use a 2D shell element to avoid inefficient or undesired tessellation due to the thin structure of facial muscles. To simplify the analysis and achieve real-time performance, we adopt real-time thin shell simulation of [Choi et al. 2007]. Our facial system is composed of four layers of skin, subcutaneous layer, muscles, and skull, based on human facial anatomy. Skin and muscles are composed of shell elements, subcutaneous fatty tissue is assumed as a uniform elastic body, and the fixed part of facial muscles is handled by static position constraint. We control muscles to have stretch deformation using modal analysis and apply mass-spring force to skin mesh which is triggered by the muscle deformation. In our system, only the region of interest for skin can be affected by the muscle. To handle the coupled result of facial animation, we decouple the system according to the type of external forces applied to the skin. We show a series of real-time facial animation caused by selected major muscles that are relevant to expressive skin deformation. Our system has generality for importing new types of muscles and skin mesh when their shape or positions are changed.

Original languageEnglish
Title of host publicationProceedings - I3D 2020
Subtitle of host publicationACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450375894
DOIs
StatePublished - 5 May 2020
Event2020 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2020 - San Francisco, United States
Duration: 15 Sep 202017 Sep 2020

Publication series

NameProceedings - I3D 2020: ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Conference

Conference2020 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2020
Country/TerritoryUnited States
CitySan Francisco
Period15/09/2017/09/20

Keywords

  • anatomical models
  • Facial animation
  • physics-based simulation

Fingerprint

Dive into the research topics of 'Real-time Muscle-based Facial Animation using Shell Elements and Force Decomposition'. Together they form a unique fingerprint.

Cite this