Abstract—This paper presents a new physically-based 3D facial model based on anatomical knowledge which provides high fidelity for facial expression animation while optimizing the computation. Our facial model has a multilayer biomechanical structure, incorporating a physically-based approximation to facial skin tissue, a set of anatomically-motivated facial muscle actuators, and underlying skull structure. In contrast to existing mass-spring-damper (MSD) facial models, our dynamic skin model uses the nonlinear springs to directly simulate the nonlinear visco-elastic behavior of soft tissue and a new kind of edge repulsion spring is developed to prevent collapse of the skin model. Different types of muscle models have been developed to simulate distribution of the muscle force applied on the skin due to muscle contraction. The presence of the skull advantageously constrain the skin movements, resulting in more accurate facial deformation and also guides the interactive placement of facial muscles. The governing dynamics are computed using a local semi-implicit ODE solver. In the dynamic simulation, an adaptive refinement automatically adapts the local resolution at which potential inaccuracies are detected depending on local deformation. The method, in effect, ensures the required speedup by concentrating computational time only where needed while ensuring realistic behavior within a predefined error threshold. This mechanism allows more pleasing animation results to be produced at a reduced computational cost.
1. K.-J. Bathe, Finite Element Procedures in Engineering Analysis. Prentice Hall, 1982.
2. V. Blanz, and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. SIGGRAPH '99, vol. 33, pp. 187-194, Aug. 1999.
3. M. Bro-Nielsen, and S. Cotin, "Real-Time Volumetric Deformable Models for Surgery Simulation Using Finite Elements
and Condensation," Proc. EUROGRAPHICS '96, vol. 15, pp. 57-66, Aug. 1996.
4. E. Catmull, and J. Clark, "Recursively Generated B-Spline Surfaces on Arbitrary Topological Meshes," Computer Aided Design, vol. 10, no. 6, pp. 350-355, 1978.
5. S. Cotin, H. Delingette, and N. Ayache, "Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation," IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 1, pp. 62-73, Jan.-Mar. 1999.
6. G. Debunne, M. Desbrun, A. Barr, and M.-P. Cani, "Interactive Multiresolution Animation of Deformable Models," Proc. 10th Eurographics Workshop Computer Animation and Simulation, pp. 133-144, 1999.
7. G. Debunne, M. Desbrun, M.-P. Cani, and A. Barr, "Adaptive Simulation of Soft Bodies in Real-Time," Proc. Computer Animation, pp. 15-20, 2000.
8. D. DeCarlo, D. Metaxas, and M. Stone, "An Anthropometric Face Model Using Variational Techniques," Proc. SIGGRAPH '98, vol. 32, pp. 67-74, July 1998.
9. T. DeRose, M. Kass, and T. Truong, "Subdivision Surfaces in Character Animation," Proc. SIGGRAPH '98, vol. 32, pp. 85-94, July 1998.
10. S. DiPaola, "Extending the Range of Facial Types," J. Visualization and Computer Animation, vol. 2, no. 4, pp. 129-131, 1991.
11. D. Doo, and M. Sabin, "Behaviour of Recursive Division Surfaces Near Extraordinary Points," Computer Aided Design, vol. 10, no. 6, pp. 356-360, 1978.
12. P. Ekman, and W.V. Friesen, Facial Action Coding System. Palo Alto, Calif.: Consulting Psychologists Press Inc., 1978.
13. I. Essa, and S. Basu, "Modeling, Tracking and Interactive Animation of Facial Expressions and Head Movements
Using Input from Video," Proc. Computer Animation '96, pp. 68-79, June 1996.
14. D.R. Forsey, and R. H. Bartels, "Hierarchical B-Spline Refinement," Proc. SIGGRAPH '88, vol. 22, pp. 205-212, Aug. 1988.
15. Y. Fung, Biomechanics: Mechanical Properties of Living Tissues. Springer Verlag, 1993.
16. F. Ganovelli, P. Cignoni, C. Montani, and R. Scopigno, "A Multiresolution Model for Soft Objects Supporting Interactive Cuts and Lacerations," Proc. EUROGRAPHICS 2000, pp. 271-282, 2000.
17. J.D. Gascuel, M.P. Cani, M. Desbrun, E. Leroy, and C. Mirgon, "Simulating Landslides for Natural Disaster Prevention," Proc. Ninth Eurographics Workshop Computer Animation and Simulation, pp. 1-12, Sept. 1998.
18. T. Goto, M. Escher, C. Zanardi, N. Magnenat-Thalmann, "MPEG-4 Based Animation with Face Feature Tracking," Proc. Erographics Workshop Computer Animation and Simulation '99, pp. 89-98, 1999.
19. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin, "Making Faces," Proc. SIGGRAPH '98, vol. 32, pp. 55-66, July 1998.
20. P. Kalra, A. Mangili, N. Magnenat-Thalmann, and D. Thalmann, "Simulation of Facial Muscle Actions Based on Rational Free Form Deformations," Proc. EUROGRAPHICS '92, pp. 59-69, 1992.
21. L. Kobbelt, S. Campagna, J. Vorsatz, and H.P. Seidel, "Interactive Multiresolution Modeling of Arbitrary Meshes," Proc. SIGGRAPH '98, vol. 32, pp. 105-114, July 1998.
22. L. Kobbelt, T. Bareuther, and H.P. Seidel, "Multi-Resolution Shape Deformations for Meshes with Dynamic Vertex Connectivity," Proc. EUROGRAPHICS 2000, Computer Graphics Forum, vol. 19,
no. 3 pp. 249-260, 2000.
23. R. Koch, M. Gross, F. Carls, D. Buren, G. Fankhauser, and Y. Parish, "Simulating Facial Surgery Using Finite Element Models," Proc. SIGGRAPH '96, vol. 30, pp. 421-428, Aug. 1996.
24. R.M. Koch, M.H. Gross, and A.A. Bosshard, "Emotion Editing Using Finite Elements," Proc. EUROGRAPHICS '98, Computer Graphics Forum, vol. 17, no. 3, pp. 295-302, 1998.
25. S. Kshirsagar, T. Molet, and N. Magnenat-Thalmann, "Principal Components of Expressive Speech Animation," Proc. Computer Graphics Int'l 2001, pp. 38-44, July 2001.
26. Y. Lee, D. Terzopoulis, and K. Waters, "Realistic Modeling for Facial Animation," Proc. SIGGRAPH '95, vol. 29, pp. 55-62, Aug. 1995.
27. C. Loop, "Smooth Subdivision Surfaces Based on Triangles," master's thesis, Univ. of Utah, 1987.
28. P. Meseure, and C. Chaillou, "Deformable Body Simulation with Adaptive Subdivision and Cuttings," Proc. Inte'l Conf. in Central Europe Computer Graphics, Visualization and Computer
Vision (WSCG '97), pp. 361-370, 1997.
29. M. Nahas, H. Huitric, and M. Saintourens, "Animation of a B-Spline Figure," The Visual Computer, vol. 3, no. 5, pp. 272-276, Mar. 1988.
30. J. O'Brien, and J. Hodgins, "Graphical Models and Animation of Brittle Fracture," Proc. SIGGRAPH '99, vol. 33, pp. 137-146, Aug. 1999.
31. J. Ostermann, "Animation of Synthetic Faces in MPEG-4," Proc. Computer Animation '98, pp. 49-55, 1998.
32. D.J. Ostry, E. Vatikiotis-Bateson, and P.L. Gribble, "An Examination of the Degrees of Freedom of Human Jaw Motion in Speech and Mastication," J. Speech, Language, and Hearing Research, vol. 40, pp. 1341-1351, 1997.
33. F.I. Parke, "Computer Generated Animation of Faces," master's thesis, Univ. of Utah, Salt Lake City, June 1972.
34. F.I. Parke, "Parameterized Models for Facial Animation," IEEE Computer Graphics and Applications, vol. 2, no. 4, pp. 61-68, Nov. 1982.
35. F.I. Parke, and K. Waters, Computer Facial Animation. Wellesley, Mass.: AK Peters, 1996.
36. L. Piegl, and W. Tiller, The NURBS Book, second ed. Springer-Verlag, 1997.
37. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin, "Synthesizing Realistic Facial Expressions from Photographs," Proc. SIGGRAPH '98, vol. 32, pp. 75-84, July 1998.
38. S. Platt, and N. Badler, "Animating Facial Expressions," Proc. SIGGRAPH '81, vol. 15, pp. 245-252, 1981.
39. H. Tao, and T.S. Huang, " Facial Animation and Video Tracking," Proc. Int'l Workshop Modeling and Motion Capture Techniques for Virtual Environments
(CAPTECH '98), pp. 242-253, 1998.
40. D. Terzopoulus, and K. Waters, "Physically-Based Facial Modeling, Analysis and Animation," J. Visualization and Computer Animation, vol. 1, pp. 73-80, 1990.
41. N. Magnenat-Thalmann, H. Minh, M. deAngelis, and D. Thalmann, "Design, Transformation and Animation of Human Faces," The Visual Computer, vol. 5, pp. 32-39, 1989.
42. P. Volino, and N. Magnenat-Thalmann, "The SPHERIGON: A Simple Polygon Patch for Smoothing Quickly Your Polygonal Meshes," Proc. Computer Animation '98, pp. 72-79, 1998.
43. C.L.Y. Wang, and D.R. Forsey, "Langwidere: A New Facial Animation System," Proc. Computer Animation '94, pp. 59-68, 1994.
44. K. Waters, "A Muscle Model for Animating Three-Dimensional Facial Expression," Proc. SIGGRAPH '87, vol. 21, pp. 17-24, July 1987.
45. P.L. Williams, R. Warwick, M. Dyson, and L.H. Bannister, Gray's Anatomy, 37th ed. London: Churchill Livingstone, 1989.
46. L. Williams, "Performance-Driven Facial Animation," Proc. SIGGRAPH '90, vol. 24, pp. 235-242, Aug. 1990.
47. Y. Wu, N.M. Thalmann, and D. Thalmann, "A Dynamic Wrinkle Model in Facial Animation and Skin Aging," J. Visualization and Computer Animation, vol. 6, pp. 195-202, 1998.
48. Y. Zhang, E.C. Prakash, and E. Sung, "Animation of Facial Expressions by Physical Modeling," Proc. EUROGRAPHICS 2001, short presentations, pp. 335-345, 2001.
49. D. Zorin, P. Schroder, and W. Sweldens, "Interpolating Subdivision for Meshes with Arbitrary Topology," Proc. SIGGRAPH '96, vol. 30, pp. 189-192, Aug. 1996.