Facial Expression Analysis - Robotics Institute Carnegie Mellon University
Graphical depiction of the Facial Expression Analysis project
Facial Expression Analysis
Project Head: Jeffrey Cohn

Facial expression provides cues about emotion, regulates interpersonal behavior, and communicates psychopathology. Human-observer based methods for measuring facial expression are labor intensive, qualitative, and difficult to standardize across laboratories, clinical settings, and over time. To make feasible more rigorous, quantitative measurement of facial expression in diverse applications, computer and behavioral scientists at Carnegie Mellon University and the University of Pittsburgh formed an interdisciplinary research team. The team has developed the CMU/Pitt Automated Facial Image Analysis (AFA) system that is capable of automatically recognizing facial action units, analyzing their timing in facial behavior, and rendering real-time photorealistic avatars.

Current efforts use AFA to enable reliable, valid, and efficient measurement of emotion expression, assess symptom severity in depression and physical pain, and investigate human social dynamics. To meet these goals, we pursue basic research to further improve algorithms and capabilities of the AFA system.

Displaying 64 Publications

2017
Journal Article, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 3, pp. 529 - 545, March, 2017
2015
Kaili Zhao, Wen-Sheng Chu, Fernando De la Torre Frade, Jeffrey Cohn, and Honggang Zhang
Conference Paper, Proceedings of (CVPR) Computer Vision and Pattern Recognition, pp. 2207 - 2216, June, 2015
2013
Conference Paper, Proceedings of (ICCV) International Conference on Computer Vision, pp. 2400 - 2407, December, 2013
Conference Paper, Proceedings of (CVPR) Computer Vision and Pattern Recognition, pp. 3515 - 3522, June, 2013
2009
Jason M. Saragih, Simon Lucey, and Jeffrey Cohn
Conference Paper, Proceedings of (ICCV) International Conference on Computer Vision, pp. 1034 - 1041, September, 2009
Jason M. Saragih, Simon Lucey, and Jeffrey Cohn
Tech. Report, CMU-RI-TR-09-15, Robotics Institute, Carnegie Mellon University, May, 2009
2008
Krishnan Ramnath, Seth C. Koterba, J. Xiao, C. Hu, Iain Matthews, Simon Baker, Jeffrey Cohn, and Takeo Kanade
Journal Article, International Journal of Computer Vision, Vol. 76, No. 2, pp. 183 - 204, February, 2008
2007
B. Theobald, Iain Matthews, Jeffrey Cohn, and S. Boker
Conference Paper, Proceedings of 9th International Conference on Multimodal Interfaces (ICMI '07), pp. 134 - 139, November, 2007
A. B. Ashraf, Simon Lucey, T. Chen, K. Prkachin, P. Solomon, Zara Ambadar, and Jeffrey Cohn
Conference Paper, Proceedings of 9th International Conference on Multimodal Interfaces (ICMI '07), pp. 9 - 14, November, 2007
Jose Gonzalez-Mora, Fernando De la Torre Frade, Rajesh Murthi, Nicolas Guil Mata, and E. Zapata
Workshop Paper, ICCV '07 Workshop on Non-rigid Registration and Tracking through Learning, October, 2007

current head

current contact

past staff

  • Zara Ambadar
  • Simon Baker
  • Jiang Gao
  • Changbo Hu
  • Wei Hua
  • Jenn-Jier James Lien
  • Tsuyoshi Moriyama
  • Lawrence Ian Reed
  • Jason M Saragih
  • Karen Schmidt
  • Ying-Li Tian
  • Yu-Te Wu
  • Adena Zlochower