About this database

The Key Laboratory of Computing and Communication Software of Anhui Province(CCSL) has constructed the USTC-NVIE (Natural Visible and Infrared facial Expression) database under the sponsor of the 863 project.

To date, most facial expression analysis has been based on visible and posed expression databases. Visible images, however, are easily affected by illumination variations, while posed expressions differ in appearance and timing from natural ones. We propose and establish a natural visible and infrared facial expression database, which contains both spontaneous and posed expressions of more than 100 subjects, recorded simultaneously by a visible and an infrared thermal camera, with illumination provided from three different directions. The posed database also includes expression image sequences with and without glasses.

The papers about the database has been published by IEEE Transactions on Multimedia.


We sincerely welcome the USTC-NVIE database users to share their preprocessing data or tools to us (ustc704@gmail.com), and we will share them with the other users.


Update Information

    Released Version: V3.0 Released Date: 2012.11.19

Description: On the basis of Version 2.0, most of Visible and Infrared thermal samples in USTC-NVIE database have been successfully marked with several feature points with the help of Prof. Qiang Ji and Yue Wu from the Intelligent Systems Laboratory (ISL) of Rensselaer Polytechnic Institute.All these point data are released togther with our USTC-NVIE database. Several example images are shown below. We really appreciate Prof. Ji's supports and Yue Wu's efforts. We hope that these data will be helpful for your research.

(a) Visible Image with Glasses
(b) Visible Image Without Glasses
(c) Infrared Image with Glasses
(d) Infrared Image Without Glasses



    Released Version: V2.0 Released Date: 2011.11.01  

Description: On the basis of Version 1.0, two kinds of neutral expressional images are included for each subject in the Posed Facial Expression Database, one is the neutral frame with eyeglasses, the other is without eyeglasses. Both the infrared thermal image and the visible image are considered for each kind of neutral frame, and all these neutral frames are with the frontal lights. What's more, some information about the experiment subjects are provided in this version, including the gender information, eyeglasses wearing information, the root directory of the image or txt files and so on.


    Released Version: V 1.0 Released Date: 2010.9.01

Description: In this version of released databse, the spontaneous database includes images of 103 subjects under front illumination, 99 subjects under left illumination, and 103 subjects under right illumination, while 107 subjects are included in the posed database.


Related References

[1] Shangfei Wang, Zhilei Liu, Siliang Lv, Yanpeng Lv, Guobing Wu, Peng Peng, Fei Chen, Xufa Wang, A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference, IEEE Transactions on Multimedia, Vol. 12, No. 7, Page(s): 682-691, NOVEMBER 2010.

[1] Shangfei Wang, Zhilei Liu, Zhaoyu Wang, Guobing Wu, Peijia Shen, Shan He, Xufa Wang,Analyses of a Multimodal Spontaneous Facial Expression Database, IEEE Transactions on Affective Computing, Vol. 4, No. 1, Page(s): 34-46, April 2013.