Penn State Emotion Modeling Research Project

The emotion modeling research project at Penn State has been conducted jointly by the College of Information Sciences and Technology (Prof. James Wang), the Department of Psychology (Profs. Reginald Adams, Jr. and Michelle Newman), and the Department of Statistics (Prof. Jia Li). The project was funded by the NSF from 2011 to 2017, the university from 2017 to 2019, Amazon from 2019 to 2020, and NSF from 2020 to 2021.

This page provides downloads for some of the datasets we created and used in our research. The original images are provided in a zip file to researchers needing the data to conduct relevant research. They cannot be directly downloaded from the site. Please email Dr. Wang (jwang at ist.psu.edu) to request if you are interested in any of the datasets.

Publication and Dataset for
Xin Lu, Reginald B. Adams, Jr., Jia Li, Michelle G. Newman and James Z. Wang, ``An Investigation into Three Visual Characteristics of Complex Scenes that Evoke Human Emotion,'' Proceedings of the International Conference on Affective Computing and Intelligent Interaction, pp. 440-447, San Antonio, Texas, October 2017.
Publication and Dataset for
Hanjoo Kim, Xin Lu, Michael Costa, Baris Kandemir, Reginald B. Adams, Jr., Jia Li, James Z. Wang and Michelle G. Newman, ``Development and Validation of Image Stimuli for Emotion Elicitation (ISEE): A Novel Affective Pictorial System with Test-Retest Repeatability,'' Psychiatry Research, vol. 261, pp. 414-420, Elsevier, 2018.
Publication and Dataset for
Jianbo Ye, Jia Li, Michelle G. Newman, Reginald B. Adams, Jr. and James Z. Wang, ``Probabilistic Multigraph Modeling for Improving the Quality of Crowdsourced Affective Data,'' IEEE Transactions on Affective Computing, vol. 10, no. 1, pp. 115-128, 2019.
Publication for
Yu Luo, Jianbo Ye, Reginald B. Adams, Jr., Jia Li, Michelle G. Newman and James Z. Wang, ``ARBEE: Towards Automated Recognition of Bodily Expression of Emotion In the Wild,'' International Journal of Computer Vision, 2019.