Stroke E.R. DiagnosisA.I. Non-verbal Communication
Research interests: computability of emotions, human-AI interaction, big data, biomedical informatics, visual arts, ...
In the PressNSF delegationUS Embassy, Beijing
The mission of our group is to advance knowledge related to the
analysis, management, and making sense of large and complex visual
data, and to contribute to the society through dissemination of
research findings and education of future leaders in this field.
The group has published two monographs and about 60 journal
articles
(Google
Scholar profile). Notable technologies developed by the group
include the SIMPLIcity image retrieval
engine (at Stanford), the ALIPR real-time automatic image annotation
system, the Acquine aesthetic quality inference engine, evoked emotion
prediction system, and the brushstroke style analysis methods for oil
paintings.
Ph.D. Study and Undergraduate Research:
Past Ph.D. students of the group have taken tenure-track
faculty and research scientist positions, right after graduation. In
the summers, graduate students have participated in internships at
Adobe Research, Amazon Lab126, Apple, AT&T Labs, Bytedance AI Lab, DeepMap.AI,
Facebook, Google Research, HP Labs, IBM Research, IDIAP Switzerland,
Kodak Research, MathWorks, Merck Research, NEC Research, PNC, Siemens
Research, SONY Research, Telefonica R&D Barcelona, Toutiao, Twitter,
Verisk Analytics, Xerox PARC, Yahoo!, and 12Sigma, among
others. Undergraduate research students have pursued graduate study at
Brown University, Carnegie Mellon University, Cornell University,
Johns Hopkins University, Tufts University,
University of Cambridge, and University of
Pennsylvania, among others. The group welcomes talented and motivated
graduate and undergraduate students with strong computational and
mathematical/statistical skills. Apply to join the group as a PhD
student here.
Dr. Wang has been on Penn State faculty since 2000, where he is Professor of the College of Information Sciences and Technology. He is also Affiliated Professor of the Molecular, Cellular, and Integrative Biosciences (MCIBS) Program (Option on Bioinformatics and Genomics, the Huck Institutes of the Life Sciences). He serves as the founding Co-Director of the Intelligent Information Systems Laboratory (2001-). He has served as the lead guest editor of IEEE Trans. on Pattern Analysis and Machine Intelligence Special Section on Real-world Image Annotation and Retrieval (2008), an Associate Editor of IEEE Transactions on Multimedia (2009-2011), and an invited speaker at more than 70 institutions. He was a Visiting Professor of Robotics at Carnegie Mellon University (2007-2008) and a Program Manager in the Office of the National Science Foundation Director (2011 and 2012). These other sites [personal; g-scholar; wiki; math genealogy; FAQ] have more information.
Other pictures: 4/2000 Stanford, 9/2007, 4/2010 State College, 9/2010, 12/2013, 12/2014, 12/2015, 12/2017, 12/2019, 9/2020
![]() |
TBA (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2021 Thesis: Committee: to be formed |
![]() |
Sitao Zhang sitao.zhang (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2020 Thesis: Committee: to be formed |
![]() |
Lizhen Zhu ljz5180 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2020 Thesis: Committee: to be formed |
![]() |
Benjamin Wortman bvw5146 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2020 Thesis: Committee: to be formed |
![]() |
Tongan Cai cta (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2019 Thesis: Committee: to be formed |
![]() |
Dolzodmaa Davaasuren dud240 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2019 Thesis: Committee: James Z. Wang (Chair), Sharon Huang, Justin Silverman, Alison Gernand |
![]() |
Chenyan Wu czw390 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2018 Thesis: Committee: James Z. Wang (Chair), Sharon Huang, Zihan Zhou, Alison Gernand |
![]() |
Zhuomin Zhang zxz78 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2016 Thesis: Segmentation for Bio-medical Images and Meteorological Image Synthesis based on Wasserstein Barycenter Committee: James Z. Wang (Chair), Jia Li (Co-Chair), Sharon Huang, Suhang Wang, Fuqing Zhang (past) |
Graduating doctoral advisees are listed under the Alumni tab (above). |
Li Yu, Informatics, Penn State, since 2019
Thomas Foltz, Computer Engineering, Schreyer Honors College, 2021.
Parker Sell, Data Sciences (Computational), First-year Undergraduate Research Program (FURP), Schreyer Honors College, 2021.
Victoria Lim, Mathematics, 2020.
John Zhuang, Cybersecurity, Schreyer Honors College, 2019.
Katelinh G. Jones, Data Sciences (Applied), Millennium Scholars Program, 2019.
Erica Mi, Information Sciences and Technology, Schreyer Honors College, 2019.
Sophie Lelei, Data Sciences (Statistical), Millennium Scholars Program, 2019.
(Not all undergraduate research students are listed here.)
Our research has been primarily supported by the US National Science Foundation. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.
We are also supported by Amazon.com, Inc. and the National Endowment for the Humanities.
Our college and other units at Penn State have been very supportive of our work. Our work uses the Extreme Science and Engineering Discovery Environment (XSEDE), which is supported by the NSF.
![]() |
![]() |
![]() |
![]() |
17. Farshid Farhat (defended but not yet graduated), with Dexerity, Inc. (g-scholar) farshid.farhat (at) gmail.com , fuf111 (at) psu.edu Ph.D. Program in Computer Science and Engineering, Penn State, since 2012 (with the group since Jan. 2016). Thesis: Committee: J. Barlow (Advisor), J. Z. Wang (Co-Advisor), J. Li, R. T. Colins, W.-C. Lee, Z. Zhou. |
![]() |
16. Yu Luo, Research Scientist, Amazon Lab126, Sunnyvale, CA. (g-scholar) yzl5709 (at) psu.edu Ph.D. Program in Informatics, Penn State, since 2015, graduation expected in 2020-2021 Thesis: Committee: J. Z. Wang (Advisor), J. Li (Co-Advisor), M. B. Rosson, Z. Zhou, R. B. Adams, Jr. |
![]() |
15. Mohammad M. Kamani,
Research Scientist II, WYZE Labs, Inc., Kirkland, WA. (g-scholar)
mohamadmahdi.kamani (at) gmail.com, mqk5591 (at) psu.edu Ph.D. Program in Informatics, Penn State, Fall 2020 Academic Computing Fellow, Penn State, 2017-2020 Thesis: Multiobjective Optimization Approaches for Bias Mitigation in Machine Learning Committee: J. Z. Wang (Advisor), Mehrdad Mahdavi (Co-Advisor), C. L. Giles, X. Zhang, C. E. Forest, J. Li |
![]() |
14. Xinye (Rachel) Zheng, Research Scientist, Facebook, Inc., Menlo Park, CA. zhengxinye (at) gmail.com, xvz5220 (at) psu.edu Ph.D. Program in Informatics, Penn State, Summer 2020 Thesis: Computational Approaches towards Pattern Recognition and Matching for Scientific Images Committee: J. Z. Wang (Advisor), J. Li (Co-Advisor), S. Abdullah, A. Squicciarini, C. E. Forest. |
![]() |
13. Yukun Chen, Research Scientist, Facebook, Inc., Menlo Park, CA. cykustc (at) gmail.com, yzc147 (at) psu.edu Ph.D. Program in Informatics, Penn State, Spring 2020 Thesis: Aggregated Wasserstein Distance for Hidden Markov Models and Automated Morphological Characterization of Placenta from Photos Committee: J. Z. Wang (Advisor), J. Li (Co-Advisor), X. Xing, X. Zhang, D. Wang (Northwestern), D. Hunter. |
![]() |
12. Baris Kandemir, Software Engineer, DeepMap, Palo Alto, CA. (g-scholar) bariskand (at) gmail.com , bzk142 (at) psu.edu Ph.D. Program in Informatics, Penn State, Spring 2019 Thesis: Aesthetic and Affective Applications of Visual Features and Physical Property Analysis of Plant Stomata Through Active Surfaces (Download) Committee: J. Z. Wang (Advisor), J. Li (Co-Advisor), Z. Zhou, R. Adams, Jr., C. Anderson. |
![]() |
11. Jianbo Ye, Applied Research Scientist, Amazon Lab126, Sunnyvale, CA. (g-scholar) jianboye.ai (at) gmail.com , jxy198 (at) psu.edu Ph.D. Program in Information Sciences and Technology, Penn State, Spring 2018 Thesis: Computational Modeling of Compositional and Relational Data Using Optimal Transport and Probabilistic Models (Download) Committee: J. Z. Wang, J. Li (Co-Chairs), C. L. Giles, Z. Li, R. Adams, Jr. |
![]() |
10. Xin Lu, Senior Engineering Manager and Scientist, Adobe Systems Inc., San Jose, CA. (g-scholar) xxl5086 (at) psu.edu Ph.D. Program in Information Sciences and Technology, Penn State, Spring 2016 Thesis: Visual Characteristics for Computational Prediction of Aesthetics and Evoked Emotions (Download) Committee: J. Z. Wang (Chair), M. B. Rosson, R. Adams, Jr., M. Newman, J. Li |
![]() |
9. Yu Zhang, Senior Software Engineer, DeepMap, Palo Alto, CA. (g-scholar)
ryanflower (at) gmail.com Ph.D. Program in Information Sciences and Technology, Penn State, Spring 2015 Thesis: Discrete Distribution Clustering in Big Data and a Method for Storm Prediction Leveraging Large Historical Archives (Download) Committee: J. Z. Wang, J. Li (Co-chairs), C. L. Giles, A. Squicciarini, C. E. Forest |
![]() |
8. Neela Sawant, Senior Research Scientist, AWS Deep Learning, Amazon, Seattle, WA. (g-scholar)
neela.sawant (at) gmail.com Ph.D. Program in Information Sciences and Technology, Penn State, Summer 2013 Thesis: Statistical Modeling of Image Semantics from Imperfectly Labeled Datasets (Download) Committee: J. Z. Wang, J. Li (Co-chairs), C. L. Giles, J. M. Carroll, R. Albert |
![]() |
7.
Lei Yao, Software Engineer, Pinterest, San Francisco, CA. (g-scholar)
simplely (at) gmail.com Ph.D. in Information Sciences and Technology, Penn State, Summer 2013 Thesis: Automated Analysis of Composition and Style of Photographs and Paintings (Download) Committee: J. Z. Wang, J. Li (Co-chairs), D. L. Hall, X. (L.) Zhang, P. J. McGrady |
![]() |
6.
Mu Qiao, Research Group Leader and Master Inventor, AI Platforms, IBM Almaden Research Center, San Jose, CA. (g-scholar)
mqiao (at) us.ibm.com Ph.D. in Computer Science and Engineering, Penn State, Fall 2012 Thesis: Mixture Modeling for Complex and Large-Scale Data with Applications (Download) Committee: J. Li (Advisor), J. Z. Wang (Co-advisor), D. Kifer (Co-Chair), J. Barlow, L. Zhang |
![]() |
5.
Professor Brian A. Canada, Chair, Department of Computer Science, and Associate Professor with tenure, Computational Science, University of South Carolina, Beaufort, SC.
(g-scholar)
bcanada (at) uscb.edu Ph.D. in Integrative Biosciences, Penn State, Fall 2010 Thesis: Augmentation of the Zebrafish Phenomic Landscape by Histological Analysis and Content-based Image Retrieval (Download) Committee: J. Z. Wang, K. Cheng, K. Weiss (Co-chairs), J. Richtsmeier, W. Miller (Computational Science Minor) |
![]() |
4. Ritendra Datta,
Tech Lead/Manager, Facebook, Inc., Menlo Park, CA and Seattle, WA. (g-scholar) ritendra.datta (at) gmail.com Ph.D. in Computer Science and Engineering, Penn State, Spring 2009 Thesis: Semantics and Aesthetics Inference for Image Search: Statistical Learning Approaches (Download) Committee: J. Z. Wang (Chair), J. Li (Co-Chair), R. Collins, C. L. Giles, D. Miller, B. Urgaonkar |
![]() |
3. Xiaonan Lu, Senior Data Scientist, GrabTaxi Holdings Pte. Ltd. (Grab), Seattle, WA.
(g-scholar)
xlu (at) cse.psu.edu Ph.D. in Computer Science and Engineering, Penn State, Fall 2008 Thesis: Image Analysis and Metadata Extraction for Document Retrieval (Download) Committee: J. Z. Wang (Chair), L. Giles (Co-Chair), W.-C. Lee, D. Miller, C. Zhu |
![]() |
2. Dhiraj
Joshi,
Senior Research Scientist, IBM T. J. Watson Research Center, New York.
(g-scholar)
dhirajjoshi16 (at) gmail.com Ph.D. in Computer Science and Engineering, Penn State, Summer 2007 Thesis: Image Analysis and Retrieval by Spatial Models and Information Integration (Download) Committee: J. Z. Wang (Chair), J. Li (Co-Chair), R. Collins, D. Hunter, W.-C. Lee |
![]() |
1. Professor Yixin
Chen,
Professor, Computer and Information Science, University of Mississippi, Oxford.
(g-scholar)
ychen (at) cs.olemiss.edu Ph.D. in Computer Science and Engineering, Penn State, Summer 2003 Thesis: A Machine Learning Approach to Content-based Image Indexing and Retrieval (Download) Committee: J. Z. Wang (Chair), C. L. Giles, J. Yen, J. Li, D. Richards |
Siqiong He, Software Engineer, Google sxh415 (at) psu.edu, Information Sciences and Technology, Penn State, graduated in May 2015 Thesis: Modeling Photographic Composition via Triangles | |
Poonam Suryanarayan, Sr. Software Engineer, Google pzs126 (at) psu.edu, Electrical Engineering, Penn State, graduated in 2011 Thesis: A Compputational Approach for Understanding the Aesthetics of Gray Scale Images | |
AdityaGiri Valluri, Hardware Applications Engineer, Microsemi, CA azv114 (at) psu.edu, Electrical Engineering, Penn State, graduated in May 2009 Thesis: Navigation Through Automated Image Understanding and Retrieval | |
Ashish Parulekar, Business Director, Capital One
Electrical Engineering, Penn State, graduated in December 2005 Thesis: Large-scale Satellite Image Browsing using Automatic Semantic Categorization and Content-based Retrieval | |
Other past members and some current collaborators are listed here.
The group currently focuses on four directions. More information will be added here later. For now, we link you to the latest publications in each direction.
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.
We provide datasets for research comparison. If you cannot find the data that you need, you may contact Dr. Wang.
Request the BoLD (Body Language Dataset) for modeling emotions
The dataset was created in our bodily expressed emotion understanding work. The data is provided for non-commerical research comparison only. You should not redistribute the data. You are strongly encouraged to participate in our data modeling challenge.
Download
10,000 test images (low resolution web-crawled misc database used in WBIIS);
download
1,000 test images (test database used in SIMPLIcity paper)(zip);
If you need the 60,000-image database used in SIMPLIcity, ALIPR, and ALIP papers for research comparison, please contact James Wang.
The databases should be used only
for comparing algorithms, which can be considered as 'fair use' of
the images and our metadata.
You should not redistribute the images.
These datasets have been used in our publications.
Download the Aesthetics Data for Research (2015)
The dataset was used in our computational aesthetics work. The data is provided for non-commerical research comparison only.
You should not redistribute the data.
Download the Emotion Data for Research (2017)
Three datasets were created and used in our work on modeling evoked emotions. The data is provided for non-commerical research comparison only.
You should not redistribute the data. You will need to contact us to obtain the original images.
Download the Portrait Triangle Data for Research (2017)
The dataset was created and used in our portrait triangle work. The data is provided for non-commerical research comparison only. Copyright of the images belongs to the original photographers. You should not redistribute the data.
Download the Aesthetics Data for Research (2006)
The dataset was used in our computational aesthetics work. The data is provided for non-commerical research comparison only.
You should not redistribute the data.
Download the Brushstroke Data of van Gogh Paintings for Research (tar.gz) and the Manual Brushstroke Extraction data (zip)
The datasets were used in our painting analysis work. The data is provided for academic research comparison only.
You should not redistribute the data.
If you are a government agency, an education institution, or a non-profit organization, we may offer you a FREE license of the SIMPLIcity system to run on Linux or Solaris. Please contact Prof. James Wang by email to discuss details. At the moment, the C source code is not ready for public download. If you are commercial and would like to use SIMPLIcity, let us know and we will try to arrange to let you use.
We are planning to release some other software packages via this site in the future. Stay tuned.
The research group is located in the Westgate Building [about] at Penn State. Please read the FAQ for answers to some common questions. .
James Z. Wang, Professor