Emotion schemas are embedded in the human visual system

Philip A. Kragel, Marianne C. Reddan, Kevin S. LaBar, Tor D. Wager

Research output: Contribution to journalArticlepeer-review

58 Scopus citations

Abstract

Theorists have suggested that emotions are canonical responses to situations ancestrally linked to survival. If so, then emotions may be afforded by features of the sensory environment. However, few computational models describe how combinations of stimulus features evoke different emotions. Here, we develop a convolutional neural network that accurately decodes images into 11 distinct emotion categories. We validate the model using more than 25,000 images and movies and show that image content is sufficient to predict the category and valence of human emotion ratings. In two functional magnetic resonance imaging studies, we demonstrate that patterns of human visual cortex activity encode emotion category–related model output and can decode multiple categories of emotional experience. These results suggest that rich, category-specific visual features can be reliably mapped to distinct emotions, and they are coded in distributed representations within the human visual system.

Original languageEnglish (US)
Article numbereaaw4358
JournalScience Advances
Volume5
Issue number7
DOIs
StatePublished - 2019
Externally publishedYes

ASJC Scopus subject areas

  • General

Fingerprint

Dive into the research topics of 'Emotion schemas are embedded in the human visual system'. Together they form a unique fingerprint.

Cite this