Role of inferior temporal neurons in visual memory II. Multiplying temporal waveforms related to vision and memory

Emad N. Eskandar, L. M. Optican, B. J. Richmond

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

1. In the companion paper we reported on the activity of neurons in the inferior temporal (IT) cortex during a sequential pattern matching task. In this task a sample stimulus was followed by a test stimulus that was either a match or a nonmatch. Many of the neurons encoded information about the patterns of both current and previous stimuli in the temporal modulation of their responses. 2. A simple information processing model of visual memory can be formed with just four steps: 1) encode the current stimulus; 2) recall the code of a remembered stimulus; 3) compare the two codes; 4) and decide whether they are similar or different. The analysis presented in the first paper suggested that some IT neurons were performing the comparison step of visual memory. 3. We propose that IT neurons participate in the comparison of temporal waveforms related to vision and memory by multiplying them together. This product could form the basis of a crosscorrelation-based comparison. 4. We tested our hypothesis by fitting a simple multiplicative model to data from IT neurons. The model generated waveforms in separate memory and visual channels. The waveforms arising from the two channels were then multiplied on a point by point basis to yield the output waveform. The model was fitted to the actual neuronal data by a gradient descent method to find the best fit waveforms that also had the lowest total energy. 35. The multiplicative model fit the neuronal responses quite well. The multiplicative model made consistently better predictions of the actual response waveforms than did an additive model. Furthermore, the fit was better when the actual relationship between the responses and the sample and test stimuli were preserved than when that relationship was randomized. 6. We infer from the superior fit of the multiplicative model that IT neurons are multiplying temporally modulated waveforms arising from separate visual and memory systems in the comparison step of visual memory.

Original languageEnglish (US)
Pages (from-to)1296-1306
Number of pages11
JournalJournal of Neurophysiology
Volume68
Issue number4
StatePublished - Jan 1 1992
Externally publishedYes

Fingerprint

Neurons
Temporal Lobe
Automatic Data Processing

ASJC Scopus subject areas

  • Physiology
  • Neuroscience(all)

Cite this

Role of inferior temporal neurons in visual memory II. Multiplying temporal waveforms related to vision and memory. / Eskandar, Emad N.; Optican, L. M.; Richmond, B. J.

In: Journal of Neurophysiology, Vol. 68, No. 4, 01.01.1992, p. 1296-1306.

Research output: Contribution to journalArticle

@article{20b83860cae545bc83158715536c24a1,
title = "Role of inferior temporal neurons in visual memory II. Multiplying temporal waveforms related to vision and memory",
abstract = "1. In the companion paper we reported on the activity of neurons in the inferior temporal (IT) cortex during a sequential pattern matching task. In this task a sample stimulus was followed by a test stimulus that was either a match or a nonmatch. Many of the neurons encoded information about the patterns of both current and previous stimuli in the temporal modulation of their responses. 2. A simple information processing model of visual memory can be formed with just four steps: 1) encode the current stimulus; 2) recall the code of a remembered stimulus; 3) compare the two codes; 4) and decide whether they are similar or different. The analysis presented in the first paper suggested that some IT neurons were performing the comparison step of visual memory. 3. We propose that IT neurons participate in the comparison of temporal waveforms related to vision and memory by multiplying them together. This product could form the basis of a crosscorrelation-based comparison. 4. We tested our hypothesis by fitting a simple multiplicative model to data from IT neurons. The model generated waveforms in separate memory and visual channels. The waveforms arising from the two channels were then multiplied on a point by point basis to yield the output waveform. The model was fitted to the actual neuronal data by a gradient descent method to find the best fit waveforms that also had the lowest total energy. 35. The multiplicative model fit the neuronal responses quite well. The multiplicative model made consistently better predictions of the actual response waveforms than did an additive model. Furthermore, the fit was better when the actual relationship between the responses and the sample and test stimuli were preserved than when that relationship was randomized. 6. We infer from the superior fit of the multiplicative model that IT neurons are multiplying temporally modulated waveforms arising from separate visual and memory systems in the comparison step of visual memory.",
author = "Eskandar, {Emad N.} and Optican, {L. M.} and Richmond, {B. J.}",
year = "1992",
month = "1",
day = "1",
language = "English (US)",
volume = "68",
pages = "1296--1306",
journal = "Journal of Neurophysiology",
issn = "0022-3077",
publisher = "American Physiological Society",
number = "4",

}

TY - JOUR

T1 - Role of inferior temporal neurons in visual memory II. Multiplying temporal waveforms related to vision and memory

AU - Eskandar, Emad N.

AU - Optican, L. M.

AU - Richmond, B. J.

PY - 1992/1/1

Y1 - 1992/1/1

N2 - 1. In the companion paper we reported on the activity of neurons in the inferior temporal (IT) cortex during a sequential pattern matching task. In this task a sample stimulus was followed by a test stimulus that was either a match or a nonmatch. Many of the neurons encoded information about the patterns of both current and previous stimuli in the temporal modulation of their responses. 2. A simple information processing model of visual memory can be formed with just four steps: 1) encode the current stimulus; 2) recall the code of a remembered stimulus; 3) compare the two codes; 4) and decide whether they are similar or different. The analysis presented in the first paper suggested that some IT neurons were performing the comparison step of visual memory. 3. We propose that IT neurons participate in the comparison of temporal waveforms related to vision and memory by multiplying them together. This product could form the basis of a crosscorrelation-based comparison. 4. We tested our hypothesis by fitting a simple multiplicative model to data from IT neurons. The model generated waveforms in separate memory and visual channels. The waveforms arising from the two channels were then multiplied on a point by point basis to yield the output waveform. The model was fitted to the actual neuronal data by a gradient descent method to find the best fit waveforms that also had the lowest total energy. 35. The multiplicative model fit the neuronal responses quite well. The multiplicative model made consistently better predictions of the actual response waveforms than did an additive model. Furthermore, the fit was better when the actual relationship between the responses and the sample and test stimuli were preserved than when that relationship was randomized. 6. We infer from the superior fit of the multiplicative model that IT neurons are multiplying temporally modulated waveforms arising from separate visual and memory systems in the comparison step of visual memory.

AB - 1. In the companion paper we reported on the activity of neurons in the inferior temporal (IT) cortex during a sequential pattern matching task. In this task a sample stimulus was followed by a test stimulus that was either a match or a nonmatch. Many of the neurons encoded information about the patterns of both current and previous stimuli in the temporal modulation of their responses. 2. A simple information processing model of visual memory can be formed with just four steps: 1) encode the current stimulus; 2) recall the code of a remembered stimulus; 3) compare the two codes; 4) and decide whether they are similar or different. The analysis presented in the first paper suggested that some IT neurons were performing the comparison step of visual memory. 3. We propose that IT neurons participate in the comparison of temporal waveforms related to vision and memory by multiplying them together. This product could form the basis of a crosscorrelation-based comparison. 4. We tested our hypothesis by fitting a simple multiplicative model to data from IT neurons. The model generated waveforms in separate memory and visual channels. The waveforms arising from the two channels were then multiplied on a point by point basis to yield the output waveform. The model was fitted to the actual neuronal data by a gradient descent method to find the best fit waveforms that also had the lowest total energy. 35. The multiplicative model fit the neuronal responses quite well. The multiplicative model made consistently better predictions of the actual response waveforms than did an additive model. Furthermore, the fit was better when the actual relationship between the responses and the sample and test stimuli were preserved than when that relationship was randomized. 6. We infer from the superior fit of the multiplicative model that IT neurons are multiplying temporally modulated waveforms arising from separate visual and memory systems in the comparison step of visual memory.

UR - http://www.scopus.com/inward/record.url?scp=0026459545&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026459545&partnerID=8YFLogxK

M3 - Article

C2 - 1432085

AN - SCOPUS:0026459545

VL - 68

SP - 1296

EP - 1306

JO - Journal of Neurophysiology

JF - Journal of Neurophysiology

SN - 0022-3077

IS - 4

ER -