Listening beyond seeing: Event-related potentials to audiovisual processing in visual narrative

Página do item simplificado
dc.contributor.authorManfredi M.
dc.contributor.authorCohn N.
dc.contributor.authorDe Araujo Andreoli M.
dc.contributor.authorBoggio P.S.
dc.date.accessioned2024-03-12T23:56:47Z
dc.date.available2024-03-12T23:56:47Z
dc.date.issued2018
dc.description.abstract© 2018 Elsevier Inc.Every day we integrate meaningful information coming from different sensory modalities, and previous work has debated whether conceptual knowledge is represented in modality-specific neural stores specialized for specific types of information, and/or in an amodal, shared system. In the current study, we investigated semantic processing through a cross-modal paradigm which asked whether auditory semantic processing could be modulated by the constraints of context built up across a meaningful visual narrative sequence. We recorded event-related brain potentials (ERPs) to auditory words and sounds associated to events in visual narratives—i.e., seeing images of someone spitting while hearing either a word (Spitting!) or a sound (the sound of spitting)—which were either semantically congruent or incongruent with the climactic visual event. Our results showed that both incongruent sounds and words evoked an N400 effect, however, the distribution of the N400 effect to words (centro-parietal) differed from that of sounds (frontal). In addition, words had an earlier latency N400 than sounds. Despite these differences, a sustained late frontal negativity followed the N400s and did not differ between modalities. These results support the idea that semantic memory balances a distributed cortical network accessible from multiple modalities, yet also engages amodal processing insensitive to specific modalities.
dc.description.firstpage1
dc.description.lastpage8
dc.description.volume185
dc.identifier.doi10.1016/j.bandl.2018.06.008
dc.identifier.issn1090-2155
dc.identifier.urihttps://dspace.mackenzie.br/handle/10899/35469
dc.relation.ispartofBrain and Language
dc.rightsAcesso Restrito
dc.subject.otherlanguageAudiovisual processing
dc.subject.otherlanguageCross-modal processing
dc.subject.otherlanguageN400
dc.subject.otherlanguageSemantic memory
dc.subject.otherlanguageVisual narrative
dc.titleListening beyond seeing: Event-related potentials to audiovisual processing in visual narrative
dc.typeArtigo
local.scopus.citations18
local.scopus.eid2-s2.0-85049462552
local.scopus.subjectAcoustic Stimulation
local.scopus.subjectAdult
local.scopus.subjectAuditory Perception
local.scopus.subjectBrain
local.scopus.subjectBrain Mapping
local.scopus.subjectElectroencephalography
local.scopus.subjectEvoked Potentials
local.scopus.subjectFemale
local.scopus.subjectHumans
local.scopus.subjectMale
local.scopus.subjectMemory
local.scopus.subjectNarration
local.scopus.subjectPhotic Stimulation
local.scopus.subjectVisual Perception
local.scopus.subjectYoung Adult
local.scopus.updated2024-05-01
local.scopus.urlhttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85049462552&origin=inward
Arquivos
Coleções
Artigos de periódico