When a hit sounds like a kiss: An electrophysiological exploration of semantic processing in visual narrative

Página do item simplificado
dc.contributor.authorManfredi M.
dc.contributor.authorCohn N.
dc.contributor.authorKutas M.
dc.date.accessioned2024-03-13T00:49:27Z
dc.date.available2024-03-13T00:49:27Z
dc.date.issued2017
dc.description.abstract© 2017 Elsevier Inc.Researchers have long questioned whether information presented through different sensory modalities involves distinct or shared semantic systems. We investigated uni-sensory cross-modal processing by recording event-related brain potentials to words replacing the climactic event in a visual narrative sequence (comics). We compared Onomatopoeic words, which phonetically imitate action sounds (Pow!), with Descriptive words, which describe an action (Punch!), that were (in)congruent within their sequence contexts. Across two experiments, larger N400s appeared to Anomalous Onomatopoeic or Descriptive critical panels than to their congruent counterparts, reflecting a difficulty in semantic access/retrieval. Also, Descriptive words evinced a greater late frontal positivity compared to Onomatopoetic words, suggesting that, though plausible, they may be less predictable/expected in visual narratives. Our results indicate that uni-sensory cross-model integration of word/letter-symbol strings within visual narratives elicit ERP patterns typically observed for written sentence processing, thereby suggesting the engagement of similar domain-independent integration/interpretation mechanisms.
dc.description.firstpage28
dc.description.lastpage38
dc.description.volume169
dc.identifier.doi10.1016/j.bandl.2017.02.001
dc.identifier.issn1090-2155
dc.identifier.urihttps://dspace.mackenzie.br/handle/10899/35762
dc.relation.ispartofBrain and Language
dc.rightsAcesso Restrito
dc.subject.otherlanguageComics
dc.subject.otherlanguageEvent-related potentials
dc.subject.otherlanguageLate positivity
dc.subject.otherlanguageN400
dc.subject.otherlanguageOnomatopoeic words
dc.subject.otherlanguageVisual language
dc.subject.otherlanguageVisual narrative
dc.titleWhen a hit sounds like a kiss: An electrophysiological exploration of semantic processing in visual narrative
dc.typeArtigo
local.scopus.citations31
local.scopus.eid2-s2.0-85013833449
local.scopus.subjectAdolescent
local.scopus.subjectAdult
local.scopus.subjectBrain
local.scopus.subjectElectroencephalography
local.scopus.subjectEvoked Potentials
local.scopus.subjectFemale
local.scopus.subjectHumans
local.scopus.subjectMale
local.scopus.subjectNarration
local.scopus.subjectPhonetics
local.scopus.subjectPhotic Stimulation
local.scopus.subjectSemantics
local.scopus.subjectSound
local.scopus.subjectYoung Adult
local.scopus.updated2024-05-01
local.scopus.urlhttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85013833449&origin=inward
Arquivos
Coleções
Artigos de periódico