Speech perception and the McGurk effect---a cross cultural study using event-related potentials
by Wu, Jia, Ph.D., UNIVERSITY OF LOUISVILLE, 2009, 102 pages; 3370063

Abstract:

Previous research has indicated the important role of visual information in the speech perception process. These studies have elucidated the areas of the brain involved in the processing of audiovisual stimuli. The McGurk effect, an audiovisual illusion, has been demonstrated to be a useful tool in the study of audiovisual integration. Brain imaging research suggests that the McGurk effect is modulated by brain structures in the Superior Temporal Gyrus, Supplemental Temporal Cortex and Broadman area 41. Electrophysiological studies suggest that the McGurk effect generates a different brainwave than the standard audiovisual congruent condition in frontal, central and parietal regions among N1, P2, N300 and later ERP components. The magnitude of the McGurk effect is influenced by lexical information, cultural difference and language experience, although these effects have not been investigated by electrophysiological methods. The current study compares three experimental groups, native Chinese speakers who had less than three years of residency in the United States; native Chinese speakers with more than three years of residency in the United States; and native English speakers. A high density (256 channels) hydrocel system was used to collect the ERP data from the participants in three experiments. The main effect of McGurk was studied in Experiment 1, by dubbing an audio /ba/ onto a video /ga/. The behavioral responses and the characteristic brainwave of the McGurk effect were examined. The semantic and culturally related McGurk effects were investigated in Experiment 2 and 3. The three groups were contrasted in each of the experiments. The results showed brainwave differences for the McGurk and the standard audiovisual congruent condition in the left hemisphere. These results also revealed a word/nonword separation in the McGurk effect, which provides electrophysiological evidence for an interaction of the McGurk condition and semantic/cognitive processing. Contrary to hypothesis, significant group differences were not found between the two Chinese groups. Limitations and implications of this study are discussed.

 
Advisor
SchoolUNIVERSITY OF LOUISVILLE
SourceDAI/B 70-07, p. , Feb 2010
Source TypeDissertation
SubjectsPsychobiology; Developmental psychology; Experimental psychology
Publication Number3370063
Adobe PDF Access the complete dissertation:
 

» This is an open access dissertation.
  Use the link below to access the full text PDF of this graduate work:
  http://gradworks.umi.com/3370063.pdf
  Use the link below to search and retrieve all open access dissertations:
  http://pqdtopen.proquest.com

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.