| 2,149 | 27 | 71 |
| 下载次数 | 被引频次 | 阅读次数 |
从插图、字幕、弹幕再到现在的AR/VR、H5,单一模态的媒介表达形式越来越难以满足当下社会对信息传达的需求,因此媒介载体不断升级,从更高的维度来塑造表意资源的保真度。在这个过程中,"注意"愈发成为一种稀缺资源。本研究从"字幕"这个细小点切入,立足于交叉学科思维,结合眼动实验和行为实验,探究母语电影中的字幕对用户注意分配以及记忆效果的影响。结果显示,在字幕组别(有字幕组、无字幕组和安慰剂对照组)之间,用户对没有加工困难的母语字幕表现出高度关注,但是这种字幕偏好性并没有提高记忆效果;在画面和文本之间,用户会优先加工画面信息,但是记忆测试结果显示用户对文字的记忆效果更好。
Abstract：[1]Martín A G,Tyner K.Media Education,Media Literacy and Digital Competence[J].Comunicar.Media Education Research Journal,Vol.20,No.1,2012.
[2]喻国明.关于媒介用户使用体验的模型与定量化研究——一项认知神经传播学研究的逻辑框架[J].新疆师范大学学报(哲学社会科学版),2018(6).
[3]Gurunluoglu,R.,Gurunluoglu,A.,Williams,S.A.,& Cavdar,S..The History and Illustration of Anatomy in the Middle Ages[J].Journal of Medical Biography,Vol.21,No.4,2013.
[4]张德禄.多模态话语分析综合理论框架探索[J].中国外语，2009(1).
[5]D’Ydewalle,G.,& De Bruycker,W.Eye Movements of Children and Adults While Reading Television Subtitles[J].European Psychologist,Vol.12,No.3,2007.
[6]D’Ydewalle,G.,Praet,C.,Verfaillie,K.,& Van Rensbergen,J.Watching Subtitled Television:Automatic Reading Behavior[J].Communication Research,Vol.18,No.5,1991.
[7]Jensema,C.J.,Danturthi,R.S.,& Burch,R.Time Spent Viewing Captions on Television Programs[J].American Annals of the Deaf,Vol.145,No.5,2000.
[8]Sadoski,M.,& Paivio,A.A Dual Coding Theoretical Model of Reading[J].Theoretical Models and Processes of Reading,No.5,2004.
[9]Childers,T.L.,& Houston,M.J.Conditions for a Picture-Superiority Effect on Consumer Memory[J].Journal of Consumer Research,Vol.11,No.2,1984.
[10]Perego E,Del Missier F,Stragà M.Dubbing vs.Subtitling:Complexity Matters[J].Target.International Journal of Translation Studies,Vol.30,No.1,2018.
[11]Iturregui-Gallardo G,Matamala A.Audio Subtitling:Dubbing and Voice-Over Effects and Their Impact on User Experience[J].Perspectives,Vol.29,No.1,2021.
[12]Borrás,I.,& Lafayette,R.C.Effects of Multimedia Courseware Subtitling on the Speaking Performance of College Students of French[J].Modern Language Journal,Vol.78,No.1,1994.
[13]Brasel,S.A.,& Gips,J.Enhancing Television Advertising:Same-Language Subtitles can Improve Brand Recall,Verbal Memory,and Behavioral Intent[J].Journal of the Academy of Marketing Science,Vol.42,No.3,2014.
[14]Bird,S.A.,& Williams,J.N.The Effect of Bimodal Input on Implicit and Explicit Memory:an Investigation into the Benefits of Within-Language Subtitling[J].Applied Psycholinguistics,Vol.23,No.4,2002.
[15]Spence,C.,& Read,L.Speech Shadowing while Driving:on the Difficulty of Splitting Attention between Eye and Ear[J].Psychological Science,Vol.14,No.3,2003.
[16]Langner,R.,Kellermann,T.,Boers,F.,Sturm,W.,Willmes,K.,& Eickhoff,S.B.Modality-Specific Perceptual Expectations Selectively Modulate Baseline Activity in Auditory,Somatosensory,and Visual Cortices[J].Cerebral Cortex,Vol.21,No.12,2011.
[17]Posner,M.I.,Nissen,M.J.,& Klein,R.M.Visual Dominance:an Information-Processing Account of its Origins and Significance[J].Psychological Review,Vol.83,No.2,1976.
[18]Colavita,F.B.Human Sensory Dominance[J].Perception & Psychophysics,Vol.16,No.2,1974.
[19]Kieras,D.E.,& Just,M.A.(eds.).New Methods in Reading Comprehension Research[M].New York:Routledge,2018.
[20]Brasel S A,Gips J.Media Multitasking:How Visual Cues Affect Switching Behavior[J].Computers in Human Behavior,Vol.77,2017.
[21]Jakob N.F-Shaped Pattern for Reading Web Content[EB/OL].Jakob Nielsen’s Alertbox,http://www.useit.com/alertbox/reading_pattern.html,2006-04-17.
[22]Posner,M.I.Orienting of Attention[J].Quarterly Journal of Experimental Psychology,Vol.32,No.1,1980.
[23]She,H.C.,& Chen,Y.Z..The Impact of Multimedia Effect on Science Learning:Evidence from Eye Movements [J].Computers & Education,Vol.53,2009.
[24]De Koning,B.B.,Tabbers,H.K.,Rikers,R.M.,& Paas,F..Attention Guidance in Learning from a Complex Animation:Seeing is Understanding?[J].Learning and Instruction,Vol.20,No.2,2010.
[25]Price D D,Finniss D G,Benedetti F.A Comprehensive Review of the Placebo Effect:Recent Advances and Current Thought[J].Annu.Rev.Psychol.,Vol.59,2008.
[26]Spears N,Singh S N.Measuring Attitude toward the Brand and Purchase Intentions[J].Journal of Current Issues & Research in Advertising,Vol.26,No.2,2004.
[27]Kanellopoulou,C.,Kermanidis,K.L.,& Giannakoulopoulos,A.The Dual-Coding and Multimedia Learning Theories:Film Subtitles as a Vocabulary Teaching Tool[J].Education Sciences,Vol.9,No.3,2019.
[28]Algesheimer,R.,Dholakia,U.M.,& Herrmann,A.The Social Influence of Brand Community:Evidence from European Car Clubs[J].Journal of Marketing,Vol.69,No.3,2005.
[29]Underwood,G.,Jebbett,L.,& Roberts,K.Inspecting Pictures for Information to Verify a Sentence:Eye Movements in General Encoding and in Focused Search[J].Quarterly Journal of Experimental Psychology Section A,Vol.57,No.1,2004.
[30]Henderson,J.M.Regarding Scenes[J].Current Directions in Psychological Science,Vol.16,No.4,2007.
[31]Strayer,D.L.,Drews,F.A.,& Johnston,W.A.Cell Phone-Induced Failures of Visual Attention During Simulated Driving[J].Journal of Experimental Psychology.Vol.23,2003.
基本信息:
中图分类号:B842.3;H05
引用信息:
[1]喻国明,陈雪娇,修利超.多模态视角下用户注意偏向与记忆的影响机制——基于电影字幕的眼动研究[J].西南民族大学学报(人文社会科学版),2021,42(06):169-177.
基金信息:
北京市社会科学基金重大项目“中国特色舆论学科体系三十年发展研究”(17ZDA06); 北京师范大学博一学科交叉基金项目“认知神经科学视角下‘人机耦合’式媒介对用户体验的影响”(BNUXKJC2016); 中央高校基本科研业务费专项资金“后真相时代”的传播效果及其认知神经机制”(2020NTSS10)阶段性成果
2021-06-10
2021-06-10