多模态语篇分析.ppt

Multimodal Discourse Analysis Foreign Linguistics and Applied LinguisticsZheng Lu Zheng Lu What is multimodality?vA mode,according to Kress and Van Leeuwen,is asemioticsystemwithrulesandregularitiesattachedtoit.vMultiple modes,namely semioticmodes,can includegestures,posture,proxemics(空 间 关 系 学),visualimages,document layout(设 计 布 局),music andarchitecturaldesign,etc.vMeanings are created in texts and interactions in acomplex interplay of semiosis across multiple modesbutarenotlimitedtowrittenorspokenlanguage.vMultimodal discourse analysis is a fairly newandrapidlydevelopingperspectiveondiscourse.vAnother interesting perspective on multimodaldiscourseanalysisisthatitnotmerelyattemptstointegrateallthepossiblesemioticmodesofexpressionsbutalsocanintegratevariousotherapproachestodiscourseanalysis.BACKGROUNDvMultimodaldiscourseanalysishasbecomepopularinthewesternworldsincethe1990s.vMultimodal discourse analysis relies heavily onHallidays systemic-functional theory of language.Languageisakindofsocial semiotic,meanwhile,ithasmanyfunctions,suchasideational ideational function,function,(概念功能)interpersonal interpersonal functionfunction(人际功能)and and textual textual functionfunction(语篇功能).Languageisinseparablefromsocialactivitiesofman.vBefore1990s,researchersalltooktextualdata,namely,static texts to be the primary resource for socialinteractions,such as Kress and van Leeuwensgrammar grammar of of imagesimages 视 觉 设 计 的 语 法 and OTooles investigation of paintings,sculpture andarchitecture.vThereisawidespreadbeliefnowthattextualdataisnotnecessarily the most important mode used for theinterpretationsofsocialmeaning.Inordertostudythecomplexityofhumaninteraction,wehavetoworkontheanalysisofmoredynamicinteractions,andanalyzeallmodesthattheparticipantsareutilizing.Every interaction is multimodal.Althoughitsrelativelyshorthistory,multimodaldiscourseanalysis has also had an important influence on otherapproachesandfields,mostnotablyintheareaofliteracyandthegrowinginterestindigital literaciesandthefieldofhuman-computerinteraction.Digital literacy is the ability to locate,organize,understand and analyze information using digital technology.Schools are continually updating their curriculum for digital literacy.This often includes computers in the classroom,the use of educational software to teach curriculum,and course materials being available to students online.v随随着着多多媒媒体体技技术术的的产产生生与与发发展展,如如何何将将自自然然话话语语同同多多种种模模态态结结合合起起来来进进行行分分析析解解读读是是现现代代语语言言学学,尤尤其其是是话话语语分分析析研研究究领领域域的的重重要要课课题题。我我国国多多模模态态话话语语分分析析研研究究主主要要涉涉及及理理论论探探讨讨、视视觉觉应应用用、口口语语语语料料库库建设、教学应用等领域。建设、教学应用等领域。v国国内内多多模模态态话话语语的的研研究究还还处处在在起起始始阶阶段段，尚尚未未见见到到专专著著出出版版，只只有有为为数数不不多多的的论论文文，其其中中包包括括胡胡壮壮麟麟的的“社社会会符符号号学学中中的的多多模模态态化化”，李李战战子子“用用系系统统功功能能语语言言学学理理论论对对多多模模态态话话语语理理论论的的研研究究”,”,另另外外朱朱永生和张德禄等也进行了相应的研究。永生和张德禄等也进行了相应的研究。The self is not something that exists first and then enters into relationship with others,but it is,so to speak,an eddy(漩涡漩涡)in the social current and so still a part of that current.American women anthropologistMead 1974:182 Some thoughts on personal identity constructionA multimodal perspectiveSigrid NorrisAssociateProfessorAuckland University of TechnologyDirector:MultimodalResearchCentreDegrees:Ph.D.LinguisticsGeorgetownUniversity,2002M.S.LinguisticsGeorgetownUniversity,1997B.A.RussianLanguageandLiteratureGeorgeWashingtonUniversity,1989Sigrid NorrisOUTLINEIntroductionSomebackgroundTheoreticargumentStructureConclusion.the social actor,speakingonthephonewithheremployee(multimodalanalysis).newthoughtsaboutconsciousness(the point of“I”and“me”identityelements)IntroductionvIdentity is who and what you are.vIdentity construction is a widely covered topic instudiesofdiscourse.vInthischapter,theauthorsfocusisamethodologicalonethatallowstheinvestigationofidentityconstructionfrom a slightly new perspective,a a multimodal multimodal approach.approach.vMy writing is first of all an extension of Scollons mediated discourse analysis(中介话语分析).vSecond,thisframework isstronglyinfluencedbytheworkofKress and van Leeuwen in multimodality.vBesidesthesetwomergingdirections,theframeworkofmultimodalinteractionanalysisdrawsoninteractional sociolinguistics of Goffman Gumperz,discourseanalysis as in Hamilton or Schiffrin and a historical approach of Wodak.Some BackgroundvTherefollowsabriefeclecticoverviewonpersonalidentityconstruction:vSchiffrinorHamilton-microdiscursiveconstructions,suchaspronounuseandshowhowindividualsestablishthemselvesasbelongingtoonegrouporanother.vWodak-combiningtextanalysiswithnarrativeandinterviewanalysisonnationalidentityconstructionandplacingitintoahistoricalperspective.vHall and Bucholztrying to encompass socialpsychological and socialcultural forces onanalyzingapersonsuseoflanguage.vWhatalloftheseapproachestoidentityhaveincommon is their concentration on language(spokenorwritten).Itisthispointthatcreatestheopportunityforthischapteronmultimodalpersonalidentityconstruction.Theoretic argumentvPrioritizingoflanguagemaylimitourunderstanding of interaction and it also maylimit our understanding of personal identityconstruction.vI untilize and build on the micro analyticalapproach,forexample,usetoanalyzespokenlanguage but take multiple embodied modessuchasposture,gestureandheadmovementintoconsideration.vFurther,I investigate disembodied modes suchaslayout(布局设计)andobjects.vIdentityisnotformedincohesivewholesbutassituationallygroundedandco-constructedidentity elements.When speaking of identityelementsIamthinkingofan analogy(类比)withchemicalelementssuchasoxygen,hydrogen,orgold.(Pleaseturntopage134.)goldGenderidentityoxygenhydrogenOccupational identityvName:Tanya&LucyvOccupation:twoco-ownersofaweb-designbusinessvRelationship:colleagues&friendsAn examplevImage 1 illustratesthat the modes ofobject handling andspokenlanguagetakeon much weight forTanya.vHowever,objecthandlingandspokenlanguagearenottheonlymodesthatsheemploys.Her body pointing away from LucyNot to be fixed on any one particular point and may be termed a middle distance gaze.With legs crossedBeat gesturesBeat gesturesMoving her hands up Moving her hands up and down 8 timesand down 8 timesThesebeatgesturesarerhythmicallyorganizedwithherspokenlanguage,emphasizingparticularwords(thisinline2;allinline3;whateverinline4;email,and,fax,everythinginline5;alwaysinline6),and we may interpret thesegesturesasawayforTanyatoforce herself to givegive clearclearinstructionsinstructions,Six out of the eight times Six out of the eight times(lines 3 to 6),Tanya(lines 3 to 6),Tanya simultaneously performs simultaneously performs beats with her headbeats with her headHead movements start withwhatever(in line 3),gothroughherpointofinstruction email and fax everything(line 4)and endwithalways(line6).Thus,while the hand beatsgovern the coherence andspeedofherutterances,theheadbeatsbrackettheactualpointthatsheistryingtogetacross.HIGHMODAL DENSITY Object handling Spoken language Posture Gaze Gesture Head movement EMPLOYER IDENTITYvWhen we revisit thispicture,weseethatLucyislistening to Tanyas callandchimes(插话)inattheappropriate time,givingTanya the sentence andthen follow up with aphone call,which Tanyarepeats without losing herrhythmbysayingandthenAlways Always follow follow up up with with a a phone call.phone call.vWealsonoticethatlayout(布局设计)playsarole,withdesks,chairs and computers arranged as they are,making it easily possible for Lucy to overhear theconversationandtochime（插话）inwhenshedeemsitnecessary.vAccordingly,Tanya is interacting with two differentpeoplesimultaneously.vWhile she is interacting with her employee in theforeground of her attention,Tanya then co-constructsherco-owner identity together with Lucy in themid-groundofherattentionawareness.vBecause the sheep and the fence appear closer to us,we say theyre in the foreground foreground of the image.vThe foothills appear far away,so theyre in the background.background.vvMidgroundMidground,as you probably guessed,is how we describe parts of the image that appear to be deeper than the foreground but not so deep as the background.“M”is for the million things she gave me,“O”means only that shes growing old,“T”if for the tears she shed to save me,“H”is for her heart of purest gold,“E”is for her eyes,with love-light shinning,“R”means right,and right shell always be.Put them all together.They spell“Mother”,a word that means the world to me.M-O-T-H-E-RM-O-T-H-E-R By Howard JohnsonBy Howard JohnsonM M M M 代表她给予我百万样东西，代表她给予我百万样东西，代表她给予我百万样东西，代表她给予我百万样东西，O O O O 意味着她渐渐老去，意味着她渐渐老去，意味着她渐渐老去，意味着她渐渐老去，T T T T 是她为育我成人而洒落的颗颗泪滴，是她为育我成人而洒落的颗颗泪滴，是她为育我成人而洒落的颗颗泪滴，是她为育我成人而洒落的颗颗泪滴，H H H H 寓意她那金子般至纯至真的心灵，寓意她那金子般至纯至真的心灵，寓意她那金子般至纯至真的心灵，寓意她那金子般至纯至真的心灵，E E E E 是她那双闪耀着慈爱之光的眼睛，是她那双闪耀着慈爱之光的眼睛，是她那双闪耀着慈爱之光的眼睛，是她那双闪耀着慈爱之光的眼睛，R R R R 使我坚信她永远正确无误的言行。使我坚信她永远正确无误的言行。使我坚信她永远正确无误的言行。使我坚信她永远正确无误的言行。把这些字母拼在一起就是把这些字母拼在一起就是把这些字母拼在一起就是把这些字母拼在一起就是“母亲母亲母亲母亲”，一个于我犹如整个世界一样的词语。一个于我犹如整个世界一样的词语。一个于我犹如整个世界一样的词语。一个于我犹如整个世界一样的词语。An examplevThefollowingexcerptsthatIwilllookatindetailcomefromanextensiveethnographicstudy of two co-owners of a web-design businessthatIconductedoveraperiodoffourmonths.vDuringthistime,Ispentmostofthedayswiththetwowomen(whomIwillcallTanya and Lucy)duringworkhoursandalsospenttimewiththemattheirhomes.Ihavemetmanyoftheirfriends,caretakersoftheirchildren,husbandandex-husband,andtheirparents.vHere,IfocusonTanyaandhereverydayidentityconstruction,reviewingdatapiecesthataremundane(普通的，平凡的)andnotspecialinanyway.vIn thischapterI show how identityelementsareco-constructed in clock-time,are then moved inconsciousnessintomemoryandtoadifferentlevelofattentionandawareness.vHere,I illustrate two aspects:one,that the identityelements that reside in memory can(and do)shapeclock-time actions;and two,that there is a lag-timebetweentheendingofoneactionandidentityformationandthenext.vDigital literacyistheabilitytolocate,organize,understandandanalyzeinformationusingdigitaltechnology.vSchoolsarecontinuallyupdatingtheircurriculumfordigitalliteracytokeepupwithacceleratingtechnologicaldevelopments.Thisoftenincludescomputersintheclassroom,theuseofeducationalsoftwaretoteachcurriculum,andcoursematerialsbeingavailabletostudentsonline.