summary multimodal refs summary query early january dear linguists anyone know work studies analyses multimodal reference e words picture interact refer texts thanks responsed among susan meredith burt robert dale karen emmorey sharon flank lisa frumkes sabine geldof james mcgilvray georgia green marti hearst richard hirsch sally jacoby pirjo karvonen john lee dick oehrle toshio ohori laurent romary deborah k ruuskanen roberta trites mats wiren background query group worked time multimodal input computer systems using combinations text direct manipulation point click gestures recently extended scope somewhat completed first running version speech interface 3 graphic virtual environment looking reference resolution interface currently process experimenting fooling surprised strong effects visual focus interactivity referent choice situations could construed ambiguous conversely certain constructions textual effects completely override visual gestural cues recently completed first stage project happy mail anyone copy first tentative report things turned led side track currently working statistical study tintin album l oreille cassee see pictorial mode text affects structure referential expressions jussi karlgren ivan bretan niklas frost lars jonsson 1995 interaction models speech interfaces virtual environments proceedings second eurographics workshop virtual environments realism real time monte carlo darmstadt fraunhofer igd integrating speech virtual reality technology done simultaneously several research groups several publications various sources works naturally multimodality human computer interface speech vision gestures fair amount work put investigating effects adding text input output graphical displays vice versa several studies made multimodal aspects humanhuman discourse spoken text form eye application humancomputer interaction several responses encouraged look studies children literature standard reference appears nodelman following list following list contains complete references sent far keep arriving may post revised version receive enough material naturally field diverse large list way even approximate breadth depth study area much work new hope use computer oriented work system descriptions empirical studies edwin bos carla huls wim claassen 1994 edward full integration language action multimodal user interface international journal human computer studies bf 40 473495 r chandrasekar ramani 1989 interactive communication sentential structure content alternative approach manmachine communication international journal man machine studies bf 30 121148 item philip r cohen 1992 role natural language multimodal interface proceedings acm symposium user interface software technology uist monterey pp 143150 steven k feiner kathleen r mckeown automating generation coordinated multimedia explanations ieee computer 24 10 3341 october 1991 interactive spoken dialogue interface virtual worlds christophe godereaux korinna diebel pierre olivier el guedj pierre nugues proc ling conc methods cscw london nov 94 govindaraju v srihari n sher b caption aided face location newspaper photographs proceedings 11th iapr international conference pattern recognition vol 1 computer vision applications hague netherlands 1992 los alamitos ca usa ieee comput soc press p 474 7 govindaraju v srihari n sher computational model face location based cognitive principles aaai92 proceedings tenth national conference artificial intelligence san jose ca usa 1992 menlo park ca usa aaai press p 350 5 item susann luperfoy 1992 representation multimodal user interface dialogues using discourse pegs proceedings 30th annual meeting association computational linguistics newark item johanna moore william r swartout 1990 pointing way toward explanation dialogue proceedings aaai boston dagmar schmauck deixis der mensch maschine interaktion multimediala referentenidentifikation durch naturliche und simulierte zeigegesten tubingen niemeyer 1991 wahlster w andre e finkler w profitlich h j rist plan based integration natural language graphics generation artificial intelligence 63 1 2 pp 387427 october 1993 less computer based work mainly humanhuman interaction studies although eye application humancomputer interface design item alphonse chapanis robert b ochsman robert n parrish gerald weeks studies interactive communication effects four communication modes behavior teams cooperative problem solving human factors 14 6 1972 487509 item alphonse chapanis robert n parrish robert b ochsman gerald weeks studies interactive communication ii effects four communication modes behavior teams cooperative problem solving human factors 19 2 1977 101126 item philip r cohen pragmatics referring modality communication computational linguistics 10 2 1984 97147 glenberg kruley p 1992 pictures anaphora evidence independent processes _ memory cognition _ 20 5 461471 glenberg mcdaniel 1992 mental models pictures text integration spatial verbal information _ memory cognition _ 20 5 458460 nelson goodman _ languages art _ _ routes reference _ georgia green margaret olsen interactions text illustration beginning reading technical report 355 center study reading university illinois champaign illinois hammel eugene 1972 myth structural analysis levi strauss three bears current topics antrhropology vol 5 module 26 1972 paages 129 neilson lee conversations graphics int journal human computer studies 40 1994 nodelman perry 1988 _ words pictures _ athens georgia university georgia press ochs e jacoby gonzales p 1994 interpretive journeys physicists talk travel graphic space configurations 2 1 151171 ochs e gonzales p jacoby forthcoming come domain state grammar graphic representation interpretive activity physicists e schegloff e ochs thompson eds grammar interaction cambridge university press thanks responded j jussi karlgren fil lic jussi karlgren sics se sw inst comp sc sics spr kteknologi natural language processing box 1263 164 28 kista ph 46 8 752 15 00 fax 46 8 751 72 30 stockholm sweden http sics se jussi jussikarlgren html