MULTI-CHANNEL NATURE AND MULTIMODALITY OF PERCEPTION IN A SIMULTANEOUS INTERPRETER’S COGNITIVE ACTIVITY
Chistova Elena Viktorovna
Siberian Federal University
Submitted: 04.07.2019
Abstract. The article aims to develop a conceptual model of the mechanism to perceive multi-channel and multi-modal input in simultaneous translation. The originality of the study lies in the fact that simultaneous translation is considered as a translation phenomenon in the context of the cognitive and activity based approach. The findings indicate substantial transformation of the simultaneous translation cycle and, consequently, the conceptualization of the simultaneous translation process should necessarily include both audio-verbal and visual channels of perception.
Key words and phrases: теория перевода, когнитивное переводоведение, когнитивное событие, визуальная информация, обработка, перевод, theory of translation, cognitive translation studies, cognitive phenomenon, visual information, processing, translation
Open the whole article in PDF format. Free PDF-files viewer can be downloaded .
References:
Aleksandrova E. M., Berendyaev M. V. i dr. Perevod i lokalizatsiya: opyt razrabotki professional'nogo standarta. Krasnoyarsk: Sibirskii federal'nyi un-t, 2019. 190 s.
Konina A. A., Chernigovskaya T. V. Sinkhronnyi perevod kak ekstremal'nyi vid kognitivnykh protsessov (obzor eksperimental'nykh issledovanii) // Voprosy psikholingvistiki. 2018. № 38. S. 178-204.
Chesterman A. Models of What Processes? // Describing Cognitive Processes in Translation / ed. by M. Ehrensberger-Dow et al. Amsterdam, PA: Benjamins, 2015. P. 7-20.
Diriker E. De-/Re-Contextualizing Conference Interpreting: Interpreters in the Ivory Tower? Amsterdam, PA: Benjamins, 2004. 223 p.
Gerver D. Empirical Studies of Simultaneous Interpretation: A Review and a Model // Translation, Application and Research / ed. by R.W. Brislin. N. Y.: Garden Press, 1976. P. 165-207.
Groh J. M., Werner-Reiss U. Visual and Auditory Integration // Encyclopedia of the Human Brain: in 4 vols. San Diego: Academic Press, 2015. Vol. 4. P. 739-752.
Hervais-Adelman A., Moser-Mercer B., Golestani N. Brain Functional Plasticity Associated with the Emergence of Expertise in Extreme Language Control // Neuroimage. 2015. № 114. P. 264-274.
Hidalgo-Barnes M., Massaro D. W. Read my lips: An animated face helps communicate musical lyrics // Psychomusicology. 2007. Vol. 19. № 2. P. 3-12.
Jesse A., Vrignaud N., Cohen M. M., Massaro D. W. The processing of information from multiple sources in simultaneous interpreting // Interpreting. 2001. Vol. 5 (2). P. 95-115.
Kade O. Kommunikationswissenschafthche Probleme der ?bersetzung // Grundfragen der Ubersetzungswissenschaft. Beihefte zur Zeitschrift Fremdsprachen / hrsg. von A. Neubert. Leipzig: VEB Verlag Enzyklop?die, 1968. S. 3-20.
Levelt W. J. M. Monitoring and self-repair in speech // Cognition. 1983. № 14. P. 41-104.
Lu S. A., Wickens C. D., Prinet J. C., Hutchins S. D., Sarter N., Sebok A. Supporting interpretation management and multimodal interface design: Three meta-analyses of task performance as a function of interrupting task modality // Human Factors. 2013. № 55 (4). P. 697-724.
Lu S. A., Wickens C. D., Sarter N. B., Thomas L. C., Nicolic M. I., Sebok A. Redundancy gains in communication tasks: A comparison of auditory, visual, and redundant auditory-visual information presentation on NextGen flight decks // Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting. Cambridge, MA: MIT Press, 2012. P. 1476-1480.
Maragos P., Gros P., Katsamanis A., Papandreau G. Cross-modal integration for performance improving in multimedia: A review // Multimodal Processing and Interaction: Audio, Video, Text / ed. by P. Maragos, A. Potamianos, P. Gros. N. Y.: Springer, 2008. P. 3-48.
McGurk H., MacDonald J. Hearing lips and seeing voices // Nature. 1976. Vol. 264 (5588). P. 746-748.
Moreno R., Mayer R. E. Verbal redundancy in multimedia learning: When reading helps listening // Journal of Educational Psychology. 2002. Vol. 94. № 1. P. 156-163.
Schaffner C. Translation Research and Interpreting Research: Translation, Gaps, and Synergies. Clevedon, UK: Multilingual Matters, 2004. 136 p.
Seeber K. G. Cognitive approaches // Encyclopedia of Interpreting Studies. N. Y.: Routledge, 2015. P. 56-60.
Seeber K. G. Multimodal Processing in Simultaneous Interpreting // The Handbook of Translation and Cognition. John Wiley & Sons, Inc., 2017. P. 461-475.
Setton R. Simultaneous Interpretation: A Cognitive-Pragmatic Analysis. Amsterdam, PA: Benjamins, 1999. 399 p.
Steffensen S. V. Human interactivity: Problem-solving, solution-probing, and verbal patterns in the wild // Cognition beyond the Body: Interactivity and Human Thinking / ed. by S. J. Cowley, F. Vall?e-Tourangeau. Dordrecht: Springer, 2013. R. 195-221.
Toury G. Descriptive Translation Studies - and Beyond. Amsterdam, PA: Benjamins, 2012. 311 p.
Van Wassenhove V., Grant K. W., Poeppel D. Temporal window of integration in auditory-visual speech perception // Neuropsycologia. 2007. № 45. P. 598-607.
Wickens C. D. Processing resources in attention // Varieties of Attention / ed. by R. Parasuraman, R. Davies. N. Y.: Academic Rress, 1984. P. 63-101.
Русский
