Research Output

The dimensions and complexities of audio-visual association.

  This paper draws on literature from psychology, neuroscience, linguistics, and philosophy to portray a cross-modal conception of auditory and visual phenomena focusing on the similarities in form, structure, and function and exploring the links to perception, conception, and language. Through an extensive literature review, we identify issues related to audio-visual association and explore divergences and convergences between the two modalities. The aim of this paper is to examine how recent research findings from brain science could inform the theoretical and methodological approaches used for studying similarity of auditory and visual percepts in the context of designing multimodal interaction.

  • Date:

    01 September 2013

  • Publication Status:

    Published

  • Publisher

    BCS: Chartered Institute for IT

  • Library of Congress:

    QA75 Electronic computers. Computer science

  • Dewey Decimal Classification:

    005 Computer programming, programs & data

Citation

Tsiros, A. (2013). The dimensions and complexities of audio-visual association. In Electronic Workshops in Computing (eWiC)

Authors

Keywords

Perception; Cognition; Multimodality; Structure; Embodied Metaphor; Similarity; Multimodal Interaction;

Monthly Views:

Available Documents