Research Output

A multidimensional sketching interface for corpus-based concatenative synthesis.

  This paper presents Morpheme, a multidimensional interface that allows real-time control of concatenative synthesis through the act of sketching on a digital canvas. Morpheme extracts textural, spatial and volumetric features from a sketch developed by a practitioner and associates these to audio features for retrieval of audio units and to synthesis parameter for signal processing. Two mappings between audio and visual features were developed based on findings from previous studies that examined audio and visual feature correlation. One of the mappings is achromatic as the features extracted from the sketch are mainly volumetric and spatial, while the second mapping is chromatic as the features extracted from the sketch are based on color attributes. A number of simple algorithms are discussed that were developed to address three problems: (i) to estimate high level visual feature, (ii) set constrains in the audio corpus to improve the selection algorithm and the exploration of the corpus, and (iii) automatically adjust the weights to improve the efficacy of the selection algorithm in assessing similarity, by optimizing the algorithm in a corpus depended manner.

  • Publication Status:

    Published

  • Library of Congress:

    QA75 Electronic computers. Computer science

  • Dewey Decimal Classification:

    006.3 Artificial intelligence

Citation

Tsiros, A. (2012). A multidimensional sketching interface for corpus-based concatenative synthesis. In Proceedings of the International Conference on Auditory Display 2013

Authors

Keywords

Morpheme; multidimensional interface; concatenative synthesis; signal processing;

Monthly Views:

Available Documents