hct logo part1UBC
department of ECE
HCT title
about_hctresearchpeopleopportunitiespublicationsresourcescontact
side menu top
music and sound
art and performance
physical interfaces
modeling
graphics
side menu end
hct logo part2
MetaMuse
A Novel Control Metaphor for Granular Synthesis
Image: MetaMuse in action A Project by
Ashley Gadd
Sidney Fels


Abstract
Downloads
- Publications
- Linux Software Tools
Overview
A Framework for Musical Expression
MetaMuse
Details
Contact Information

We built the MetaMuse system to explore the role that metaphor plays in developing expressive devices. MetaMuse is a prop-based system that uses the metaphor of rainfall to make the process of granular synthesis understandable. With MetaMuse we introduce a two-axis transparency framework that can be used as a predictor of the expressivity of musical devices. Metaphor depends on a literature, which forms the basis for making transparent device mappings. On this page you will find a brief introduction to MetaMuse, along with links to several papers with more detailed discussions of the system. You will also find downloads for three libraries that were designed and implemented for the project to parse data from devices on the serial port.

Downloads

Publications
CHI 2002

A Gadd and SS Fels. MetaMuse: A Novel Control Metaphor for Granular Synthesis. In Proceedings ACM Conference on Computer Human Interaction (CHI 2002), Minneapolis, April 2002.

NIME 2002

A Gadd and SS Fels. MetaMuse: Metaphors for Expressive Instruments. In Proceedings 2002 Conference on New Interfaces for Musical Expression (NIME 2002), Dublin, Ireland, May 2002.

OS 2002

SS Fels, A Gadd, and A Mulder. Mapping Transparency through Metaphor: Towards More Expressive Musical Instruments. To appear in Organised Sound: an International Journal of Music and Technology 7:2, 2002.


Linux Software Tools
Serial Port Library

The Serial Port library is a wrapper of the basic serial port functions for GNU/Linux. By creating a wrapper, the higher-level libraries can more easily be ported to a different architecture. Different serial ports can be handled by changing this library and linking to the new version.

After downloading this file, extract it using `tar zxvf serialPort-0.8.tar.gz', then check the enclosed README for further details.

Polhemus Library

The Polhemus library is a multi-threaded, protected library that parses data from a Polhemus Fastrak magnetic tracker into individual records. It then provides notification of the records through polling, callbacks, or the select() system call. The library is multi-threaded to allow the data stream to be parsed and callbacks to be run separately from the calling application.

After downloading this file, extract it using `tar zxvf polhemus-0.8.tar.gz', then check the enclosed README for further details. You will also need to download the Serial Port library; this library depends on it.

Cyberglove Library

The Cyberglove library is an adaptation of the Polhemus library for parsing data from the Virtual Technologies Cyberglove dataglove. See the Polhemus library description for more information.

After downloading this file, extract it using `tar zxvf cyberglove-0.8.tar.gz', then check the enclosed README for further details. You will also need to download the Serial Port library; this library depends on it.

Overview

MetaMuse is a prop-based instrument that uses the metaphor of rainfall to make the process of granular synthesis understandable. The sound of rainfall in nature comes from a process very similar to that of granular synthesis: short, discrete sound samples layered and overlapped to create a gestalt. MetaMuse was built to demonstrate the principle of ``transparency,'' a concept intended to facilitate the creation of expressive instruments.

A Framework for Musical Expression

We identify transparency as a quality of mappings, where a mapping is the connection between the input interface and output interface of a device. Similar to control intimacy, transparency provides an indication of the psychophysiological distance, in the minds of the player and the audience, between the input and output of a device mapping. The more transparent the mapping is, the more expressive the device can be. The degrees of mapping transparency for the player and audience form orthogonal axes of a graph into which devices can be placed. The position of a device in the graph acts as an indicator of its expected expressivity. New technologies, often being poorly understood, tend to sit in the opaque corner of the graph. (For further discussion of the concept of transparency, see the Organised Sound publication below.) Metaphor is one technique to facilitate moving from an opaque mapping to a transparent mapping. Metaphor enables instrument designers, players, and audience members to refer to cultural bases or elements that are ``common knowledge,'' which we call literature. By grounding a mapping in the literature, it is made transparent to all parties. Metaphor restricts and defines the mapping of a new device. Through metaphor, transparency increases, making the device more expressive.

MetaMuse

MetaMuse uses the metaphor of a falling particle impacting a surface and creating a sound as an interface to a granular synthesis engine. This choice of metaphor defines a class of instruments in the same way that choosing to excite a string with a bow identifies the class of traditional instruments that includes cello and violin. Props are used to control the particle model; the mapping of prop positions into physical model parameters and then into granular synthesis parameters defines the specific instrument within the class. Two props are used in MetaMuse: a watering can and a flat palette. The watering can affords the creation of particles through the motion of pouring, and acts as real-world pouring experience would lead the user to expect. The palette creates a surface on which the particles can impact. Once again natural parameters are used; for example, the velocity of the particle on impact affects the volume of the resultant sound.

Details

For more details, download one of the papers from the publications section on this page.

Contact Information

Ashley Gadd
Sidney Fels


Last up-dated: 03/05/2002
© 2002-2005 HCT
about_hctresearchpeopleopportunitiespublicationsresourcescontact