hct logo part1UBC
department of ECE
HCT title
about_hctresearchpeopleopportunitiespublicationsresourcescontact
side menu top
music and sound
art and performance
physical interfaces
modeling
graphics
side menu end
hct logo part2
KEYed User Interface
A music sequencing interface
LMNKui A Project by
Farhan Mohamed
Sidney Fels


Abstract
Downloads
- Publications
- Videos
- Posters
- Software
- Keyboard Mappings
Layout
Design
Details
System Requirements
Future Directions
Contact Information

Our primary goal is to reduce the need for keyboard and mouse during a music composing task. We accomplish this by moving the most commonly used computer keyboard macros and mouse functions to the MIDI controller keyboard. This allows the composer to work more efficiently. An example of a macro that can be relocated to the controller is the copy function, or [Control]-[C], which copies a highlighted sequence to the clipboard. To distinguish between keystrokes that represent a note and keystrokes that represent a macro, a momentary foot pedal is used as a mode switch.

Downloads

Publications
CHI 2002

Mohamed, F. and Fels, S. (2002). LMNKui: Overlaying computer controls on a piano keyboard. In Proceedings ACM Conference on Computer Human Interaction (CHI 2002), Minneapolis, April 2002.

ICMC 2002

Mohamed, F. and Fels, S. (2002). KEYed user interface: Tools for expressive music production. In Proceedings of the International Computer Music Conference (ICMC), Gothenburg, Sweden, pp. 88-91. International Computer Music Association (ICMA).

ASI 2001

Mohamed, F. and Fels, S., Extending Music Performance and Composition Using Two Novel Interaction Techniques, BC Advanced Systems Institute Exchange (ASI 2001), Poster presentation, March 18, 2001.


Videos
KEYed Video 1

A short video of the KEYed user interface
File Size: 33MB, File Type: .avi; Medium Quality (Indeo Video 5); Recommended for slower machines

KEYed Video 2

A short video of the KEYed user interface
File Size: 33MB, File Type: .avi; High Quality (MPEG4); Recommended for faster machines


Posters
CHI 2002

An interactive poster presented at the ACM Conference on Computer Human Interaction (CHI 2002), Minneapolis, April 2002.

ASI 2001

A poster presented at the BC Advanced Systems Institute Exchange (ASI 2001), Vancouver, March 2001.


Software
KEYed.exe

The executable for running the KEYed user interface prototype.

MIDIIO32.ocx

A library used for reading MIDI messages from external devices.

LMNK.dll

A library used for simulating keypresses, and to communicate with the Steinberg Nuendo music sequencing program.

KEYed.key

A set of key commands to be imported to your Steinberg Nuendo project.


Keyboard Mappings
KEYed Mappings

An outline of the current piano keyboard mappings used for various QWERTY keyboard and mouse functions, used in a Nuendo project. These mappings will be user customizable in our future prototypes.

Layout

KEYed User Interface setup

Layout

Design

The design of the layout incorporates the four sequencer windows most commonly used by the composer. The functions associated with each window map to a specific octave on the piano controller keyboard. For example, the transport octave is used to play, stop, record, mute, and solo a sequence or a specific MIDI channel. Please refer to the "Keyboard Mappings" section for details of the mappings.

For continuous parameters, we have integrated a single point touchpad. The touchpad is used for constrained vertical or horizontal actions, for a single degree of freedom task like sliding a fader, and to perform a full two degree of freedom task like drawing a modulation graph, as shown in the below figure.

Editing

Details

For more details, download one of the papers from the publications section on this page.

System Requirements

The following are the hardware and software requirements to run the KEYed user interface prototype:

  • Platforms Supported: Win2K, Win98
  • Steinberg Nuendo 1.5 for Windows
  • Any MIDI compatible piano keyboard
  • Cirque Glidepoint touch pad (serial port)
  • MIDI In/Out of the piano keyboard connected to a SB PC128 soundcard
  • MIDI thru of the piano keyboard connected to a SB Live! soundcard
  • A momentary foot pedal plugged into the foot switch port of the piano keyboard
  • Libraries MIDIIO32.ocx and LMNK.dll (Download from the "Software" section)
  • KEYed.exe file (Download from the "Software" section)
  • KEYed.key file (Download from the "Software" section)

Future Directions

  • Applying the design concepts to other musical instruments
  • User customizable piano mappings
  • Exploring musical structures for good mappings
  • Investigating different key boundaries

Contact Information

Farhan Mohamed
Sidney Fels


Last up-dated: 03/15/2002
© 2002-2005 HCT
about_hctresearchpeopleopportunitiespublicationsresourcescontact