They just patented Sound-Into-Graphics:

United States Patent 6,898,759
Terada , et al. May 24, 2005
System of generating motion picture responsive to music

Abstract

In a system for animating an object along a music, a sequencer module sequentially
provides music control information and a synchronization signal in correspondence with
the music to be played. A parameter setting module is operable to set motion parameters
effective to determine movements of movable parts of the object.
An audio module is responsive to the synchronization signal forgenerating a sound
in accordance with the music control information to thereby play the music.
A video module is responsive to the synchronization signal for generating a motion image
of the object in matching with progression of the music. The video module utilizes the
motion parameters to basically control the motion image, and utilizes the music control
information to further control the motion image in association with the played music.