CubeHarmonic: A new interface from a magnetic 3D motion tracking system to music performance

Abstract

We developed a new musical interface, CubeHarmonic, with the magnetic 3D motion tracking system IM3D. This sys- tem precisely tracks positions of tiny, wireless, battery-less, and identifiable markers (LC coils) in real time. The Cube- Harmonic is a musical application of the Rubik’s cube, with notes on each little piece. Scrambling the cube, we get dif- ferent chords and chord sequences. Positions of the pieces which contain LC coils are detected through IM3D, and transmitted to the computer to recognize the status of the Rubik’s cube, that plays sounds. The central position of the cube is also measured by the LC coils located into the corners of Rubik’s cube, and, depending on the position, we can manipulate overall loudness and pitch changes, as in theremin playing. This new instrument, whose first idea comes from mathematical theory of music, can be used as a teaching tool both for math (group theory) and music (music theory, mathematical music theory), as well as a composition device, a new instrument for avant-garde per- formances, and a recreational tool.