Laser Trail Tracker: Laser pointers tracking system with special emphasis on the shapes of a laser trails



Interactive techniques to improvise a live visual image are important for a stage performance. Nowadays using computers to generate realtime rendered computer graphics is very popular for those live performance, but the most of those systems are controlled via mice or keyboards, or something not better than a MIDI console, which are not attractive in front of a large screen.

The problem is that using such input devices in front of a large screen on the stage lacks a feeling of direct manipulation for a performer. Besides, for audiences, it is difficult to recognize the relationship between a body action of the performer and the result on the screen. In addition, it is not so entertaining to see shaking a mouse or tapping a key.

By contrast, let us consider a musician's performance at a live stage. For example, body action of a guitarist (e.g. neck bending or wailing) itself is a performance, and the relationship between the action and the sound is clear for audiences.

On the other hand, In the contemporary computer music field, the lack of performance of "laptop music" becomse a problem too. To solve it, there is a conference titled "New Interface for Musical Expression (NIME)" and many artists, researchers and engineers are involved to it.

The goal of this research is to improve interaction part of live visual performance.

L.T.Tracker Overview

Our laser tracking system "Laser Trail Tracker (L.T.Tracker)" recognizes laser trails and thier motions drawn on a screen with laser pointers. When a visual reflecting those laser stroke is shown on the screen, it seems to be generated via direct interaction to the screen.

L.T.Tracker system overview

There is a camera in front of a screen to capture it. The system extracts laser trails from a camera image and track their motions by using simple image processing and recognition techniques. Finally, a visual processor makes a visual from those information and projects on the screen.


There are many previous works on laser-based interaction, but our system is distinct from those systems in the following features.


As seen in the figures, you can display the same color to the laser pointer on the screen. Of course, you can use other colors than green.


Some records of the stage performances with this system are shown in this page in the works section.