FUKUCHI Kentaro's web pages / Research


Laser Trail Tracker: Laser pointers tracking system with special emphasis on the shapes of a laser trails

Index

Background

Interactive techniques to improvise a live visual image are important for a stage performance. Nowadays using computers to generate realtime rendered computer graphics is very popular for those live performance, but the most of those systems are controlled via mice or keyboards, or something not better than a MIDI console, which are not attractive in front of a large screen.

The problem is that using such input devices in front of a large screen on the stage lacks a feeling of direct manipulation for a performer. Besides, for audiences, it is difficult to recognize the relationship between a body action of the performer and the result on the screen. In addition, it is not so entertaining to see shaking a mouse or tapping a key.

By contrast, let us consider a musician's performance at a live stage. For example, body action of a guitarist (e.g. neck bending or wailing) itself is a performance, and the relationship between the action and the sound is clear for audiences.

On the other hand, In the contemporary computer music field, the lack of performance of "laptop music" becomse a problem too. To solve it, there is a conference titled "New Interface for Musical Expression (NIME)" and many artists, researchers and engineers are involved to it.

The goal of this research is to improve interaction part of live visual performance.

L.T.Tracker Overview

Our laser tracking system "Laser Trail Tracker (L.T.Tracker)" recognizes laser trails and thier motions drawn on a screen with laser pointers. When a visual reflecting those laser stroke is shown on the screen, it seems to be generated via direct interaction to the screen.


L.T.Tracker system overview

There is a camera in front of a screen to capture it. The system extracts laser trails from a camera image and track their motions by using simple image processing and recognition techniques. Finally, a visual processor makes a visual from those information and projects on the screen.

Features

There are many previous works on laser-based interaction, but our system is distinct from those systems in the following features.

Samples

As seen in the figures, you can display the same color to the laser pointer on the screen. Of course, you can use other colors than green.

Demo video clips

High definition version (mp4, 40 megabyte)

These movie files are published under Creative Commons, Attribution-ShareAlike 2.0.

Sound track: "U R Ritdum (Original Mix)" by Laurie Laptop (cc) 2004

Application

Some records of the stage performances with this system are shown in this page in the works section.

Publications


Spectrum is green.

Captain Scarlet, from TV series "Captain Scarlet"

She's a killer queen gunpowder gelatine
Dynamite with a laser beam
Guaranteed to blow your mind

Queen, Killer Queen from "Sheer Heart Attack".

FUKUCHI Kentaro (E-mail address is here)