Flash Based Computer Vision

From HIT Lab NZ

Researchers:	Eva Artinger , Bettina Gruenzweil , Raphael Grasset
Date:	Feb 2008
Funding:

Computer vision is used for many projects. Mostly, programming languages like C++ and libraries like OpenCV, are used for it. With ActionScript 3.0, it is possible to access a connected camera in a flash movie. We built a class in AS3 for Flash Player 9 that simplifies the connection between the camera and the flash code.

Flash movies can be watched with the most browsers and at the most platforms. With Flash based computer vision nearly every user that owns a webcam can access those movies in the Internet without installing a new executable for every new application that uses a webcam.

In addition, the video files consist of code only, and therefore the downloaded files are very small although they show a 30 fps video.

The project can be used to apply video effects to material recorded by a webcam in real-time. It could also be used to create online games operated by gestures. The BitmapData API in Adobe Flash CS3 allows us to develop computer vision components like motion detection, motion buttons, skin recognition and many more. In combination with Papervision 3d (pv3d), a 3d engine for Flash, 3d models can be rendered and controlled by the webcam.

The demos developed for this project are motion detection, 2 real-time video effects and a simple computer vision game:

Motion detection The movement in the camera image is calculated and shown in another image.
Dot creator A video effect that creates colored dots from the video data. The size of the dots can be changed by a slider.
Split delay A video effect that splits the video in four different frames, calculates different time delays alternately and displays the delayed videos with color thresholding.
Simple motion detection game This game uses motion tracking to control the game character.

Click Here to view online demos.