Web apps a la Minority report?

Yes, I know, I have been lazy again with blogging. It was been a turbulent two months and I didn’t have much time. Anyhow, let’s go on. My past blog posts were all about AR, current and future developments with some examples. I didn’t get to play with it yet but something else popped up on my to do list.

While I was looking around for AR examples done with Flash and working with Papervision3D I had this idea… what if I could detect the motion of my hands through the web cam to move objects around in my Papervision3D application?

At first I thought it might be impossible to achieve with Flash but I still googled: flash motion detection. Woop I came across numerous post and most of the pointing me to two crazy guys Ohtsuka Masakazu and Mario Klingemann. Now Ohtsuka was crazy enough to port parts of OpenCV into ActionScript3 (the project is code named Marilena) and Mario improved parts of that port for performance, which enables Flash developers to perform facial recognition on still images and web cam. This technology even found its way into Facebook via an application.

Coming across this blew my mind literally and I started investigating on OpenCV and hand motion recognition which in turn blew my mind (or what was left of it) again, I realized that what I have been thinking is actually possible but yet to be implemented in ActionScript3. The most amazing part is that unlike Minority Report, this approach does not need any special gloves (although it would surely simplify development).

So here are a few videos I have found during my research. I am positive that the user experience on the web will drastically change in the next few years. AR, motion and object dedection, there is a huge amount of possibilities. Imagine a website with computer vision that would respond to your facial expression; try to cheer you up when you’re sad, calm you down when you’re angry and joke with you when you’re happy.

This first video is pretty much the most impressive that I found so far. Big kudos for this kid.

Could body motion recognition the next version of the Wii?

Advertisements

Back

Finially… After a long long period of silence I got myself back together and now I’ll start to write again.

A few months ago I started to develop with Adobe Flex. Quite interesting and sort of easy to use but I got really interested when I stumbled upon Away3D and Papervision3D. Those two are 3D engines for Flash… yes… 3D and not like the good old Shockwave Flash. No, fully fledged “high” performance 3D engines even suitable to program little games with them. I was amazed by the capabilities of those two engines and directly dove into developing small test applications and I am currently working on two websites using Papervision3D.

I will post more in the next few weeks about my progress in developing those two applications but in the meantime you can check out some really cool websites developed with PPV3D and Away3D:

Away3D


Eminem’s new album has broken records, and this amazing interactive adventure website lets you discover and immerse yourself in Eminem’s sick musical world.

Some superb 3D User Interface ideas can be seen at AIRFORCE.com’s Supercar site.

Powerflasher’s “PDF Book 3D” tool uses Away3D to breathe fresh air into your run-of-the-mill 2D page flip book viewer

Papervision3D

Nascar and the United States Air Force, the work was performed for GSD&M Idea City out of Austin, Texas.

Site for a band that already broke up in 1986