The Pixel Code » Augmented Reality

Color Marker Guided 2D Ribbons

Mohammed Khan — Sat, 23 Jan 2010 07:03:07 +0000

Last few days at work had been crazy, been spending almost 15 hours at office and getting back home early in the morning, blame it partly to offshore accounts and then to internal activities like rolling up a training program. After getting back home today (5AM in the morning), all I wanted to do before I kick-start my SNOOZY weekend, was to get this post up. For last few weeks we have been working on a AR concept, and you can say this just a small inspiration for me to work with Processing more often.

Processing is more like declarative creativity, it lets you program animation, illustrations and patterns using open source language, which can be executed within the Java Virtual Machine (JVM). This post and demo was alot inspired by James Alliban’s video post. I here used a simple live video color tracker and added the random 2D ribbons. As I am a dead meat now, will post further details in coming week, till then will await for your feedback and have a great weekend.

Color Marker Guided 2D Ribbons from Mohammed Khan on Vimeo.

Will update the source code here soon, need to work on the lag.

Augmenting Flex 3 Component using FLARToolKit & PaperVision3D

Mohammed Khan — Fri, 10 Jul 2009 17:26:32 +0000

In continuation to my last post, I finally got some time today to continue work on some examples for Augmented Reality using FLARToolKit and PaperVision3D. One thing that I wanted to try was augmenting flex components, and after working on it for some time, I learned that its possible to augment Flex components, but with the current implementation of FLARToolKit its not possible to interact with the component.

PaperVision3D lets you create a Material instance of type MovieMaterial, this can latter be added as the child to the Plane on which you would want to project your Flex component. When working with PaperVision3D, the instance creation starts with BasicView and ends with the Plane, and this is how the chain looks, BasicView -> Scene -> ViewPort -> Plane -> Material.

If you wish to try out the demo, firstly get the marker PDF printed and then go here. Below is the source code attached to explore and play around.

Simple AR Flex Component Demo Source Code

Augmented Reality using FLARToolKit and PaperVision3D

Mohammed Khan — Mon, 06 Jul 2009 11:05:19 +0000

Augmented Reality (AR) is combining real world objects with virtual ones (computer generated). Major experimentation with AR has been in field of video processing, where live video feeds are combined with 2D or 3D objects. The early impressions on AR came along with the the Java AR Toolkit called NyARToolkit, more info can be found here. Based on the NyARToolkit, the Flash AR Toolkit (FLARToolkit) was created to work with Flash and Flex. FLARToolkit has been clubbed with 3D programmatically authoring tools for Flash like PaperVision3D (pv3d) and Away3D to augment the the live video feeds with the 3D objects.

The simple principle behind the AR is that in the live video feed, a Marker needs to be placed in the live video feed and the application then does the image processing (breaks the video into BitMapData) to determine the Marker and match it with the pre stored marker pattern, which can be created using Adobe Photoshop. After determining the position of the marker in the video, the AR toolkit augments the 3D object.

I think to understand more about augment reality one needs to experience it, so kindly find a live demo here created using Flex 3, FLARToolkit and PaperVision3D. As I told earlier you will need a marker, so kindly print the following PDF which can be used as a marker with the live demo.

Simple AR Cube Demo Source Code