Archive for September, 2009

mobile focus and AR zombies at a great metaio fair

Tuesday, September 29th, 2009

Yesterday metaio held their annual fair to show us their new developments and technologies live and interactively with the biggest fair they set up so far. 200 registered AR enthusiasts stormed their bright new offices to be overwhelmed with marker symbols, markeless tracking, applications, concepts and hardware presentations. I consider the day at their headquarters a big success and a nice event to meet AR people from all over the world. Let’s see, if they will put comments on it up in their blogs. But now I’d like to mention some cool things I’ve seen.

In an interesting welcome-introduction by Peter Meier and Thomas Alt they clearly put emphasis on the mobile scenario and that it’s the perfect device to do augmented reality. It’s the first time a consumer product integrates all different kinds of technology in a handy form factor. Clearly, metaio will focus on this idea more and quite a few demos could be seen using mobile phones, including a glance at junaio (later on).

I didn’t count the numerous demos, but every room was packed with new technology, AR prototypes and ideas. I will only list a few, since we (at the AR blogosphere) probably heard about Unifeye Design, magic card games, magic book concepts, their workflow engine, measure tools, furniture clients and the robotic arms fine-grain tracking systems before. :-)

metaio fair 3D feature tracking

Most interesting for me was their ongoing research on marker-free 3D tracking. During a calibration step some reference pictures of real geometry (a machine, a building) are taken and processed, extracting and aligning features found in the shots. Afterwards their tracking engine could find the camera’s position fast and robust. Translations and rotations didn’t have a significant impact or had different robustness during the demo, shown with a off-the-shelf tabletPC. We’ve seen this before, but the level it reaches 2009 is compelling and lets me already dream about a completely tracked downtown area, where GPS is still too inaccurate (and always will be). Unfortunately, it will take a little while longer, since too many feature points will slow down performance (esp. initialization, currently around 500 iirc). But we know, where we are heading (as usual a good comparison is Microsoft’s Photosynth in this area of 3D reconstruction).

metaio

As I said, a lot of production obviously went into their mobile platform and upcoming Unifeye mobile SDK. Fresh from R&D at metaio came the possibility to use a not-so-great Symbian phone, doing 2D feature tracking and showing a neat 3D object. We can see where they are taking us! To see their optimized algorithms on this already-pathetic hardware run smoothly was great, although poly count for 3D models is kept low and rendering, as usual on phones, has yet to improve. But besides there, of course, demos on the latest smartphones, including the iphone junaio demo: it seems to become a great AR browser, that displays social information on the go. They especially stress the social part of it, already today combining and integrating with pages as flickr, facebook, etc really nicely. Even if you don’t own an expensive smartphone you can participate. On the one hand, allowing fun acts as taking augmented snapshots and enriching photos and sights, but on the other the “regular” AR browser concept of adding air tags, to get directions, information, rankings for restaurants, etc. Unfortunately we couldn’t yet see the live camera AR system, but only through taken pictures and nobody was allowed to document their current status, but everything will be in your nearest AppStore on Nov, 2nd. Expect a bigger preview at ISMAR in Orlando! Special focus was laid on the GUI and the user experience as to foster actual augmentation - not only for show, but for the really added value through AR. But we have to be patient to see more of this one today…

metaio

What I like about metaio is the modularity of their software and the spread onto different devices and systems. A nice touch was the already-known web-based approach, but now I could see it done in Adobe Director’s tools, so that a web agency has little effort integrating AR into a scenario. Even physics were shown and AR seems to be usable with the flick of a switch.

The next thing I like about the crazy fellow Bavarians is their sense of humor, showing every guest as either Obama or chancellor Merkel. I don’t know why… but I turned out as Merkel. Maybe they integrated a brainwave decoder and displayed what is going on in the people’s heads! (The day before the German People re-elected Merkel.) Another neat add-on to metaio’s tracking portfolio, for sure. But maybe with other 3D heads in the future!

metaio zombies

And finally we were able to shoot zombies, crawling out of the gutter in a set-up horror room. This tech demo showed the capabilities of today’s smartphones and their mobile SDK. Another crazy idea these guys put up in no-time, but with too many crawling undead, it was more of a fire-and-forget situation. The rendering was too slow for an interactive experience, but positioning (using the G-sensor and computer vision for sideway movements tracking) went well.

I know this has only been a shallow abstract of the fair, but I hope I can get back to it and post a video or two. Gotta catch my flight now.

Thanks a lot to Peter, Thomas and their big team for the insight and driving AR technology!! (Ah, yeah, and thanks for the great time at the Oktoberfest, too! Maybe a Stein of beer less would have been enough. ;-))

Flyar to augment your twittering

Friday, September 25th, 2009

Another short update on a fun application from ydreams comes to your desktop for free: look at your screen as if it where a mirror (virtual mirror) and see floating birds chirping your twitter feeds out. Move them away through gestures and enjoy.

Gestures feel more like a bit chaotic PlayStation-EyeToy-waving and I don’t see added value for twitter besides “it’s so cute” (where I also sometimes ask where is the value for twitter? ;-)), but it’s another fun application. Why not. It would actually become more “useful” or “thoughtfully integrated” if we could see the system in a real mirror. E.g. you go to your bathroom in the morning and check out yourself and the latest information pops up without the need of a (visible) computer, where you place yourself in front actively. So I consider ydreams’ idea more as another concept for the yet-known new interaction paradigms and technology-integration-into-everyday-objects to come and forget about the twittering. :-)

Bummer

Thursday, September 24th, 2009

Dear AR-Community,

two bad news for AR and me floating in today.

First, Gamaray announced to stop developing their 3D-AR-Android-Browser. Due to the hard competition, e.g. Layar3D and the missing USP for gamaray now, they don’t see much use in putting effort into their technology. I hope, that Clayton Lilly and his team will have success with their other Android projects and maybe they will get back to AR one day? All the best.

Secondly, my company RTT is finally not willing to send me to the ISMAR to have an industry talk about our experiences and use cases and customer hopes. I consider this fair the biggest chance and melting pot for this great technology, that apparently left all its teething troubles a while ago. For me, there is such a great emerging field, where we can greatly contribute with our close-to-realism renderings at RTT, combined with AR. But tell that to the budget guys… a hard struggle. I’ts a shame and I’m fairly disappointed not to be able to share our ideas with you vis-a-vis for now. I’ll be online 24/7 watching all notes and snippets, Ori, Thomas and others will drop. Be sure to check out Thomas’ industry talk at ISMAR, though!

If your are in Munich on Sep, 28th, I’m sure we will meet at metaio’s fair and exchange AR thoughts there or drink an Oktoberfest beer afterwards. Looking forward to it.

Cheers!
- Tobias D. Kammann

Clever interoperability through OpenARML?

Wednesday, September 23rd, 2009

Layar's 3D demo with PacMan

With the rise of AR browsers for smartphones and other devices, the need or the advantage of standards rises as well. A nice move was made by Mobilizy, proposing an extension to the KML file format, tagging geo data. You can read their press release here and check out the fresh website for the eventually available and open standard for AR geo tags: www.openarml.org.

The documentation online is only an excerpt of what will come, so there might be answers for my open questions soon. If I missed out on it, please let me know.

  • will there be a way to define heights? this might be useful when a higher building has different tag-worthy elements on different floors, etc.
  • will there be a way to define orientation for tags? e.g. for placing 3D models (as possible with gamaray and the latest layar tech demo). also 3D-fonts for buildings might sometimes be better off not just facing the user’s point of view, etc.

I believe there is much more to come, but the current proposal seems to be a good start - from what I can tell so far. KML based approach sounds good, since the tags can still be viewed in applications such as Google Earth or Maps, but give additional value for mobile AR user.

Oh, and the picture doesn’t have anything to do with ARML, but is a shot from layar’s 3D demo. I just like PacMan so much and the reference to early AR work, too. ;)

Update: I had a talk with Markus Tripp from Mobilizy and height definition is integrated for sure, everything else… we have to wait and see.

Back to work

Monday, September 21st, 2009

Hi there,

I was unhooked from the computer world for the last ten days (it still works without!), so I’m getting back on AR right now. Currently, I’m still hoping that my company will approve my travel to ISMAR 09, where I’m invited to hold a talk about AR in the industry. Unfortunately I’m lead on another VR project here and everything is on knife’s edge right now - hope that I can squeeze it in. I cross my fingers to meet you all over there in Orlando and give you an insight on what we are doing here at research. You can already prepare yourself and look forward to Tom’s talk from Toyota’s point of view. :-)

In other news - besides all new funny AR marker demos, business card applications, etc. - Tonchidot gave a nice interview to Tish and metaio announced their mobile AR application for the iphone, coming Nov, 2nd: called junaio.

So, put on warm cloth for the upcoming AR winter, running around with your GPS-enabled phone, trying out all new layars and junaios! :-) I’ll keep you posted asap on the ISMAR. … still feels good to have my daily AR-RSSs and blogs back. ;-)

Nokia shows us their Augmented Reality Vision

Wednesday, September 9th, 2009

Please take a look at the fresh AR video, created by Nokia, that just went online. It is a pretty high quality production (well, it’s Nokia!), comparable to Microsoft’s interaction vision video. The video shows mixed reality (projection onto your living room, i.e. here the window) and AR goggles with gaze and finger gesture interaction. Unfortunately it’s not a near future scenario (or what is going on in their secret labs?), but it’s great to see high quality visualizations to convince everybody of the ideas and to get the hardware research rolling (well, more rolling).

The video does not show too much, though. Especially it does not show how the person interacts with the fingers (how are the gestures tracked?) and how the person would use the system for typing. (Selection of emotion done by gaze, but do we really can/want to type staring at letters?) But nevertheless, worth a look. A great piece of concept. Enjoy!

In other news…

AR Wiki

An augmented reality wiki just went online under www.AugmentedRealityWiki.com. Please go and check it out and contribute. I’m not sure if a special wiki is needed or it would be easier to just get a whole set of AR related topics inside of wikipedia going. Nevertheless, it shows that AR awareness is rising and that 2009 is the year of augmentation. :-)

AR Flashlight

Another new demo comes from fellow Bavarians from the Fraunhofer institute in Munich, showing a concept of an AR flashlight. It’s a pico projector combined with a webcam allowing to augmented your view through projected AR. I’m genereally keen on this concept, so have a look, too. Nicely done is the triggering of a button by holding your finger ontop of it for a second, waiting for a progress bar to fill up - to avoid accidental pushes.

Screw HMDs! Go for contact lenses!

Wednesday, September 2nd, 2009

AR Contact Lenses

Okay, I have to admit, this is a bit unfair. I’m waiting for slim HMDs like all AR enthusiasts. But there will still be restrictions, speaking about field of view, still the need for a device stuck to your nose, that can slip and destroy the overlay-position, etc. But in a future, far, far away, we could be able to get rid of our then-old cyberglasses and swap them for cyber contact lenses! Over a year ago, technology review already covered this topic on research at Washington. Now, fresh online, a detailled report on this emerging technology, written by Babak A. Parviz can be found here. Intereseting read, while we are waiting for the new iphone OS or new layar-layers. ;-)

IEEE coverage on AR contact lenses