Augmented Reality Anywhere and Anytime
The Handheld Augmented Reality
Come to ISMAR 2011
In 2007, Rohs et al. created a software for Symbian phones that tracks maps, which are outfitted with regular grids of dots, and tracked with 2.5 DOF [link]. Our map tracker is similar to this work but performs six degree of freedom pose estimation from almost any map or other uniquely textured planar object. Maps have to be prepared by adding small black dots that serve as reference point for tracking. These dots are small and cover only about 1% of the map's area. Hence the map remains mostly unmodified.
The map tracker has been implemented by adding two new sub modules to our Studierstube Tracker. Hence it can make use of Studierstube Tracker's advanced features such as fast feature detection and pose estimation. It runs on Windows Mobile and Symbian at frame rates of 15-30 fps for a complete application, depending on the phone and the application itself.
Although maps are planar and mostly viewed from afront, the map tracker treats this as a full six degree of freedom problem. It therefore allows rotating the map arbitrarily and tilting the phone to ~45°. This makes the map tracker suitable to track maps or other planar surfaces from almost any position. E.g. it is highly suited to be used for AR board (table top) games.
The following video show the map tracker in action running on an unmodified iPAQ smartphone. The map has a size of ~70x70cm and is made up of 9x9 dots (forming 8x8=64 cells to track). Tracking works as long as a at least a single cell is visible. The over application performance in this video is about 30fps. While the tracker ifself runs faster, the overal performance is limited by the framerate of the camera, which is 30fps.
Map tracking on an iPAQ smartphone.
A high quality version
The following video shows the same application (ported to Symbian) running on an Nokia N95 smartphone.
Map tracking on a Nokia N95 phone.
A high quality version
How does it work?
The map tracker has benn implemented using the regular Studierstube Tracker pipeline. Two new modules (called "features") have been added: a circle detector and a grid detector. At run-time the following steps are performed for every frame:
The map tracker has been developed as part of the IPCity project.
copyright (c) 2014 Graz University of Technology