handheld augmented reality

Augmented Reality Anywhere and Anytime   


   Social Augmented Reality

   Information Presentation

   Real-Time Self Localization

   Structural Modelling

   AR Graphics

   AR Navigation

   Augmented Reality Games

   Past Projects



   Hybrid SLAM

   Panorama SLAM

   Planar SLAM

   Model-Based Tracking

   Marker-Based Tracking


Software Libraries

   Studierstube ES

   Studierstube Tracker










   Student projects


   Site map


The Handheld Augmented Reality
Project is supported by the
following institutions:



Christian Doppler Forschungsgesellschaft


Graz University of Technology




Come to ISMAR 2011



Follow us on twitter

Graphics and Simulation for Augmented Reality


In Augmented Reality virtual content is embedded in the real-world. A major topic in AR Graphics is visual coherence. The goal of visual coherence is to create virtual content which becomes indistinguishable from real-world content. This is especially interesting from a perceptional point of view where the user experience is influenced by the visual representation. Moreover creating realistic renderings can also be used for automatic evaluation. For example a simulation of camera views can help to benchmark AR techniques such as tracking and to improve them.

The following projects deal with two topics. The first project is about simulating tracking targets for a detection benchmark. The results are further used to improve the physical tracking target object itself. The other project introduces a complete Augmented Reality stage set which is available in a digital form but also in a physical form. The purpose of this stage set in Augmented Reality Graphics is to aid the research on visual coherence.



Summary: Creating panoramic images in real-time is an expensive operation for mobile devices. Mapping of individual pixels into the panoramic image is the main focus of this paper, since it is one of the most time consuming parts. The pixel-mapping process is transferred from the Central Processing Unit (CPU) to the Graphics Processing Unit (GPU). The independence of pixels being projected allows OpenGL shaders to perform this operation very efficiently. We propose a shader-based mapping approach and confront it with an existing solution. The application is implemented for Android phones and works fluently on current generation devices.

Panoramic Mapping on a Mobile Phone GPU. Georg Reinisch, Clemens Arth and Dieter Schmalstieg, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2013

Panoramic Mapping on Mobile Phone GPUs. Georg Reinisch, Clemens Arth, Proceedings of CESCG 2013: The 17th Central European Seminar on Computer Graphics, 2013



Summary: In this work we present a novel idea of evaluating natural feature-point based tracking targets. Our main objective is to evaluate the inherent characteristics of natural feature-point sets with respect to vision-based pose estimation algorithms. Our work attempts to break new ground by concentrating on evaluating complete tracking targets, rather than evaluating tracking methods or single features. This allows deriving indications on how to improve the trackability of natural feature point sets.

Evaluating the Trackability of Natural Feature-Point Sets
. Lukas Gruber, Stefanie Zollmann, Daniel Wagner and Dieter Schmalstieg, 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 19-22 Oct. 2009

Optimization of Target Objects for Natural Feature Tracking. Lukas Gruber, Stefanie Zollmann, Daniel Wagner, Tobias Hollerer and Dieter Schmalstieg, 2010 20th International Conference on Pattern Recognition (ICPR), 23-26 Aug. 2010



Summary: We describe the design and implementation of a physical and virtual model of an imaginary urban scene - the City of Sights - that can serve as a backdrop or stage for a variety of Augmented Reality (AR) research. We argue that the AR research community would benefit from such a standard model dataset which can be used for evaluation of such AR topics as tracking systems, modeling, spatial AR, rendering tests, collaborative AR and user interface design. By openly sharing the digital blueprints and assembly instructions for our models, we allow the proposed set to be physically replicable by anyone and permit customization and experimental changes to the stage design which enable comprehensive exploration of algorithms and methods. Furthermore we provide an accompanying rich dataset consisting of video sequences under varying conditions with reference camera pose. We employed three different camera-pose reference data acquisition methods to support a broad range of use cases. The goal of our design is to enable and improve the replicability and evaluation of future augmented reality research.

The City of Sights: Design, Construction, and Measurement of an Augmented Reality Stage Set. Lukas Gruber, Steffen Gauglitz, Jonathan Ventura, Stefanie Zollmann, Manuel Huber, Michael Schlegel, Gudrun Klinker, Dieter Schmalstieg, Tobias Höllerer, 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 13-16 Oct. 2010





copyright (c) 2014 Graz University of Technology