You are here

Vision for Augmented Reality


Main activities

This activity focuses on the development of algorithms for the detection of landmarks naturally embedded in the scene.

We develop algorithms devoted to the detection of text embedded in scenes, its segmentation from the background and its adjustment to facilitate its readability by an OCR engine. 

Our research focuses on image analysis to support precise alignment of geo-referenced information with the capturing camera view, where GPS and inertial measurements are used to support the registration with the visual environment.

Our activities focus on signal processing techniques for detecting user-customized gestures as well as recognising repetitive motion patterns such as occurring during work-out and sport activities.

Augmented Reality seeks to enrich the users view of the environment with relevant information. It has raised importance with the pervasive use of mobile appliances such as smart-phones. Our activities focus on low-complexity computer vision methods for analyzing images captured with mobile devices to aid AR services such as geo-referenced information overlay and indoor navigation.


one on GIM International Magazine, two on conferences:

  • Caterina Battisti, Stefano Messelodi, Fabio Poiesi 
    Seamless bare-hand interaction in Mixed Reality
    17th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany, October 2018

FBK Magazine (in Italian)

"Dai libri alla realtà aumentata: l’intelligenza artificiale per la didattica 2.0 della storia dell’arte"

  • N. Pretto, F. Poiesi
    Towards gesture-based multi-user interactions in collaborative virtual environments
  • E. Nocerino, F. Poiesi, A. Locher, Y.T. Tefera, F. Remondino, P. Chippendale, L. Van Gool
    3D reconstruction with a collaborative approach based on smartphones and a cloud-based server

LowCost 3D, Hamburg, Germany, 28-29 November 2017


REPLICATE for Cultural Heritage goal is the development of an eXtended Reality (XR) platform to make experiences within museums unique and engaging.

RELIGION TO GO! originates from an interdisciplinary reflection on the possible human impacts of creating virtual, 3D replicas of objects which hold religious beliefs.

Hand interactions are fundamental to enable natural collaboration and immersive experiences. This project deals with the creation of a distributed communication strategy to handle high-throughput visualisation data in collaborative virtual environments.

This project deals with the creation of a virtual reality (VR) setup that enables multiple users to participate in collaborative virtual environments and interact via gestures.

The CheForte project lead to the creation of an Android app that enables visitors to five of Trentino’s finest WWI fort sites to visualise the fort’s original structure over the existing remains, using Augmented Reality and their smartphones.

cReative-asset harvEsting PipeLine to Inspire Collective-AuThoring and Experimentation - REPLICATE enhances creativity through the integration of novel Mixed-Reality user experiences, enabling 3D/4D storyboarding in unconstrained environments and the ad-hoc expression of ideas by disassembling and reassembling objects in a co-creative workspace.

VENTURI - immersiVe ENhancemenT of User-woRld Interactions - aims at creating a pervasive Augmented Reality paradigm, where information is presented in a ‘user’ rather than a ‘device’ centric way.