In order to produce realistic simulations and enhance immersion in augmented reality systems, solutions must not only present a realistic visual rendering of virtual objects, but also allow natural hand interactions. Most approaches capable of understanding user interaction with virtual content can often be restrictive or computationally expensive. To cope with these problems, we demonstrate a method which employs user’s thumb and forefinger to interact with the virtual content in a natural way, utilizing a single RGB-D camera. Based on this method, we develop and realise an augmented reality chess game, focused on providing an immersive experience to users, so that they are able to manipulate virtual chess pieces seamlessly over a board of markers and play against a chess engine.


  • Augmented Reality
  • Virtual Object Manipulation
  • Human-Computer Interaction
  • 3D User Interfaces