Reality Plane is a haptic tablet using Hololens, Vuforia and BLE bridging the gap between the virtual and reality, allowing new interactions with a familiar interface. "The physical plane, in emanationist metaphysics taught in Neoplatonism, Hermeticism, Hinduism, and Theosophy, refers to the visible reality of space and time, energy and matter" As we subscribe ourselves to worlds created or altered in Virtual or Augmented Reality, we are leaving and redefining our current plane of reality. In this mode of transition, it will become important to explore how our existing bodies simultaneously interact with physical and virtual environments. The Reality Plane begins to explore our interaction in Mixed Reality through added sensory cues in a familiar input device, a tablet.
To build the haptic response component, we used the following hardware
We did some experiments to balance the weight and improve the resonance of the haptic feedback through the tablet. The marker size was especially challenging because of the small viewport restriction of Hololens and the desired tracking quality we wanted to achieve.
Reality Plane presents a completely blank surface onto which information can be projected in mixed or virtual reality. It has the potential to support natural interactions (touching, sliding, pinching, et cetera) and provides haptic feedback for interactions. Developers can create their own experiences while users experience a more natural mode of interactions (as compared with air gestures or game controllers) The orientation of the Reality Plane allows for different types of information to be displayed. In the demo game we created, when orientated horizontally a game map appears and displays the location of crystals to collect. Vertical orientation allows you to engage with the crystals that are floating in your environment. When you catch the crystals you simultaneously feel a buzz and hear the sound that each crystal emits.
Source code coming soon!