The illusion of 3D is kind of ruined the moment you reach out and try and grab whatever silly thing is supposed to be protruding from the screen. Researchers at Keio University in Tokyo have started to figure out a solution to the problem, and are calling their system RePro3D. By combining a glasses-free 3D display with an infrared tactile interface, they are able to create a holographic model that responds when "touched." The next step for the team is to provide feedback via a wearable device, adding the sensation of touch to the already impressive illusion of interactivity. We do have our concerns about the researcher's motives however.
Engadget, RePro3D is a 'touchable' 3D interface that lets you poke pixies (video)