Engineers at Glasgow University have developed a new system that creates the sensation of physical touch when interacting with holographic projections.
Named ‘aerohaptics’, the system pairs volumetric display technology with precisely controlled jets of air to create the sensation of touch on users’ hands, fingers and wrists. Researchers hope the EPSRC-funded project could lead to advances in remote interaction, such as in teleconferencing and surgical applications.
Developed by the university’s Bendable Electronics and Sensing Technologies (BEST) research group, the system is based around a pseudo-holographic display which uses glass and mirrors to make a 2D image appear to hover in space — a modern variation on a 19th century illusion technique known as Pepper’s Ghost.
It pairs a leap motion sensor to track users’ movements with a moveable air nozzle to direct airflow to their palms and fingertips.
Published in Advanced Intelligent Systems, the team’s paper describes how they used the system to create a realistic sensation of bouncing a basketball. Pairing a computer-generated 3D image of a basketball with the leap motion sensor, the system varies the direction and force of the airflow to create aerohaptic feedback.
Users can reportedly ‘feel’ the rounded shape of the ball roll from their fingertips when it is bounced, and the slap in their palm when it returns, thanks to modulated feedback based on the ball’s virtual surface. Users can also push the virtual ball with varying force and sense the change in how hard the bounce feels in their palm, the team said.
Leader of the BEST group Prof. Ravinder Dahiya, who developed the system, said that whilst haptic feedback and volumetric display technology has advanced in recent years, current haptic tech still involves wearable or handheld peripherals which can be costly and complex, a barrier to widespread adoption.
“Aerohaptics creates a convincing sensation of physical interaction on users’ hands at a relatively low cost,” he said. “We are already looking into adding additional functionality to the system, such as adding temperature control to their airflow to deepen the sensation of interacting with hot or cool objects.”
Dahiya added that the system could form the basis for creating convincing, interactive 3D renderings of real people for teleconferences, and could help surgeons to perform procedures in virtual spaces or even command robots to perform surgeries.