Computer haptics is an emerging field focused on developing technologies for tactile sensation and haptic rendering. As the Metaverse expands and the demand for immersive experiences grows, the importance of computer haptics continues to increase. While significant advancements have been made in computer vision (CV) and computer audition (CA), partially driven by mature infrastructures like cameras and microphones, computer haptics (CH) remains in the infant stage.

In the Metaverse, where digital interactions aim to replicate real-world experiences, the lack of a reliable method to capture and process tactile sensations significantly limits the potential for truly immersive environments. For instance, while a player in a virtual basketball game can see and hear, the inability to feel the basketball’s texture, weight, and surface friction detracts from the overall experience. The challenge lies in the fact that, unlike visual and auditory technologies, there is no generic device that can acquire and process tactile data with the same functionality as human skin for computer haptics. This gap highlights the need for innovative solutions that can bring the sense of touch into the digital realm, enhancing immersion and making virtual experiences more lifelike.

Tactile Data Acquisition: First Step to Computer Haptics

Unlike CV and CA, which benefit from well-established devices and software, the tools and systems required to capture and render tactile sensations are still significantly underdeveloped. Bridging this gap necessitates the invention of new devices capable of acquiring tactile data, similar to how cameras capture visual information. To address this need, we have developed a bioinspired tactile scanner for computer haptics.

The bioinspired tactile scanner we developed in this work provides a method to capture tactile information that can be processed and used to recreate realistic haptic sensations. This work represents a critical step toward establishing the necessary infrastructure for computer haptics, enabling more natural and engaging interactions in virtual realities.

Mimicking Human Touch: Neuromorphic Engineering

To build such a tactile scanner, we draw inspiration from the biological tactile sensory system, particularly the electrophysiological processes that enable human skin to perceive and process tactile stimuli. A neuromorphic processing unit (NPU) is therefore designed and integrated into our tactile scanner to preprocess the captured tactile data, mimicking the tactile response of the human haptic nervous system.

From a mass production standpoint, the scanner is manufacturable using industrially-standard large-area thin-film transistor (TFT) production lines, allowing us to produce the device arrays and NPUs at scale. The neuromorphic circuits are designed to emulate the synaptic behaviors of neurons, processing tactile signals in the form of spikes. This bioinspired approach allows the scanner to capture and process complex tactile sensations in a manner that closely resembles biological systems, which is crucial for recreating realistic haptic sensations.

The processed tactile data can be then fed into haptic rendering systems to generate tactile stimuli that users can experience in virtual environments. This closed-loop system enables a level of interactivity and realism in the Metaverse that was previously unattainable.

Potentials and Perspectives: Enrich Virtual Realities

The potential applications of the proposed bioinspired tactile scanner are vast, spanning multiple domains within the Metaverse and beyond. In gaming, for instance, players could feel the distinct textures and properties of virtual objects, significantly enhancing immersion and engagement. In education and training, students and trainees could explore the tactile properties of virtual models—such as historical artifacts or biological specimens—in ways that were previously impossible. In telemedicine, doctors could conduct remote examinations with tactile feedback that closely mimics in-person interactions. As we continue to advance this technology, our future focus will be on enhancing its sensitivity, responsiveness, and integration with other sensory modalities to achieve a fully immersive experience in the Virtual Realities.

Conclusion: Toward Immersive Haptic Interactions

The introduction of such bioinspired tactile scanner marks a significant milestone in advancing computer haptics, paving the way for enhanced tactile experiences in the Metaverse. By capturing and processing tactile data in a manner that closely mimics the human sense of touch, this scanner establishes a foundation for more natural and intuitive interactions within digital environments. As the technology continues to evolve, we foresee a solid future where the Metaverse delivers experiences as rich and nuanced as those in the physical world, making virtual interactions more realistic than ever before.