The newly developed Robotic VR human-machine interface system can teleoperate the robot to imitate the user's actions to perform complicated tasks. (Credit: City University of Hong Kong)

An innovative human-machine interface (HMI) system, which consists of flexible, multi-layered electronic skin, provides both visual and haptic feedback to users. The system can teleoperate the robot to imitate the user's actions to perform complicated tasks, including conducting COVID-19 swab tests.

The HMI system links users to robotics or computers and plays a significant role in teleoperating robotics. However, conventional HMIs are based on bulky, rigid and expensive machines, and the lack of adequate feedback to users limits their application for conducting complicated tasks.

The advanced HMI system, named Robotic VR, is an integration of visual, auditory and haptic virtual reality (VR) via skin-integrated electronics. It uses a layout of multilayer stacking, where the bottom layer of skin-tone elastomeric silicon serves as a soft adhesive interface, which can be mounted on the skin and joints of the user. The layers are interconnected with a collection of chip-scale integrated circuits and sensing components, including resistors, capacitors, a Bluetooth module, a microcontroller unit (MCU), and soft sensors and actuators developed by the team.

The sensors of the Robotic VR system can accurately detect and convert subtle human motion into electrical signals, which are processed by the MCU and wirelessly transmitted to the target robot.

Source 

Topics:
AR/AI Artificial Intelligence Augmented/Virtual Reality Medical Robotics Surgical Robotics/Instruments

More From SAE Media Group

Medical Design Briefs
Designing Rugged Myoelectric Interfaces for Highly Functional Prosthetics
Related article image
Medical Design Briefs
Robot Sleeves Help Kids with Cerebral Palsy
Related article image
Motion Design
Head-Worn Assistive Teleoperation of Mobile Manipulators
Related article image
Electronics & Sensors INSIDER
Built For AI, This Chip Moves Beyond Transistors for Huge Computational Gains
Related article image