3D motion tracking display enabled by magneto-interactive electroluminescence

Abstract

Development of a human-interactive display enabling the simultaneous sensing, visualisation, and memorisation of a magnetic field remains a challenge. Here we report a skin-patchable magneto-interactive electroluminescent display, which is capable of sensing, visualising, and storing magnetic field information, thereby enabling 3D motion tracking. A magnetic field-dependent conductive gate is employed in an alternating current electroluminescent display, which is used to produce non-volatile and rewritable magnetic field-dependent display. By constructing mechanically flexible arrays of magneto-interactive displays, a spin-patchable and pixelated platform is realised. The magnetic field varying along the z-axis enables the 3D motion tracking (monitoring and memorisation) on 2D pixelated display. This 3D motion tracking display is successfully used as a non-destructive surgery-path guiding, wherein a pathway for a surgical robotic arm with a magnetic probe is visualised and recorded on a display patched on the abdominal skin of a rat, thereby helping the robotic arm to find an optimal pathway.