top of page
WechatIMG4974.jpg

VR Interactive Car for Disable People

Brief Discription

After witnessing infantile autism(ASDs) among disable people as they cannot easily get in touch with lots of entertainment, I decided to change this situation by developing new ways for game accessing. I designed a low-cost telepresence platform that lets users steer a real ESP32/L298 car from a simple Minecraft scene. Virtual buttons become compact 5-bit commands—11111 (forward), 01100 (left), 01000 (right), 00000 (stop)—sent via MQTT or ESP-Now to the car’s controller. Minecraft chat and coordinates provide friendly, real-time feedback, so users can practice virtually before moving in the real world. The modular design supports accessible home navigation, caregiver tele-assist, and classroom demos.

System Flowchart

Liquid Metal Gloove
Control System
ADC Circuit
​Single Chip Board
LoRa transparent module

Liquid Metal Glooves Controlling Vehicle

UART Serial Module
Robot Car Chassis
Vehicle
 
​Double Stepping Motor
​Execution System
​L298P Motor Drive
ESP 32 Single Chip
​Communication Module

Execution Timeline

Control System
​Execution System
​Signal Acquisition
Stepping Motor Control
​ADC collecting
Select the pins to obtain
5 available pins
GPIO Driving Program
Select the pins to obtain
6 available pins

​Signal Transmission

GPIO Signal Recieving

UART Program

​Communication protocol

Gloove System Deisgn

G

​Computer

G

​USB-- TTL 

Protocol

Rx

Tx

Tx

Rx

image.png
image.png

​MCU

image.png

Our glooves based gesture detection is performed on an integrated system placed in the back of the glove, powered from a flat Li-Po battery integrated under the wrist. Shown are four different gestures (out of the 22 we consider in the evaluation) including those that for most gloves are not easily distinguishable from each other.

Interactive Vehicle System Deisgn

ESP32 Car Main Control Board.png
WechatIMG4974.jpg
9AC7236E-42ED-40B3-BE81-544F819AA601_1_105_c.jpeg

​Main Design Steps

main control board

main control board

Main Control Board 3D simulation

image

image

Schematic Diagram for Vehicle

image

image

Physical circuit connection with Lora module

WechatIMG5034

WechatIMG5034

Liquid metal control glooves

WechatIMG5035

WechatIMG5035

Connect glooves with control MCU

Final Display.

Final Display.

We finally design two cars that can coordinate together with Minecraft game and controlling with glooves.

Connect Vehicle with Minecraft and Redstone Circuits

image.png
image.png

By connecting with Minecraft redstone circuits, the liquid-metal glove can not only control the car independently through different hand gestures, but can also link to virtual games, allowing even patients with limited hand mobility to enjoy gaming and experience the appeal of virtual reality interaction.

  • GitHub

 

© 2025 by Zimingwang.

bottom of page