top of page

Gazed-controlled Fetching Robot
Puhe Liang / Yu Qin / Shenli Yuan
2018 UIST Student Contest
Toolkit
Interaction
Using eye movement to control the movement of a robot.
Technical Anatomy
​​



Eye Movement Detection
ARKit + iPhoneX Depth Camera
-
Implemented ARKit2 App on iPhoneX to capture the direction of eye movement in order to control a fetching robot’s moving.​
​
​
Robot Movement Control
Makeblock Robot Kit (Arduino)
-
Send the direction of eye movement to Robot via Bluetooth
-
Transform the direction of eye movement to the rotation degree of the motor on the Robot.
-
Robot moves and stops when detecting the target via ultrasonic sensor
-
Fetch the target and back to the original
Future Add-On
Machine Learning / Object Recognition + Route Caculation
Similar Works​
bottom of page