top of page
LOGO.png

Gazed-controlled Fetching Robot

 

Puhe Liang / Yu Qin / Shenli Yuan

2018 UIST Student Contest

 

 

 

Toolkit

 

 

 

 

 

 

 

 

 

 

 

 

Interaction

Using eye movement to control the movement of a robot.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Technical Anatomy

​​

 

 

ToolKit.png
interaction.png
tech.png

Eye Movement  Detection

ARKit + iPhoneX Depth Camera

  1. Implemented ARKit2 App on iPhoneX to capture the direction of eye movement in order to control a fetching robot’s moving.​

​

​

Robot Movement Control

Makeblock Robot Kit (Arduino)

  1. Send the direction of eye movement to Robot via Bluetooth

  2. Transform the direction of eye movement to the rotation degree of the motor on the Robot.

  3. Robot moves and stops when detecting the target via ultrasonic sensor

  4. Fetch the target and back to the original 

Future Add-On

Machine Learning / Object Recognition + Route Caculation

Similar Works​

VR 3D MODELING

VR 3D MODELING

HTC VIVE + Unity 3D

Gazed-controlled Fetching Robot

Gazed-controlled Fetching Robot

ARKit + Ardunio

VR Resume

VR Resume

A-frame

VR Mandarin Learning  APP

VR Mandarin Learning APP

Physical Prototype + Unity 3D

AR Grocery Shopping

AR Grocery Shopping

A-Frame

AR Inspiration Collector

AR Inspiration Collector

A-Frame + Space AR

Future Workspace

Future Workspace

Personal Research Project

AR Drawing

AR Drawing

Keynote

AR Reading

AR Reading

Keynote

Power Strip Redesign

Power Strip Redesign

Rhino + Keyshot

AR Picture Book

AR Picture Book

Designer + Prototyper

bottom of page