Second Place

FetchIt Mobile Manipulation Challenge at ICRA 2019

Zhao Han (PI), Jordan Allspaw, Gregory LeMasurier, S. Reza Ahmadzadeh (Faculty advisor), and Holly A. Yanco (Faculty advisor) Organizers: Fetch Robotics, EandM, SCHUNK, SICK, and The Construct May 22, 2019

We won second place in fetchit mobile manipulation challenge
Second place, Fetchit Mobile Manipulation Challenge
  • May 22, 2019

    Our RoboHawks team that I led took a solid second place in the inaugural FetchIt! Mobile Manipulation Challenge held at ICRA 2019 in Montreal! We plan to use it as a platform for our future research.

In the competition, a Fetch mobile manipulator robot autonomously navigates to stations in a narrow work cell to pick parts in irregular shape (screws, gears, gearbox parts) and machine large gears by inserting into a narrow chuck, transport and place them into a human-friendly caddy, and drop off the caddy on a specified region at inspection station.

The contest includes the full range activities commonly found in manufacturing environments. As the media reported, “While conceptually simple, combining autonomous mobility with robotic arm activity is extremely challenging, requiring complex interaction between the robot navigation, machine vision, arm operation and safety systems.”

Our Work

Our navigation code enables the Fetch robot to autonomously navigate in the narrow space and stop closely to tables for manipulation; compared to popular hard-coded solutions with the robot not aware of table obstacles. Our perception work is able to successfully and rapidly detect screws, small gears, gearbox parts and the almost symmetric caddies, which are all of irregular shape not commonly seen in academic work. Our manipulation work enabled safety, being able to avoid not only common obstacles – walls and tables – but also complex ones, e.g., the machine with door and a chuck inside.

Media coverageAPBusiness Wire


The narrow work cell with parts and machine on stations.
grasping small gear
Our robot grasped a small gear.
Fetch grasped a large gear
Fetch grasped a large gear
place into caddy
Our robot is placing gearbox top into caddy.
insert large gear into chuck
Our robot inserted a large gear into chuck.


fetch robotics logo
EandM logo
Schunk logo
SICK logo
The Construct logo