Pick & place mobile manipulation

I am working on Stretch2 Robot and I am looking for a way to coordinate movement between the base and the arm of the robot. Essentially, I want the robot to be able to detect where an object is in a room, navigate toward it and pick the object up. I wanted to know the best way to go about the base + arm problem?

Hi @Igri, welcome to the Stretch forum! This is a common task to program Stretch to do. I’d recommend starting with the tutorials on our docs: Hello Robot! - Stretch Docs (especially Mapping & Navigation tutorial).

Then, I’d recommend trying Stretch AI, which demonstrates open vocabulary pick and place (essentially the task of coordinating the robot’s cameras, mobile base, and arm to find an object, navigate to it, and pick it up).

Hello, and thank you for the reply and for sharing the Stretch AI. That definitely helps!

1 Like