# The position or the shape of the object

**URL:** <https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489>\
**Category:** Knowledge Base\
**Created:** [April 21, 2026, 4:55pm UTC](https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489 "2026-04-21T16:55:23Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mallak\_Alqaisi](https://avatars.discourse-cdn.com/v4/letter/m/3ec8ea/32.png) [@Mallak\_Alqaisi](https://forum.hello-robot.com/u/Mallak_Alqaisi)\
**Post date:** [April 21, 2026, 4:55pm UTC](https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489/1 "2026-04-21T16:55:23Z")

</div>

Hello,

Does the shape or position of an object affect the execution of a task? For instance, when running the command `python -m stretch.app.ai_pickup --use_llm` to pick up a book, I notice that the gripper fails to grasp the book if it is lying flat on the table; it is only able to pick it up if the book is standing upright. How, then, can I control the movement of the gripper?

---

<div class="post-metadata">

**Author:** ![Jason\_Koubi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.hello-robot.com/jason_koubi/32/1050_2.png) [@Jason\_Koubi](https://forum.hello-robot.com/u/Jason_Koubi)\
**Post date:** [April 21, 2026, 5:28pm UTC](https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489/2 "2026-04-21T17:28:59Z")

</div>

Hi @Mallak_Alqaisi,

Yes, the shape and position of an object can significantly affect the success of a grasp. When the book is lying flat on the table, the gripper has very limited space to get underneath it and fewer good grasp points, which makes it difficult to pick up. When the book is upright, the robot can more easily detect edges and perform a stable side grasp.

Regarding control of the gripper: when using  
`python -m stretch.app.ai_pickup --use_llm`,  
the grasping motion is automatically determined by the perception and grasp planning system, so it is not directly user-controlled.

However, you can influence the behavior in a few ways:

- Place the object near the edge of the table or slightly tilted to improve accessibility
- Reposition the robot to approach from a different angle
- Try running the command multiple times, as small perception differences can affect the result

If you need more direct control over the gripper motion (for example, specifying the approach direction or grasp strategy), this would require using teleoperation tools or lower-level control APIs rather than `ai_pickup`.

Best,  
Jason

---

<div class="post-metadata">

**Author:** ![Mallak\_Alqaisi](https://avatars.discourse-cdn.com/v4/letter/m/3ec8ea/32.png) [@Mallak\_Alqaisi](https://forum.hello-robot.com/u/Mallak_Alqaisi)\
**Post date:** [April 21, 2026, 5:46pm UTC](https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489/3 "2026-04-21T17:46:42Z")

</div>

Can you help me of how can i do that by using APIs ?

---

<div class="post-metadata">

**Author:** ![Jason\_Koubi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.hello-robot.com/jason_koubi/32/1050_2.png) [@Jason\_Koubi](https://forum.hello-robot.com/u/Jason_Koubi)\
**Post date:** [April 21, 2026, 6:45pm UTC](https://forum.hello-robot.com/t/the-position-or-the-shape-of-the-object/1489/4 "2026-04-21T18:45:23Z")

</div>

Yes, absolutely. If you want direct control over the gripper motion, you would need to use a lower-level interface instead of `python -m stretch.app.ai_pickup --use_llm`, since that command handles the grasp automatically.

A good option is to use the ROS 2 APIs here:

1. **Motion commands in ROS 2**  
This lets you manually command individual joints:  
[https://docs.hello-robot.com/0.3/ros2/jogging/](https://docs.hello-robot.com/0.3/ros2/jogging/?utm_source=chatgpt.com)
2. **Follow Joint Trajectory**  
This is useful if you want to script a full grasp sequence step by step, for example:

- move the lift and arm into position
- rotate the wrist
- open the gripper
- approach the object
- close the gripper  
[https://docs.hello-robot.com/0.3/ros2/follow\_joint\_trajectory/](https://docs.hello-robot.com/0.3/ros2/follow_joint_trajectory/?utm_source=chatgpt.com)
