Person-following head tracking with RealSense #549

Closed
opened 2026-03-14 09:57:16 -04:00 by sl-jetson · 0 comments
Collaborator

Implement ROS2 node for automatic person-following head tracking using RealSense D435i.

Requirements:

  • Subscribe to person detection bounding boxes (from perception pipeline)
  • Compute pan/tilt angles to center detected person in frame
  • Publish gimbal commands to /saltybot/gimbal/cmd
  • Smooth PID tracking (avoid jerky motion)
  • Lost-target behavior: hold last position for 3s, then return to center
  • Priority: closest person, or person with highest confidence
  • Configurable tracking speed and deadband

Deliverables:

  • ROS2 Python package: saltybot_head_tracking
  • Launch file + params YAML
  • Depends on gimbal control node

Assigned to: sl-perception

Implement ROS2 node for automatic person-following head tracking using RealSense D435i. **Requirements:** - Subscribe to person detection bounding boxes (from perception pipeline) - Compute pan/tilt angles to center detected person in frame - Publish gimbal commands to /saltybot/gimbal/cmd - Smooth PID tracking (avoid jerky motion) - Lost-target behavior: hold last position for 3s, then return to center - Priority: closest person, or person with highest confidence - Configurable tracking speed and deadband **Deliverables:** - ROS2 Python package: saltybot_head_tracking - Launch file + params YAML - Depends on gimbal control node Assigned to: sl-perception
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: seb/saltylab-firmware#549
No description provided.