seb/saltylab-firmware
1
0
Fork 0
Code Issues Pull Requests 3 Actions Packages Projects Releases Wiki Activity

feat: Add gesture recognition system (Issue #454) #461

Merged
sl-jetson merged 1 commits from sl-webui/sl-perception/issue-454-gestures AGit into main 2026-03-05 11:07:14 -05:00
Conversation 0 Commits 1 Files Changed 11 +909
sl-webui commented 2026-03-05 09:20:21 -05:00
Collaborator
Copy Link

Implements hand and body gesture recognition via MediaPipe on Jetson Orin GPU.

  • MediaPipe Hands (21-point hand landmarks) + Pose (33-point body landmarks)
  • Recognizes: wave, point, stop_palm, thumbs_up, come_here, arms_up, arms_spread
  • GestureArray publishing at 10–15 fps on Jetson Orin
  • Confidence threshold: 0.7 (configurable)
  • Range: 2–5 meters optimal
  • GPU acceleration via Jetson Tensor RT
  • Integrates with voice command router for multimodal interaction
  • Temporal smoothing: history-based motion detection (wave, beckon)

Co-Authored-By: Claude Haiku 4.5 noreply@anthropic.com

Implements hand and body gesture recognition via MediaPipe on Jetson Orin GPU. - MediaPipe Hands (21-point hand landmarks) + Pose (33-point body landmarks) - Recognizes: wave, point, stop_palm, thumbs_up, come_here, arms_up, arms_spread - GestureArray publishing at 10–15 fps on Jetson Orin - Confidence threshold: 0.7 (configurable) - Range: 2–5 meters optimal - GPU acceleration via Jetson Tensor RT - Integrates with voice command router for multimodal interaction - Temporal smoothing: history-based motion detection (wave, beckon) Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
sl-webui added 1 commit 2026-03-05 09:20:21 -05:00 
Implements hand and body gesture recognition via MediaPipe on Jetson Orin GPU.
- MediaPipe Hands (21-point hand landmarks) + Pose (33-point body landmarks)
- Recognizes: wave, point, stop_palm, thumbs_up, come_here, arms_up, arms_spread
- GestureArray publishing at 10–15 fps on Jetson Orin
- Confidence threshold: 0.7 (configurable)
- Range: 2–5 meters optimal
- GPU acceleration via Jetson Tensor RT
- Integrates with voice command router for multimodal interaction
- Temporal smoothing: history-based motion detection (wave, beckon)

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
sl-jetson merged commit 270507ad49 into main 2026-03-05 11:07:13 -05:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
shaytac sl-controls sl-firmware sl-jetson sl-mechanical sl-perception sl-uwb sl-webui seb
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: seb/saltylab-firmware#461
No description provided.
Delete Branch "sl-webui/sl-perception/issue-454-gestures"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?