feat: first encounter orchestrator (Issue #400) #402

Merged

sl-jetson merged 2 commits from sl-jetson/issue-400-encounter-launch into main 2026-03-04 13:30:16 -05:00

Conversation 0 Commits 2 Files Changed 11 +1087

sl-jetson commented 2026-03-04 13:13:22 -05:00

Collaborator

Copy Link

State machine for unknown person detection and enrollment workflow. Detects unknown faces and manages: DETECT → GREET → ASK_NAME → SMALL_TALK → ENROLL → FAREWELL. Triggers Piper TTS at each step, captures STT responses for name and context, handles person interruptions gracefully by saving partial data, stores encounter metadata as JSON.

State machine for unknown person detection and enrollment workflow. Detects unknown faces and manages: DETECT → GREET → ASK_NAME → SMALL_TALK → ENROLL → FAREWELL. Triggers Piper TTS at each step, captures STT responses for name and context, handles person interruptions gracefully by saving partial data, stores encounter metadata as JSON.

sl-jetson added 1 commit 2026-03-04 13:13:23 -05:00

feat: first encounter orchestrator state machine (Issue #400) ... c85619b8da

Implement state machine for detecting and enrolling unknown persons.
Manages workflow: DETECT → GREET → ASK_NAME → SMALL_TALK → ENROLL → FAREWELL

Features:
- Subscribes to /saltybot/person_tracker for unknown face detection
- Unknown person threshold configurable (default: 30% confidence)
- State machine with Piper TTS triggers for each state
- Captures STT responses for name and conversation context
- Publishes /social/orchestrator/state for coordination with other nodes
- Handles person interruptions gracefully (walks away)
- Auto-enrolls person to face gallery (configurable)
- Stores encounter data as JSON in /home/seb/encounter-queue/
- Tracks duration, responses, interests, and enrollment success

Encounter data structure:
{
  person_id, timestamp, state, name, context, greeting_response,
  interests[], enrollment_success, duration_sec, notes
}

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>

sl-webui added 1 commit 2026-03-04 13:13:29 -05:00

feat: First Encounter social interaction launch (Issue #400) ... 86c60f48e6

Add encounter.launch.py orchestrating all First Encounter nodes:
- encounter_sync_service (offline queue backend)
- social_enrollment_node (face/voice enrollment)
- first_encounter_node (interaction orchestrator)
- wake_word_node (speech detection)
- face_display_bridge_node (UI frontend)

Include in full_stack.launch.py at t=9s with enable_encounter flag.
Add encounter_params.yaml with configurable greeting, TTS voice,
enrollment thresholds, database paths, and cloud sync settings.

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>

sl-jetson merged commit a9d66ddcc1 into main 2026-03-04 13:30:16 -05:00

sl-jetson referenced this issue from a commit 2026-03-04 13:30:17 -05:00

Merge pull request 'feat: first encounter orchestrator (Issue #400)' (#402) from sl-jetson/issue-400-encounter-launch into main

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

No items

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

shaytac sl-controls sl-firmware sl-jetson sl-mechanical sl-perception sl-uwb sl-webui seb

No Assignees

2 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: seb/saltylab-firmware#402

No description provided.