feat: deaf/accessibility mode (Issue #371) #381

sl-jetson · 2026-03-03T18:51:26-05:00

sl-jetson commented

2026-03-03 18:51:26 -05:00

STT display (Whisper), touch keyboard (1024x600 MageDok), TTS via PulseAudio, web server @8080. Issue #371.

sl-jetson added 1 commit 2026-03-03 18:51:26 -05:00

feat: Implement deaf/accessibility mode with STT, touch keyboard, TTS (Issue #371 ) 5604670646

Accessibility mode for hearing-impaired users:
- Speech-to-text display: Integrates with saltybot_social speech_pipeline_node
- Touch keyboard overlay: 1024x600 optimized for MageDok 7in display
- TTS output: Routes to MageDok speakers via PulseAudio
- Web UI server: Responsive keyboard interface with real-time display updates
- Auto-confirm: Optional TTS feedback for spoken input
- Physical keyboard support: Both touch and physical input methods

Features:
- Keyboard buffer with backspace/clear/send controls
- Transcript history display (max 10 entries)
- Status indicators for STT/TTS ready state
- Number/symbol support (1-5, punctuation)
- HTML/CSS responsive design optimized for touch
- ROS2 integration via /social/speech/transcript and /social/conversation/request

Launch: ros2 launch saltybot_accessibility_mode accessibility_mode.launch.py
UI Port: 8080 (MageDok display access)
Config: config/accessibility_params.yaml

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>

sl-jetson merged commit 6df453e8d0 into main

2026-03-03 18:51:30 -05:00

sl-jetson referenced this issue from a commit

2026-03-03 18:51:32 -05:00

Merge pull request 'feat: deaf/accessibility mode (Issue #371)' (#381) from sl-controls/issue-371-accessibility into main

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: seb/saltylab-firmware#381