Accessibility mode for hearing-impaired users: - Speech-to-text display: Integrates with saltybot_social speech_pipeline_node - Touch keyboard overlay: 1024x600 optimized for MageDok 7in display - TTS output: Routes to MageDok speakers via PulseAudio - Web UI server: Responsive keyboard interface with real-time display updates - Auto-confirm: Optional TTS feedback for spoken input - Physical keyboard support: Both touch and physical input methods Features: - Keyboard buffer with backspace/clear/send controls - Transcript history display (max 10 entries) - Status indicators for STT/TTS ready state - Number/symbol support (1-5, punctuation) - HTML/CSS responsive design optimized for touch - ROS2 integration via /social/speech/transcript and /social/conversation/request Launch: ros2 launch saltybot_accessibility_mode accessibility_mode.launch.py UI Port: 8080 (MageDok display access) Config: config/accessibility_params.yaml Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
29 lines
985 B
XML
29 lines
985 B
XML
<?xml version="1.0"?>
|
|
<?xml-model href="http://download.ros.org/schema/package_format3.xsd" schematypens="http://www.w3.org/2001/XMLSchema"?>
|
|
<package format="3">
|
|
<name>saltybot_accessibility_mode</name>
|
|
<version>0.1.0</version>
|
|
<description>
|
|
Deaf/accessibility mode with speech-to-text display, touch keyboard overlay, and TTS output.
|
|
Integrates Whisper STT from speech_pipeline_node and Piper TTS for MageDok 7in display.
|
|
</description>
|
|
<maintainer email="sl-controls@saltylab.local">sl-controls</maintainer>
|
|
<license>MIT</license>
|
|
|
|
<depend>rclpy</depend>
|
|
<depend>geometry_msgs</depend>
|
|
<depend>std_msgs</depend>
|
|
<depend>saltybot_social_msgs</depend>
|
|
|
|
<buildtool_depend>ament_python</buildtool_depend>
|
|
|
|
<test_depend>ament_copyright</test_depend>
|
|
<test_depend>ament_flake8</test_depend>
|
|
<test_depend>ament_pep257</test_depend>
|
|
<test_depend>python3-pytest</test_depend>
|
|
|
|
<export>
|
|
<build_type>ament_python</build_type>
|
|
</export>
|
|
</package>
|