Current Prototype Tutorial
The tutorial functions as an integrated, step-by-step guide featuring these characteristics:
Tutorial Features
- Auto-starts upon first app launch
- Toggleable via the H key
- Core teaching method: Sound-based instruction
- Primary controls taught:
- Tab - advance to next step
- Enter - activate command mode
- T - push-to-talk AI assistant
- Arrow keys - movement and rotation
Feedback Mechanisms
The tutorial provides distinct cues for spawn/landing, a short earcon when command mode opens, and clear wall signals for bumps or sliding along boundaries. These audio cues help users understand their position and available actions at all times.
Additional Features
- Recovery tools: Built-in help for when users get lost or disoriented
- Orientation shortcuts: "Where am I?" queries to get current location information
- Restart capability: Press F1 to restart the tutorial at any time
- Relaunchable guidance: Tutorial can be accessed again even after completion
Design Philosophy
The tutorial serves as scaffolding reducing cognitive load and replacing silence with ambient soundscaping while enabling independent exploration. Rather than simply providing instructions, it creates a supportive learning environment that helps users build confidence in navigating the soundscape.
Getting Started
To begin using Screen-to-Soundscape:
- Download the latest version from GitHub (v1.0.5)
- Launch the application - the tutorial will start automatically on first run
- Use headphones for the best spatial audio experience
- Follow the audio instructions to learn the basic controls
- Press H at any time to toggle the tutorial on or off
- Press F1 to restart the tutorial from the beginning
Key Controls Reference
| Key | Action |
|---|---|
| H | Toggle tutorial on/off |
| F1 | Restart tutorial |
| Tab | Advance to next tutorial step |
| Enter | Activate command mode |
| T | Push-to-talk AI assistant |
| Arrow Keys | Move and rotate in the soundscape |
Tips for Best Experience
- Use high-quality headphones for optimal spatial audio perception
- Find a quiet environment to fully immerse in the soundscape
- Take breaks if you feel fatigued - sound-based navigation can be cognitively demanding
- Don't worry about making mistakes - you can always restart the tutorial with F1
- Listen for the constant ambient sounds - "silence feels like being lost"
- Pay attention to surface sounds under your footsteps - they indicate what type of ground you're on