Abstract
In Japan, handwriting practice is an important part of education and often involves repeatedly writing the same character, which can become monotonous and reduce motivation. We propose a melody-based handwriting system that maps pen strokes to pitches and stops playback when the stroke leaves a predefined spatial gate, providing spatially-contingent auditory feedback that encourages accurate tracing while maintaining engagement. We implemented a browser-native, low-latency prototype that synchronizes visual input and audio in real time. In a controlled experiment comparing continuous feedback, restricted feedback (proposed), and no feedback, the proposed method led to slower, more attentive writing and a higher proportion of strokes within the designated range, indicating improved precision.
Artifacts
Information
Book title
ACM Multimedia Asia 2025 (MMAsia '25)
Pages
1 - 7
Date of issue
2025/12/09
Date of presentation
2025/12/11
Location
Kuala Lumpur, Malaysia
Keywords
Handwriting Practice / Auditory Feedback / Handwriting Training System / Educational Technology / Stroke Trajectory /Citation
Reo Hatogai, Sayuri Matsuda, Kento Watanabe, Satoshi Nakamura, Akiyuki Kake. Don't Break the Melody: Encouraging Accurate Handwriting Practice with Sound Feedback, ACM Multimedia Asia 2025 (MMAsia '25), pp.1 - 7, 2025.