Conference Proceedings

Don't Break the Melody: Encouraging Accurate Handwriting Practice with Sound Feedback

Abstract

In Japan, handwriting practice is an important part of education and often involves repeatedly writing the same character, which can become monotonous and reduce motivation. We propose a melody-based handwriting system that maps pen strokes to pitches and stops playback when the stroke leaves a predefined spatial gate, providing spatially-contingent auditory feedback that encourages accurate tracing while maintaining engagement. We implemented a browser-native, low-latency prototype that synchronizes visual input and audio in real time. In a controlled experiment comparing continuous feedback, restricted feedback (proposed), and no feedback, the proposed method led to slower, more attentive writing and a higher proportion of strokes within the designated range, indicating improved precision.

Artifacts

Information

Book title

ACM Multimedia Asia 2025 (MMAsia '25)

Pages

1 - 7

Date of issue

2025/12/09

Date of presentation

2025/12/11

Location

Kuala Lumpur, Malaysia

Citation

Reo Hatogai, Sayuri Matsuda, Kento Watanabe, Satoshi Nakamura, Akiyuki Kake. Don't Break the Melody: Encouraging Accurate Handwriting Practice with Sound Feedback, ACM Multimedia Asia 2025 (MMAsia '25), pp.1 - 7, 2025.