Real-Time Pitch Visualization with “Blinky" Sound-to-Light Conversion Device

• Ishii Kanato

  Tokyo Metropolitan University

• Kinoshita Yuma

  Tokyo Metropolitan University

• Wakabayashi Yukoh

  Tokyo Metropolitan University

• Ono Nobutaka

  Tokyo Metropolitan University

Abstract

In this paper, we propose a real-time pitch visualization system with a “Blinky" sound-to-light conversion device. A Blinky transmits sound information as the intensity of an onboard light-emitting diode (LED). In conventional research using Blinkies, sound intensity has been converted into light intensity without utilizing spectral information. In contrast, we focus on pitch information of sound in this study and realize real-time pitch visualization as a new application of a Blinky. The proposed system consists of seven Blinkies. Each Blinky calculates a chroma vector in real time, and a pitch is visualized by activating an LED on a Blinky. We modify each Blinky for a smoother frequency response. Experimental results in a real environment show that the proposed system classifies 12 pitch classes of a musical instrumental tone reproduced by a loudspeaker with high accuracy. Furthermore, it is shown that a Specmurt-based chroma vector calculation makes it possible to suppress overtone components in a chroma vector.

Journal

• Journal of Signal Processing

  Journal of Signal Processing 25 (6), 213-220, 2021-11-01

  Research Institute of Signal Processing, Japan

Keywords

• Blinky
• sound-to-light conversion
• acoustic signal processing
• chroma vector
• real-time pitch visualization

Details

• CRID: 1390571395581474304
• NII Article ID: 130008110101
• DOI: 10.2299/jsp.25.213
• ISSN: 18801013
• ISSN: 13426230
• Web Site: https://www.jstage.jst.go.jp/article/jsp/25/6/25_213/_pdf
• Text Lang: en
• Data Source:
  • JaLC
  • Crossref
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed