[ACM Multimedia 2018 oral paper] Songle Sync

Songle Sync: A Large-Scale Web-based Platform for Controlling Various Devices in Synchronization with Music Jun Kato, Masa Ogata, Takahiro Inoue, Masataka Goto National Institute of Advanced Industrial Science and Technology (AIST) For more details, please visit The paper is available at --- This paper presents Songle Sync, a web-based platform on which hundreds of Internet-connected devices — including smartphones, computers, and other physical computing devices — can be controlled to synchronize with music playback. It uses music-understanding technologies to dynamically synthesize music-driven multimedia performances from a musical piece of choice. To simultaneously control hundreds of devices, a conventional architecture keeps always-on connections between them. However, it does not scale and suffers from latency and jitter issues when there are various devices with potentially unstable networks. We address this with a n