Kaan C. Fidan, Ihsan Kehribar, M. Tugce Sahin, Serhan Cosar, Devrim Unay
CSW 2010 - Computer Science Student Workshop
The aim of this paper is to present a novel system which tracks the motion of a drummer and generates the corresponding drum sounds. Only a camera, some colored markers and an everyday PC are used in the development of the system. The input video sequence from the camera is processed in real-time by using local and adaptive color segmentation and Kalman ﬁlter based tracking. The Kalman ﬁlter is used to predict the ”hits” so that we can overcome the processing delays and provide a morerealistic drumming experience. We use a local and adaptive search to detect the effective points of the drum sticks, which ensures robustness to background clutter and reduces the computational burden. We developed a working demo and evaluated its performance by comparing with the output signal of an electronic drum pad. We observed that the timing errors have an average of -8.4 ms and a standard deviation of 5.4 ms, where the two extreme values were 22.9 and 3.2 ms in a real drumming experiment consisting of 121 hits.