Activity 11: Playing notes by image processing

Results:

Using a simple score sheet we try to play a musical score using Scilab and a bit of image processing. From the score sheet in Figure 1. We slice the score sheets into images with each image containing a line of musical notes.

Figure 1: Sample Musical Score ( Tisket, Tasket)

We slice the image into staffs, remove the lyrics and the cleffs. Figure 2 shows the sliced images.

Figure 2: Sliced Musical Scores

We must create a reference path with the same size containing each type of the notes present in the score for us to use in finding the correlation of the notes. Figure 3 shows the notes for correlation.

Figure 3: Half Note basis(Top), Quarter Note Basis(Bottom)

By taking the correlation of the images we are able to determine the peaks and these correspond to the location of the notes. From these locations we are able to determine the type of the note and from the values of the correlation between these notes we are able to determine the duration of the playing time.

Click Here to Listen

References:

[1] M.Soriano, "Activity 11: Playing notes by image processing", AP 186, 2010

Self Evaluation: 10