Animation to Music

Thanks to MLT’s XML file format, It’s easy enough to edit the file to choreograph drums with a MIDI file.

Not only that, but filters can be animated to the beat of the music, e.g. pulsing the zoom of a clip with the beat or pulsing the brightness with the onset of each note. Here’s a low effort example!

I chose a midi with rapid changes in notes to test the consequences of running my code on a MIDI with notes that are more frequent than the zoom pulse period. Definitely have to keep an eye out for the tempo of the music since each pulse of the filter has to be spread over multiple frames to be appreciated, but they can meld into each other.

Here’s an extra. It’s animated to… some tempo, but without any music.

2 Likes