Bildton

Interactive tool for the musical interpretation of moving images
Bachelor Thesis 2020
Basel Academy of Art and Design HGK FHNW
Mentoring: Prof. Marion Fink, Jinsu Ahn, Ted Davis
Concept, Programming: Raphael Benz
Tools: HTML/CSS, P5.js

As part of my bachelor's thesis at the HGK Basel, I worked with the musical interpretation of moving images. As a visual designer and musician, I am interested in the interface between visual and auditory media.

The result of this research is a browser-based tool with which video recordings can be converted into sound in various modes. I am fascinated by the unexpected results that are produced and the rhythmic qualities of video recordings.

You can try out the tool here:
rbvonrb.github.io/bildton

Detailed documentation can be found here:
rbvonrb.github.io/bildton/doku/

Screen Capture of the final tool. Try it out at rbvonrb.github.io/bildton

Thesis presentation and live performance

Screenshots

Process Earlier experiments of turning image into sound.

Turning movement into sound by measuring the difference between two frames. This value controls a noise filter.

Turning image into a wavetable

First webbased prototype

← Prev Home Next →