Geometric response to audio. Real time. Grasshopper : Version 1
This is an attempt to program geometric manipulations based on feedback from audio in real time. Been curious since some time now, about the ability to “attach” a physical connotation to audio [like music for instance]. As part of this experiment, the first stage was an attempt to script a simple visualization in VVVV that responds to audio played back on the computer.
Audio input is analysed using the Fast Fourier Transform algorithm within VVVV [fft node]. Audio frequency scales up the height of boxes. ‘Low mid out’ value scales the boxes along the base plane. ‘High mid out‘ value is responsible for the color change and finally the ‘high out‘ value controls the rotation of the boxes about the vertical axis.
Audio played back is by the artist Zero and the song’s called PSP 12′.
Vodpod videos no longer available.
The next stage in this process was to stream the frequency values from VVVV into a text file that is being updated continuously in real time. This text file was further read inside grasshopper using a ‘Read File‘ component. These values are then utilized to manipulate the height of boxes inside rhino in real time. Currently, the test was attempted under simple conditions involving just the height of boxes. There seems to be a major jump in the processing power absorbed by rhino while attempting to update changes in real time. The setup seems to be clunky and slightly less responsive in updating the heights continuously.
The second artist performing here apart from Zero is Darude and piece is called “Sandstorm”.
All attempts so far have been directed towards studying responses in real time. However, it might be feasible to “record” audio input response on geometry as a static exercise, which would mean the possibility of attaching a physical connotation “form” to audio signals . It is quite early at this point of time to speculate whether this could have any architectural implications. However, what is definitely feasible (and this currently is already being implemented) is the development of an interactive response to audio signals in the real world.