Geometric response to audio. Real time. Grasshopper : Version 1
This is an attempt to program geometric manipulations based on feedback from audio in real time. Been curious since some time now, about the ability to “attach” a physical connotation to audio [like music for instance]. As part of this experiment, the first stage was an attempt to script a simple visualization in VVVV that responds to audio played back on the computer.
Audio input is analysed using the Fast Fourier Transform algorithm within VVVV [fft node]. Audio frequency scales up the height of boxes. ‘Low mid out’ value scales the boxes along the base plane. ‘High mid out‘ value is responsible for the color change and finally the ‘high out‘ value controls the rotation of the boxes about the vertical axis.
Audio played back is by the artist Zero and the song’s called PSP 12′.
The next stage in this process was to stream the frequency values from VVVV into a text file that is being updated continuously in real time. This text file was further read inside grasshopper using a ‘Read File‘ component. These values are then utilized to manipulate the height of boxes inside rhino in real time. Currently, the test was attempted under simple conditions involving just the height of boxes. There seems to be a major jump in the processing power absorbed by rhino while attempting to update changes in real time. The setup seems to be clunky and slightly less responsive in updating the heights continuously.
The second artist performing here apart from Zero is Darude and piece is called “Sandstorm”.
All attempts so far have been directed towards studying responses in real time. However, it might be feasible to “record” audio input response on geometry as a static exercise, which would mean the possibility of attaching a physical connotation “form” to audio signals . It is quite early at this point of time to speculate whether this could have any architectural implications. However, what is definitely feasible (and this currently is already being implemented) is the development of an interactive response to audio signals in the real world.
Great stuff, love it!
reaktorplayer said this on January 11, 2010 at 23:58
Hi!
I’m architecture student from Spain and I’ve found ypur blog searching some code examples to achieve some audio-to-form solutions. I use grasshopper and rhinoscript. It would be great if you could share with me some basic definitions (vvvv and GH) to stream data between audio files, txt files, and grasshopper interface.
Thanks for share your amazing work
And sorry for my english “butchering”.
Best Regards.
Angel (a.k.a.: _aLinG_) said this on January 20, 2010 at 20:03
Sure. I could send the stuff across in the weekend. In the meantime, you should also check http://nielswouters.be/3d-geluid/ for further work but using processing. Drop me an email : kdondeti@gsd.harvard.edu
Best,
Karthik.
Karthik Dondeti said this on January 21, 2010 at 11:55
amazing work! I just sent you an email as well. I’m also currently working on a thesis project and part of it is about using sound data to inform the aesthetics and structure of designed pieces.
Anonymous said this on March 3, 2010 at 17:48
oh..i just saw that you’re linked to scripted by purpose….i was the DJ at that show here in Philadelphia..great exhibit and opening.
matt said this on March 3, 2010 at 17:51
hello.
nice work. could you share it?
ssinan said this on March 22, 2010 at 20:39
Fantastic work. I’m working on a similar project to model a song, using an existing Wav file, with grasshopper. I was wondering If I could get some more details about how you created the original vvvv visualization and then how you later converted it to grasshopper. Any help you could give me would really be amazing.
Chris said this on November 2, 2010 at 14:44
Shoot me an email at karthik.dondeti@gmail.com. I would be glad to help any which way I can
Karthik Dondeti said this on November 3, 2010 at 20:53
this is amazing. when i got introduced to the world of sound and architecture i had no idea what i’m going to face. your approach is great. I’m an interior design student in Toronto. And I would like to use your script for my thesis project. I will definitely mention your name in my work.
it would be awesome if you could share it with me as well. i’ll shoot you an email regarding this
thanks bunch
geli
geli said this on November 7, 2010 at 01:21
hey,
great work! I’m a architecture student in tasmania, currently involved in setting up a theatrical tool kit for the school of visual performance arts in my University. I would love to get more details on how you managed to get an real time audio to work with grasshopper. I would love to use the script to demonstrate the performativity of sound in terms of set and costume(form) using projection.
It would be absolute fantastic if you could share this knowledge with us.
david said this on April 27, 2011 at 22:30
Looks great,
trying to do something similar with mapping movie scene conversations for architecture thesis. Could really use some help with the vvvv end if you have time.
Thanks,
Matt
Matt said this on September 14, 2011 at 02:55
[...] Geometric response to audio. Real time. Grasshopper : Version 1 « ….yet another script?. Share this:TwitterFacebookLike this:LikeBe the first to like this post. This entry was posted in Uncategorized by charlottehaughton. Bookmark the permalink. [...]
Geometric response to audio. Real time. Grasshopper : Version 1 « ….yet another script? | Charlotte Haughton said this on October 15, 2011 at 16:12
could you send me script?
Trey said this on March 16, 2012 at 16:28
I am student at University of Washington. I thought your example was great. May you send me of the VVV and ghx script?
Thanks
chan said this on April 1, 2012 at 23:38
Hi I am a student at University of Cincinnati, I wanted to apply and manipulate this script for one of my projects coming up that focuses on circulation space! Could you possible send the VVVV and gh script to me? It would be greatly appreciated!
Anjali Patel said this on September 21, 2012 at 12:00
With havin so much content and articles do you ever run
into any problems of plagorism or copyright violation?
My website has a lot of exclusive content I’ve either authored myself or outsourced but it appears a lot of it is popping it up all over the web without my agreement. Do you know any methods to help protect against content from being ripped off? I’d really appreciate it.
Shad said this on May 21, 2013 at 00:17