Archives for category: audio/visual systems & machines

music: hot chip (careful)

a) create a 140 character (or less) composition using super collider. Take a look at the sc140 albumbs for inspiration.

b) using super collider or chuck and OSC, create a audio visual composition where the sound is produced in a separate program and OF controls the visuals. You can recode your sequencer to use these tools if you want.


Over spring break, I made a sequencer by using a 2D array of notes (code via zach gage) to create a grid system, where there are 32 notes (rows, x) and 24 notes (columns, y). I created a new class so I could control the color and size of the circles, depending on if they are on (pressed) or off (not pressed). I had a few issues when I converted the squared to circles. When you press the circle, sometimes it will turn on the circle next to it, which is something I need to work on fixing. It’s fairly simple, but I would like to keep developing this project. Depending on how I approach it, I probably will end up re-writing it because the zach g’s code I was working with, although very efficient and logical, it was a challenge trying to work with the 2D boolean arrays.


Updated version :: The mouse functions are now accurately mapped to each circle / note.

updated code

Assignment: audio analysis meets white square (200px x 200px)
Basic Rules:
a) start with a white square, 200px x 200px, centered on the screen
b) start with a black background
c) draw nothing else on screen

For this program, I used FFT analysis for the input sound. I broke the square into a grid comprised of smaller squares, each reacting differently to the FFT average input, or peak values.
Music: Daft Punk (Boris Dlugosh Remix).

For this program, I used pitch detection. As the pitch increases, the white square transforms into a blue triangle. For this video I used the amplitude modulation control panel to visualize the change in pitch.

For this one, I used FFT analysis again. There seems to be something off because it’s moving too fast. I’m still working on fixing this.

Assignment: Make a graphical score to a piece of music / sound for which traditional music notation isn’t necessary. Think about what visual languages you can use to represent sound.
Created with Adobe Flash CS5

swf file : click below to see it in high resolution


Assignment: Build a non-computational sound visualizer. Collaborated with Burcum Turkman.

First we used different colors of glitter to visualize various levels of frequencies.

With the same technique, we experimented with different songs. This one is Radiohead, Codex.

For this one, we used Jason Jordison’s (slipknot) drum solo.

Metallica (S&M) – Master of Puppets.

We mixed the glitter with cornstarch and water. The results are pretty sweet. We didn’t use a song for this one, but alternated the frequency levels.

Assignment 2 : Build / Find / Document a visual equivalent to granular synthesis
think specifically about the stochastic nature of granular synthesis, and how you can make something that’s a visual equivalent.

I built this in oF. I ideally, I would want this to be an image and as you move the mouse, the pixels become clear.

For the next two projects, I worked in Processing to experiment with pixel data. I think the first one represents granular synthesis more accurately.


assignment: Create 3 interactive audio visual systems based on AM, FM or Additive synthesis and a primitive visual form (circle, square, triangle). Think about creating the tightest relationship between the sound and the visual form, and how interaction (mouse, keyboard, other) can influence that.

I incorporated FM sound in this audio visual system. The integration between the sound and visuals still needs some work, but I like the direction it’s going so far. My next step is to implement a range in volume.

Updated Version :: the sound correlates more accurately with the movement of the mouse.

Another FM audio visualization. I used vector points to create the patterns. Each shape of vector points maps the distance between low and high frequency.

In this system, I used vector points to control the FM sound. I was having trouble implementing a range in volume for certain areas of the screen.

The mouseclick function is controlling the direction of the moving circles. The frequency shifts from high to low as the radius size changes. I want the volume to change as you click the mouse and the circles switch their position – still need to figure this out.

Amplitude Modulation
description: AM synthesis using sin wave code in openframeworks.


Frequency Modulation
description: FM synthesis using sin wave code in openframeworks.


Additive Synthesis
description: using additive synthesis, create the most evil, terrible, cacophonous and dissonant sound.


description: using additive synthesis, create the most harmonious, beautiful sound that you can.


Sin Oscillators
description: try to see what the limit of your computer is by adding as many sin oscillators as you can together.


Recreating Tones
description: using any synthesis technique, attempt to recreate these tones:
a. dial tone:


b. ringtone:


Images as inspiration for sound creation