PROCESS

Quartz Composer Visualizations System | Flash Visualization System | Flash Visualization Process | Concerto - The Game

An easy to understand summary of what we did, and how it works (including some music theory)

Quartz Composer Visualizations System

Quartz Composer is a Visual Programming Environment that is composed of various patches. Each patch controls a different element. As you manipulating them you see immediate changes in the output viewer window eliminating the need for code.

The Diagrams below demonstrate the setup process for Quartz Composer

quartz setup


Flash Visualization System

flash system

Description of Flash Visualization Tools

MIDI Patch Bay:MIDI patchbay lets you hook up your various pieces of MIDI software and hardware and pass MIDI data between them, applying assorted filters on the way. Things like key splits, MIDI channel remapping, transposition, etc. are simple.
Resource:Patchbay

IPhone App Touch OSC:TouchOSC is an iPhone / iPod Touch application that lets you send and receive Open Sound Control messages over a Wi-Fi network using the UDP protocol.
Resource:TouchOSC

OSCulator:OSCulator is a software that links your controllers to your music and video software. For example, with OSCulator, your Nintendo Wiimote or iPhone can talk to major MIDI sequencers or your favorite console emulator or even the Kyma sound design workstation.
Resource:OSCulator

Synthesia:Synthesia is a program for Windows and Mac OS X which allows users to play a MIDI keyboard or use a computer keyboard in time to a MIDI file by following on-screen directions, much in the style of Keyboard Mania or Guitar Hero.
Resource:Synthesia

Garageband: Garageband is a software application that allows users to create music.
Resource:Garageband


Flash Visualization Process

MIDI Input -> MIDI Patch Bay -> Osculator -> Flash Visualization

Overview:

MIDI input is picked up by the MIDI patch bay program, where the input is converted into OSC input. Osculator will then pickup on the signal. Flash will then pickup the data from Osculator and display it in its visualization.

Setup:

  1. Launch "Garage Band" and test to make sure that you get some sound output.
  2. Download "MIDI Patch Bay" from here
  3. Install "MIDI Patch Bay" into you Application folder
  4. Launch "MIDI Patch Bay"
  5. In "MIDI Patch Bay" select the the desired input, and the desired output.
  6. Download "Osculator" from here
  7. In the top left corner of the "Osculator" application, change the OSC Input Port to 9000
  8. Within "Osculator" you will see a label for each key that is pressed from the MIDI input (keyboard), and will route that information over port 9000.
  9. Flash will listen to data being sent over port 9000, and display the proper visualization.

Notes:

MIDI input will come from the keyboard for our launch. If not using "Garage Band", use an appropriate program that will output sounds. (ie. "Synthesia" would output sound because it is taking in MIDI input from a keyboard)

Input -> Garageband -> Osculator -> Flash Visualization

Overview:

MIDI input is picked up by the MIDI patch bay program, where the input is converted into OSC input. Osculator will then pickup on the signal. Flash will then pickup the data from Osculator and display it in its visualization.

Setup:

  1. Launch "Garage Band" and test to make sure that you get some sound output.
  2. Download and Install "Osculator" into your applications folder from here
  3. In the top left hand corner of the "Osculator" application, change the OSC Input Port to localhost 8000 and the output to 9000.
  4. Within "Osculator" you will see a label for each key that is pressed from the MIDI input (keyboard), and will route that information over port 9000.
  5. Flash will listen to data being sent over port 9000, and display the proper visualization.

Notes:

MIDI input will come from the keyboard for our launch. Osculator will be listening to garageband on localhost port 8000. It will be sending information via port 9000. Garageband will be sending information on port 8000.


Concerto - The Game

Properties of the Game:

  1. Currently Beethoven's Fifth is the only song that can be chosen.
  2. The song(s), theoretically, are broken into two parts to allow for multiplayer action.
  3. The visualizer displays both parts of the song.
  4. Winning is based on scoring. -- Points are gained by hitting notes and series of keys
  5. Only supports a maxmimum of two (2) players.

Game Process:

  1. Start Game
  2. Select Beethoven's Fifth -- Theoretically you would choose a song, but current Beethoven's Fifth is the only song that has been separated into two pieces to allow multiplayer action.
  3. Game Begins
  4. Game Ends
  5. Score is presented with winners and losers