Tuesday 23 April 2013
Wednesday 2 November 2011
The Experiment Soundtrack
The Experiment Live
""For one night only, Thrill Laboratory present an experiment like no other: real scientists, amateur paranormal investigators, and the live exploration of a haunted building. University researchers have developed cutting-edge medical technology to monitor the effect of paranormal beliefs on the bodies and minds of those susceptible. Dr Brendan Dare brings to you the unpredictable results of their scientific research from the remote basement of a reputed Broad Street haunting. The Experiment will be captured by a film crew and transmitted real-time to a live cinema audience."
Project summary
I was asked produce a horror soundtrack that could be shaped by biological-data, The bio data was captured by electronically by measuring pulse,breath and sweat (GRS) responses and transmitted wirelessly to a hub computer. The composition made up of individual music tracks which can be modified in various ways, creating a changing horror sound track reacting to the highs and lows of emotions felt by five people during a filmed paranormal investigation.
For this i created two interlocking compositions who's different parts that could be highlighted and modified. These composition can be played singularly or an overture can be created from different parts of each.
For the composition I pulled out every horror cliche i could find. The general feel for the compositions over all was a pastiche ofJohn Carpenter horror sound tracks. The main piano theme itself is a derivative of the Halloween soundtrack.
The tritone, also know the devil chords (diabolus in musica) is a well know technique for horror sound tracks,as well as apeggiating the notes up and down a semi tone. Low bass sounds, discordancy, creepy violins, sound effects such as thunder and creaking doors, as well as sound design using reverb, tape delays and stereo placement.
Each track was 46 seconds long, there were 16 tracks in total.
an example of the compositions functionality
n.b this recording does glitch!(due to the recording it off thing....)
an example of the compositions functionality
n.b this recording does glitch!(due to the recording it off thing....)
ingredients .….the kit used
data stream from the p.c. hub
PD to understand the data from the hub and sending to Max/MSP via Osc,
Max/MSP run midi/control notes ,to receive bio data via an OSC link from PD
Logic,running 16 synthesisers/samplers ,effected and sound designed
Purpose of Max/MSP
Max/MSP was used to control the midi data of the project,to play the composition.
The patch reads a 16 track midi file, each track of the midi file can be modified in (for instance each track of the midi file has the option to be appegiated) "live" before being sent to logic, via inter application midi, to trigger logics powerful synths,drum machines and samplers. The volumes of the synths,the note it plays, its perimeters and effects can all be modulated from Max/Msp.
These controls are modified by the bio data, or can be controlled in real time via a midi controller.
A separate patch (to be explained later) was also developed in Max/MSP
Purpose of PD
A program needed to be developed to communicate with the hub computer, receiving the biometric data. The hub computer communicates with the "music" computer by sending its data via TCP, either through ethernet or a wireless network. After experimenting with TCP protocols in Max/Msp, I quickly discovered its wasn't ideal for the task and used the programming environment PD (pure data), The patch received the raw data, packaged it, and then sent it to a separated program i wrote in Max/MSP via OSC. I made this choice so a separate laptop could be used to receive the data, and then send it via midi to the "music" machine. A separate laptop sending out the data meant that a crash wouldn't nesicerly bring stop the music. This I felt would shore up a weak link, if the program crashed (and it didn't!) it wouldn't also take down the music program. The max patch also translated the data and turned it into a midi control value between the scale of 0 to 127, which made making the program bio reactive easier, and more adaptable for other data in the future.
Purposes of Logic
Logic was used as an audio engine. Logics on board sampler, the albino synth plus its various effects units where all put to good use. These all were controlled through midi sent by Max/Msp. One disadvantage of this system was the Tempo cannot be easily controlled via midi in Logic, so this was not used as an element in the composition, tempo needed to be controlled to make sure syncopated elements of the effect units were kept in time with the standard tempo.
Change Factor- how the composition can change
All tracks can be appegiated (in the case of the sample and drum machine different samples/patterns are chosen) and the base volume and wether the track is muted can be changed.
The two compositions were made up of the following elements
track 1- low drone-resonant filter can be modulated
track 2- bass note- filter cut off frequency can be modulated
track 3- low string- filter cut off frequency can be modulated
track 4 piano chords- can be raised a fifth
track 5- piano riff- can be raised a fifth
track 6- high string- filter cut off frequency can be modulated
track 7- drum machine- use hi hat sound or drum pattern
track 8- sampler- choice of 16 different spot effects (choose at random or repeated)
track 9 -drum machine2- start stop drum pattern
track 10- morrocan pipe- resonant filter can be modulated
track 11- glacial synth- filter cut off frequency can be modulated
track 12- discordant organ- filter cut off frequency can be modulated
track 13-ghostly voices-resonant filter can be modulated
track14- creepy music box-can be raised a fifth
track15-appegiator- filter cut off frequency can be modulated
track16-spare
The Total Randomness Index
with these perimeters we can roughly work out we have…….
at least 2 different ways of modifying the sound of the 16 basic tracks
that gives us 512 different combinations of the basic tracks, each track is 46 seconds long
that gives us a playing time of around 6.5 hours
On top ,each volume level that can be adapted, and blend smoothly in or out. or be mute so it cuts in and out abruptly.
additionally each individual track can be arppegiated which give us another at least 256 different ways the tracks can work together.
Although there maybe many different combinations the tracks will always retain a flavour of the original composition.
How it deals with the data
Due to the experimental nature of the performance and the fact the system hadn't been used live, I used a very simple algorithm to trigger the composition. Each participant was given a fear index, based upon the total readings of their bio data results. This index was ranged from 0 (for base level) to 3 for maximum stress displayed. All the participants fear index was added together to give an average result, the number of tracks that could be triggered (heard) was based on this result. As the fear index fluctuated around every 20 or so seconds this made an ideal trigger to change the playback order of the tracks and their volumes, giving a varied composition. the relative volumes between the track were altered with a volume slope between the two values giving a smooth transition.
Also the GRS index gate spikes,rising quickly and settling back down again, this made it perfect to open and close resonate filers and cutoff, giving a distinctive "womb" sound.
the GRS index in some case was also used to trigger sound effects, when the level reached a certain level a random horror sample was played. Hopefuly the effect of this was to audibly highlight any spikes in the data
The compositions key change (arppegiated note) trajectory was in this case operated manually. The mechanics were there to connect it to a bio generative behaviour but in light of the performance it seemed beneficial to change the dynamic manually to build and disapate tension.
At the same time all changes could be operated manually,as previously mention the system hadn't been tested and manual control via midi enable me to make sure the compositions trajectory moved slowly.
Not included…...
With more observation of actual real life examples of biodata, it will be easier to identify spikes, trends and conditions in the data which will influence the mapping of more sound behaviours.
Tempo at this time is not included in the change perimeters due to logics inability to map this behaviour.
Wednesday 20 July 2011
Glaber
the glaber is name after the naked mole rat.its real ugly..lives in the desert and is almost impervious to pain.
glaber the program makes music automaticaly from stuff it finds scurrying around internet.it searches for mp3's and jpeg and gifs...then mixes them up making a stream of music an images. each time differently
where does it gets it material from?
glaber already has some sounds and images in it when you download it, so they always should start of sounding simular..after time they each become a different beast.no two performance are ever the same.
it gets its images from searching goolge images
and it gets it audio from serching.
and the media art bath resource page
it chooses its key words for searching by looking at the bbc news site looking for the latest headlines in science,world news,uk news,entertianment,politics and education
can i make it go full screen?
yes,press escape
does it put weird shit onto me 'puter?
no!.....it downloads all its stuff to (picturesdelete folder)or .it then searches through this to see what it can use and transports this stuff to (pictures folder)
the audio is downloaded directly to the audio folder
the program is standalone. that is to say you dont need to install anything to get it working.
where does it store its audio and images?
glabber stores its audio in the folder marked (:audio) and its visuals in the folder marked (:pictures)
if you add your own jpegs or giffs (in the pictures) or mp3s (in audio) glaber will use these to mix.
how do i look after glaber.
glaber has a folder of junk that need regulary emptying.you 'd think a proper programer would do this automaticaly, but the glaber is an untidy animal and needs a human to clean up the rubbish from the internet.
the folder that needs emptying and throwing away is (:picturesdelete )
is it new stuff each time?
glaber labels the media it collects sequentialy but chosses a different number to start from each time you start up.so eventualy you see a mix of all the data you have collected since you have downloaded glaber. but the media is loaded randomly,so no two performances are ever the same.
are they're any controls?
not realy..tis automatic.....thats the point.
but for the games cheats out there.....
heres some key controls
A Reload all
S New tempo
D New load o mutes
F keep at same setting
V carry on
G downloader on
B downloader off
H put in own search
escape full screen
are there/gonna be any updates?
yes watch this space
who made this program?
matthew olden, thats who....
he's got a website where you can see more stuff and download more stuff too....
tis here
what is glaber made in?
glaber is made in max/msp with jitter
it seems a bit slow.
glaber can slow down,but sure and steady.everytime you use it it gets more material,and each time you use it the more different (ish)itll be.sometimes slow internet ,heavy traffick,slow computers/full up computers/computers cause it to only download a few things a time.just keep it going......and itll be solid gone...
sometime the internet connection is too good and the visuals might judder whilst its loading too many visuals.
it doesnt seem to be downloading mp3's
it will its just sometimes there massive before gabber chops them down
its crashing...it wont start...
hmm...ill have a look.
sometimes dodgy media in the (pictures folder) or (audio folder) might do that.
check out yer audio settings
empty the (picturesdelete folder)
download it again
it need quicktime to be installed for the visuals inall......
how much space will it use up?
itll fill the folders up with 1500 items then start over writting em....
each time you start up glaber starts labeling at a different point, so material will build up over time
1500 audio files will take up about 4gigs worth of space eventualy....but itll take a long time
the picture folder when full will probly only be about a gigs worth of space...
if you think its getting too full free free to throw stuff away.
Omnichord
Its a virtual omnichord! heres the instructions....
the way it works is that each row of keys produces a chord, and when the keypad is stroked left to right it plays theses notes (over 4 octives). Like an omni chord you can play 72 different chords
heres the keys
row qwertyuiop[] plays major chords
row asdfghjkl;'\ plays minor chords
row `zxcvbnm,./space plays a 7th
with caps lock on
row qwertyuiop[] plays major minor chords
row asdfghjkl;'\ plays major 7th chords
row `zxcvbnm,./space plays a 7th monr chords
sorry if there isnt a major minor scale, dont realy know the terminolgy.....
it sends out through midi (use IAC for sending to summat like logic, or use the computers on board synth), or you can test it using sinewaves....
heres the keys
row qwertyuiop[] plays major chords
row asdfghjkl;'\ plays minor chords
row `zxcvbnm,./space plays a 7th
with caps lock on
row qwertyuiop[] plays major minor chords
row asdfghjkl;'\ plays major 7th chords
row `zxcvbnm,./space plays a 7th monr chords
sorry if there isnt a major minor scale, dont realy know the terminolgy.....
it sends out through midi (use IAC for sending to summat like logic, or use the computers on board synth), or you can test it using sinewaves....
3D Harmonograph
it creates a spinable 3d Harmonograph from 3 different audio waves, and makes very beutiful patterns.
I've put together a blogspot for it here, where you can find out more.
Subscribe to:
Posts (Atom)