Kinect and OSC Human Interface Devices

To make up for the boring title of this post, lets’s start off with a video:

XYZ with Kinect a video by celesteh on Flickr.

This is a sneak preview of the system I wrote to play XYZ by Shelly Knotts. Her score calls for every player to make a drone that’s controllable by x, y, and z parameters of a gestural controller. For my controller, I’m using a kinect.

I’m using a little c++ program based on OpenNi and NITE to find my hand position and then sending out OSC messages with those coordinates. I’ve written a class for OSCHIDs in SuperCollider, which will automatically scale the values for me, based on the largest and smallest inputs it’s seen so far. In an actual performance, I would need to calibrate it by waving my arms around a bit before starting to play.

You can see that I’m selecting myself in a drop down menu as I start using those x, y and z values. If this had been a real performance, other players names would have been there also and there is a mechanism wherein we duel for controls of each other’s sounds!

We’re doing a sneak preview of this piece on campus on wednesday, which I’m not allowed to invite the public to (something about file regulations) but the proper premiere will be at NIME in Oslo, on Tuesday 31st May @ 9.00pm atChateau Neuf (Street address: Slemdalsveien 15). More information about the performance is available via BiLE’s blog.

The SuperCollider Code

I’ve blogged about this earlier, but have since updated WiiOSCClient.sc to be more immediately useful to people working with TouchOSC or OSCeleton or other weird OSC devices. I’ve also generated several helpfiles!
OSCHID allows one to describe single OSC devices and define “slots” for them.
Those are called OscSlots and are meant to be quite a lot like GeneralHIDSlots, except that OSCHIDs and their slots do not call actions while they are calibrating.
The OSC WiiMote class that uses DarWiinRemote OSC is still called WiiOSCClient and, as far as I recall, has not changed its API since I last posted.
Note that except for people using smart devices like iPhones or whatever, OSC HIDs require helper apps to actually talk to the WiiMote or the kinect. Speaking of which…

The Kinect Code

Compiling / Installing

This code is, frankly, a complete mess and this should be considered pre-alpha. I’m only sharing it because I’m hoping somebody knows how to add support to change the tilt or how to package this as a proper Mac Application. And because I like to share. As far as I know, this code should be cross-platform, but I make no promises at all.
First, there are dependencies. You have to install a lot of crap: SensorKinect, OpenNi and NITE. Find instructions here or here.
Then you need to install the OSC library. Everybody normally uses packosc because it’s easy and stuff…. except it was segfaulting for me, so bugger that. Go install libOSC++.
Ok, now you can download my source code: OscHand.zip. (Isn’t that a clever name? Anyway…) Go to your NITE folder and look for a subfolder called Samples. You need to put this into that folder. Then, go to the terminal and get into the directory and type: make. God willing and the floodwaters don’t rise, it should compile and put an executable file into the ../Bin directory.
You need to invoke the program from the terminal, so cd over to Bin and type ./OscHand and it should work.

Using

This program needs an XML file which is lurking a few directories below in ../../Data/Sample-Tracking.xml. If you leave everything where it is in Bin, you don’t need to specify anything, but if you want to move stuff around, you need to provide the path to this XML file as the first argument on the command line.
The program generates some OSC messages which are /hand/x , /hand/y and /hand/z, all of which are followed by a single floating point number. It does not bundle things together because I couldn’t get oscpack to work, so this is what it is. By default, it sends these to port 57120, because that is the port I most want to use. Theoretically, if you give it a -p followed by a number for the second and third arguments, it will set to the port that you want. Because I have not made this as lovely as possible, you MUST specify the XML file path before you specify the port number. (As this is an easy fix, it’s high on my todo list, but it’s not happening this week.)
There are some keyboard options you can do in the window while the program is running. Typing s turns smoothing on or off. Unless you’re doing very small gestures, you probably want smoothing on.
If you want to adjust the tilt, you’re SOL, as I have been unable to solve this problem. If you also download libfreenect, you can write a little program to aim the thing, which you will then have to quit before you can use this program. Which is just awesome. There are some Processing sketches which can also be used for aiming.
You should be able to figure out how to use this in SuperCollider with the classes above, but here’s a wee bit of example code to get you started:




 k = OSCHID.new.spec_((
  ax: OscSlot(realtive, '/hand/x'),
  ay: OscSlot(realtive, '/hand/y'),
  az: OscSlot(realtive, '/hand/z')
  ));

 // wave your arms a bit to calibrate

 k.calibrate = false;

 k.setAction(ax, { |val|  val.value.postln});

And more teaser

You can see the GUIs of a few other BiLE Tools in the video at the top, including the Chat client and a shared stopwatch. There’s also a network API. I’m going to do a big code release in the fall, so stay tuned.

Strategies for using tuba in live solo computer music

I had the idea of live sampling my tuba for an upcoming gig. I’ve had this idea before but never used due to two major factors. The first is the difficulty of controlling a computer and a tuba at the same time. One obvious solution is foot pedals, which I’ve yet to explore and the other idea is a one-handed, freely moving controller such as the wiimote.
The other major issue with doing tuba live-sampling is sound quality. Most dynamic mics (including the SM57, which is the mic I own) make a tuba sound like either bass kazoo or a disturbingly flatulent sound. I did some tests with the zoom H4 positioned inside the bell and it appeared to sound ok, so I was going to do my gig this way and started working on my chops.
Unfortunately, the sound quality turns out not to be consistent. The mic is prone to distortion even when it seems not to be peaking. Low frequencies are especially like to contain distortion or a rattle which seems to be caused by the mic itself vibrating from the tuba.
There are a few possible work arounds. One is to embrace the distortion as an aesthetic choice and possible emphasise it through the use of further distortion fx such as clipping, dropping the bit rate or ring modulation. I did a trial of ring modulating a recorded buffer with another part of the same buffer. This was not successful as it created a sound lurking around the uncanny valley of bad brass sounds, however a more regular waveform may work better.
At the SuperCollider symposium at Wesleyan, I saw a tubist (I seem to recall it was Sam Pluta, but I could be mistaken) deliberately sampling tuba-based rattle. The performer put a cardboard box over the bell of the tuba. Attached to the box was a piezo buzzer in a plastic encasing. The composer put a ball bearing inside the plastic enclosure and attached it to the cardboard box. The vibration of the tuba shook the box which rattled the bearing. The piezo element recorded the bearing’s rattle, which roughly followed the amplitude of the tuba, along with other factors. I thought this was a very interesting way to record a sound caused by the tuba rather than the tuba itself.
Similarly, one could use the tuba signal for feature extraction, recognising that errors in miccing the tuba will be correlated with errors in the feature extraction. Two obvious thing to attempt to extract are pitch and amplitude, the latter being somewhat more error-resistant. I’ve described before an algorithm for time-domain frequency detection for tuba. As this method relies on RMS, it also calculates amplitude. Other interesting features may be findable via FFT-based analysis such as onset detection or spectral centroid, etc using the MLCD UGens. These features could be used to control the playing of pre-prepared sounds or live software synthesis. I have not yet experimented with this method.
Of course, a very obvious solution is to buy a better microphone. It may also be that the poor sound quality stemmed from my speakers, which are a bit small for low frequencies. The advantage of exploring other approaches include cost (although a tuba is not usually cheap either) and that cheaper solutions are often more durable or at least I’d be more willing to take cheaper gear to bar gigs (see previous note about tuba cost). As I have an interest in playing in bars and making my music accessible through ‘gigability,’ a bar-ready solution is most appealing.
Finally, the last obvious solution is to not interact with the tuba’s sounds at all, thus creating a piece for tuba and tape. This has less that can go wrong, but it looses quit a lot of spontaneity and requires a great deal of advance preparation. A related possibility is that the tubist control real-time processes via the wiimote or other controller. This would also require a great deal of advanced preparation – making the wiimote into it’s own instrument requires the performer to learn to play it and the tuba at the same time, which is rather a lot to ask, especially for an avant guarde tubist who is already dealing with more performance parameters (such as voice, etc) than a typical tubist. This approach also abandons the dream of a computer-extended tuba and loses whatever possibilities for integration exist with more interactive methods. However, a controller that can somehow be integrated into the act of tuba playing may work quite well. This could include sensors mounted directly on the horn such that, for example, squeezing something in a convenient location, extra buttons near valves, etc.
I’m bummed that I won’t be playing tuba on thursday, but I will have something that’s 20 minutes long and involves tuba by September

First BiLE Performance

BiLE, the Birmingham Laptop Ensemble, had it’s first gig on Thursday, just six or eight weeks after being formed. We played at the Hare and Hounds in Birmingham, which is a well-known venue for rock bands, as a part of the Sound Kitchen series. There were two pieces on the bill, one called 15 Minutes for BiLE by BiLE member Jorge Garcia Moncada and we did a cover of Stucknote by Scot Gresham-Lancaster, which was a piece played by The Hub.
As a first performance, I thought it went rather well. There were the usual issues where everything sounds completely different on stage and the few minutes of sound checking does not give anybody enough time to get used to the monitor speakers. And time moves completely differently in front of an audience, where suddenly every minute gets much longer. But there were also the performing-with-a-computer issues: computers get terrible stage fright and are much more prone to crash. A few people did have their sound engines crash, so the first piece had a high pitched squeal for a few minutes, while messages flew on the chat window, reminding people to be quiet during the quiet parts. Actually, there was quite a lot of panic in the chat window and I wish I’d kept a log of it. (Later the audience said we all looked panicked from time to time. I always look panicked on stage, but it’s not cool.) In the second piece, I forgot to tell my programme to commence sound-making for a bout the first three minutes. I haven’t heard the recording yet, but I bet things sounded ok. Considering that most of us had never done live laptop performance at all before and how quickly we went from our first planning meeting to our first gig, I think we got a good result.
Jorge’s piece was complicated but Stucknote seems deceptively simple, so we did not try running through it until the day before the gig. In retrospect, this was clearly an error, because the piece, like all structured improvisation, does require some practice to get the flow down. Of course, we’d all spent the requisite time working on our sound generation and I’d coded up some faders for me and the other SuperCollider user, with Ron Kuivila’s Conductor quark, which is a very quick and dirty was of making useful GUIs. I’d tried out my part at home and it worked well and the sound I got was interesting, so I felt confident in it until I got to the practice and it crashed very quickly. I restarted SuperCollider and it crashed again. And again. And again. Half the time, it brought down the other SC user’s computer also. And it was clobbering the network, causing the MAX users a bunch of error messages and a few moments of network congestion. MAX, usefully, just throws away network messages when there are too many of them, whereas SC does not seem to.
I could not figure out where the bug was and so, after the practice, I sat down to sort it out. And there was no sign of it. Everything was fine again.
Fortunately, this provided enough of a clue that I was able to figure out that I had created an infinite loop between the two SuperCollider programmes. When I moved a slider in the GUI, that sent a message to the network which effected the sound on the target machine and also caused Shelly’s programme to update the GUI. However, the Conductor class always informs listeners when it’s updated, no matter who updated it or how, so it sent a message back to the network informing everybody of it’s new value, which caused my GUI to update, which sent a message to the network, ad infintum until I crashed.
I came up with a fix using a flag and semaphores:

                   Task({
                             semaphore.wait;
                             should_call_action = false;
                             cv = con[contag];
                             cv.input = input;
                             should_call_action = true; 
                             semaphore.signal;
                     }).play;
 

While this fix mostly works, it does bring up some interesting questions about data management across this kind of network. If we’re all updating the data at once, is there a master copy of it somewhere? Who owns the master copy if one exists? In this case, as one person is making sound from it, that person would seem to be the owner of the data. But what if we were all sharing and using the sliders? Then we all own it and may all have different ideas of what it might actually be.
I’m writing a class for managing shared resources which holds a value and notifies listeners when it changes. The object that’s changing it passes itself along to the method, so when listeners are notified, the changer is not. I haven’t finished the class yet, so I don’t have sample code, but I’m pondering some related issues.
Like, should there be a client version of this class for a local copy held on the local machine and a master version for the canonical copy on the network that everybody else is updating? Should a master copy of some data advertise itself on the network via the API and automatically listen for updates? Should they specify a way to scale values so it can also accepted changed inputs from 0-1 and scale them appropriately? If it does accept inputs/values in a specified range, should there be a switch for the clients to automagically build a GUI containing sliders for every master variable on the network? I think that would be quite cool, but I may not have time to code it soon, as our next gig, where we’ll be playing a piece of mine, is coming up very soon on 29 of April and then there’s a gig in May and then I suspect probably one in June and one in July (although not scheduled yet) and in August, we’re going to NIME in Oslo, which is very exciting. Bright days ahead.

My life lately (is tl;dr)

Tuesday and Wednesday Last Week

A week ago Tuesday, I taught my module in Cambridge. The next morning, I got on a train to Birmingham for BiLE practice. I’m a co-founder of BiLE, the Birmingham Laptop Ensemble. We formed in February and we have a gig next week. The technical hurdles to getting a laptop ensemble going are not minor, so there has been a lot of energy going into this from everybody. We have got group messaging going, thanks to OSCGroups and I wrote some SuperCollider infrastructure based on the API quark and a small chat GUI and a stopwatch sort of timer, which is controlled with OSC, so there’s been a lot of that sort of tool writing. And much less successful coding of sound-making items, which will eventually be joystick controllable if I ever get them to work. All my code is written for mono samples and all of the shared samples people are using are in stereo, so I spent a lot of time trying to stereo-ise my code before finally mixing the samples down to mono.
I’m a big believer in mono, actually, in shared playing environments. If I am playing with other people, I’m playing my computer as an instrument and instruments have set sound-radiation patterns. I could go with a PLOrk-style 6-speaker hemisphere, if I wanted to spend a boatload of money on a single-use speaker to get an instrumental radiation pattern form my laptop, so I could just use a single Genelec 1029 that I already own.
Anyway, after the BiLE rehearsal, a couple students gave a group presentation on Reaper, which is a shareware, cheap, powerful DAW. I’m quite impressed and am pondering switching. My main hesitation is that I expect my next computer will be linux, so I don’t know if I want to get heavily involved with a program that won’t run on that OS. On the other hand, I don’t actually like Ardour very much, truth be told. I haven’t liked any of them since I walked away from ProTools.
After that we went out for socialising and instead of catching a train home, I went to stay on the floor of Julien’s studio. He lives way out in the country, up a lane (British for a single-track country road). It’s quite lovely. I would not be a fan of that commute, but I might do it for that cottage.

Thursday

The next morning, Juju and I set back to campus quite early so he could meet his supervisor. I ran a couple of errands and got a uni-branded hoodie. I haven’t worn such a garment for years, because fabric clinging to my chest in the bad old days was not a good thing. But now I can wear snug woven fabrics, like T-shirts, hoodies and jumpers! It’s amazing! Also, I remember the major student protests about university branded clothing made by child labour, but this was actually fairtrade, according to the label, which is fairly impressive.
Then all the postgrads met in the basement of the Barber Institute to start loading speakers into a truck for a gig. We were moving a relatively small system, only 70 speakers, but that’s still a fair amount of gear to muscle around. Then we went to the Midlands Arts Centre to move all the gear into the venue and set it up. The gear is all in heavy flight cases, which needed to be pushed up and down ramps and down hallways and then the speakers inside needed to be carried to where they would be set up, as did the stands to which they would be attached and the cables that connect them. It’s a lot of gear. We worked until 6 or 7 pm and then went back to the studios at uni to get a 2 hour long presentation from Hans Tutchku about how he does music stuff. I tried desperately to stay awake because it was interesting and I wanted to hear what he was saying, but I did not entirely succeed in my quest.

Friday

Then, Juju and I went back to his place, 45 minutes away and then came back to the MAC early the next morning to finish rigging the system. We put up the remainder of the system and then people who were playing in that evening’s concert began to rehearse. I hung around for the afternoon, trying to get my BiLE code working. Kees Tazelaar, who played the next evening came along to see how things were going and recognised me from Sonology and greeted me by my old name. I like Kees quite a lot, but it was a very awkward moment for me and I wasn’t sure what to do, so I spoke to him only briefly and then mostly avoided him later. This was not the best way to handle it.
There were two concerts in the evening. The second of them was organised by Sound Kitchen and was a continuous hour with no break between pieces. The people diffusing the stereo audio to the 70 speakers took turns, but changed places without interrupting the sound flow. It was extremely successful, I thought. The hour was made up of the work of many different composers, each of whom had contributed only 5 minutes, but somehow this was arranged into a much larger whole that held together quite well, partly because many of the different composers had used similar sound material. A lot of them used bird sounds, for example, so that was a repeating motif throughout the concert.

Saturday

After that, we hung around the bar for a bit afterwards. The next morning was not so early, thank goodness, when we went back to the MAC and then back to the uni for the BiLE hack day. The idea was that we would do a long group coding session, where people could write code around each other and ask for clarification or feedback or help or whatever from band mates. However, it started really late and everybody was really tired, so it was not entirely successful in it’s goals.
Then we went back to the MAC for the concerts. I was sitting in the hallway, trying to figure out why my BiLE code had failed so completely when I got drafted into being in charge of the comp tickets. It turns out that this is actually somewhat stressful, because it requires knowing who is supposed to get comped in, getting tickets for them and then distributing them. Which means approaching Francis Dhomont and speaking to him.
The first concert was curated by Kees Tazelaar and started with a reconstruction of the sounds played in the Philips Pavilion at the Brussels Worlds Fair in 1958. He found the source tapes and remixed them. Concrete PH sounded much more raw and rougher than other mixes I’ve heard. It had a gritty quality that seemed much more grounded in a physical process. I was surprised by how different it sounded. Then he played Poem électronique and a his own work called Voyage dans l’espace. I hope he plays these again on large multi-channel systems, because it was pretty cool.
I was feeling fairly overwhelmed by the lack of sleep, my lack of success with BiLE and getting stuck with all the comp tickets, so I was not happy between concerts. The next one was all pieces by Anette Vande Gorne, a Belgian woman who runs the Espace du son festival in Brussels and who has very definite theories about how to diffuse sounds in space. Some of them are quite sensible, however, she thinks that sound can start at the front of the hall and be panned towards the back of the hall, but sound cannot originate at the back of the hall and travel to the front. Hearing about this had prejudiced me against her, as it seems rather silly.
She always diffuses standing up, so they had raised the faders for her, with one bank slightly higher than the other, like organ manuals. She started to play her pieces… and it was amazing. It was like being transported to another place. All of my stress was lifted from my shoulders. It was just awe inspiring. The second piece was even better. I was sitting in the back half, so I could see her standing at the mixers, her hands flying across the faders dramatically, like an organist, full of intensity as her music dramatically swelled and travelled around the room. It was awe-inspiring. Then I understood why people listened to her, even when some of her theories sound silly. She might not be right about everything, but there’s quite a lot she is right about. This was one of the best concerts that I’ve ever been to.
The last concert was a surprise booking, so it wasn’t well publicised. It was Jonty Harrison, Francis Dhomont and Hans Tutchku. It was also quite good, but I wouldn’t want to play after Vande Gorne. Tutchku’s piece had several pauses in it that went on just a few moments too long. It’s major climax came quite early. It worked as a piece, but seemed like it could be experienced in another order as easily as the way it was actually constructed. I talked to him at the party afterwards and he said that the pauses were climaxes for him and ways of building tension and that he had carried them out for too long in order to build suspense. I’m not entirely positive they functioned in this way, but the idea is quite ineresting and I may look into it. He also asked me what I thought of his presentation for two days earlier, so I was hoping he hadn’t noticed me dozing off, but I think he did.
After the final concert, there was a large party at Jonty’s house. I got a lift from Jonty, so I was squeezed in the back of a car with Anette Vande Gorne on one side of me and Hans Tutchku on the other side with Francis Dhomont in the front. They all spoke French the whole way. I’ve been filling out job applications and one them wants to know about my foreign language skills and now I can say with certainty that if I’m stuck in a car with several famous composers speaking French, I can follow their conversation fairly well, but would be way too starstruck to contribute anything.
Apparently, the party went on until 4:30 in the morning, but I didn’t stay so late. I talked a lot to Jean-François Denis, the director of empreintes DIGITALes, a Canadian record label. He flew from Canada just for the weekend and showed up without anyone expecting him. He is extraordinarily charming.

Sunday

The next morning, we went back again to the MAC and then there was a long concert with an intermission in the early afternoon. Amazingly, none of the concerts over the entire weekend featured overhead water drops. There were barely any dripping sounds at all.
After the concert, we de-rigged the system and packed all the gear back into cases and loaded it onto the two rented trucks. Then we went for curry in Mosely, which we seem to do after every gig. Shelly was talking about how it was her last BEAST gig and I wasn’t paying much attention until I realised this meant it was my last gig too. I really should have signed up to play something. I thought there was another gig coming later in the year, but it was cancelled. I’m seriously going to graduate from Brum having only played a piece at a BEAST gig one time and never having diffused a stereo piece. That is extremely lame on my part.

Monday

Juju was completely exhausted, so we left the curry early, so he could go home and catch up on sleep. The next morning, we all went back to the Barber Institute to unload the trucks and put everything away. Then we, as usual, went to the senior common room to have cups of terrible coffee. Their tea is alright, so that’s what I had, but most people go for the coffee, which could double as diesel fuel. I guess this was my last time of that also.
Normally, I would then gather my things and go home, but I did not. I worked on code and faffed and worried about my lecture the next day and then in the evening, we had another seminar. Howard Skempton came and talked for two hours about Cardew and Morton Feldman and his own music. It was quite good. We all went to the pub afterwards, but that dissipated quickly as people left to sleep it off.

Tueday

I got the train home, finally and got in after midnight. There’s a large stack of mail inside my door. I woke up early the next morning to assemble my presentation for my module. As luck would have it, the topic was acousmatic music, so I talked about BEAST and played them some of the music from the weekend. I also pointed them at some tools. I was supposed to have them start their task during the class time, but a surprising number of them wanted to show their works in progress, so that didn’t happen.
As I was on the train back to London from Cambridge, I wondered whether I should go out to a bar that night to socialise when I fell completely asleep on the train. Drooling on my backpack asleep. I completely crashed. I woke myself up enough to get the tube home and then thought I would sort out my BiLE code instead of going out, but I couldn’t concentrate, so I just faffed around on the internet instead of sleeping or going out. Meh to me.

Wednesday

Then, the next day, which was Wednesday, a week and a day after all of this started, I got on the train for Birmingham to go to a BiLE rehearsal and to go to a seminar. I got my code working on the train and was feeling somewhat happy about that, but when I got to the rehearsal, it just gave up completely. I managed to make sounds twice during the entire rehearsal, one of which was during a grand pause. When I tried repeating the sound later, it wouldn’t play. Also, Shelly found a crash bug in my chat application, when Juju typed a french character. On the bright side, however, all of the MAX users got all the way through one of the pieces we’re playing next Thursday, which is quite encouraging. Antonio, our graphics guy got the projector sort of working, so I was able to glance at what he was doing a couple of times and it looked good.
We took a break and a bunch of the postgrads were dissing live coding, so I guess that might not be a good goal for the ensemble. They thought projected code was self-indulgent and only programmers would care. I need to link them to the toplap mainfesto. Actually, they were more dissing the idea of live coding, having barely witnessed any themselves. Non-programmers do seem to care and, while it is a movement that does require some thoughtful understanding to fully appreciate it, the same could certainly be said of acousmatic music. I like the danger of live coding, something that I think a laptop ensemble ought to appreciate. It’s a bit like a high wire act.
The presentations at the seminar were interesting and then we went to the pub. I was so tired biking home from the train station that I got confused about which side of the street I’m supposed to be on.

Thursday

I slept until 2 this afternoon and I was supposed to sort out my BiLE code and fix up my CV and write my research portfolio, but all I did was send out email about Monday’s supercollider meetup and fix the crashbug in the chat thing. SuperCollider strings are in 7 bit ascii and fuck up if you give them unicode, which is really quire shocking and not documented anywhere.
Then I went to Sam’s to get Xena back and I wired up part of the 5.1 system she got for her daughter and sorted out her daughter’s macmini so that she could connect to it with VNC and so it was wired to the sound system and the projector and quit asking for the keychain password every 5 seconds. Then I came home and spent ages typing this up. Tomorrow, I will do my CV stuff for real, because I have to get it done and then work on my BiLE code. Saturday I’m going back to Brum again for a 5 hour rehearsal in wich we sort out the rest of our music for the gig. Sunday, I need to finish and job application related stuff and write my presentation for Tuesday. Monday is the job application deadline and a SuperCollider meetup. Tuesday, I teach. Wednesday, I need to get Xena back to Sam’s and then go to Brum again for a rehearsal and will be there overnight to practice the next day and then play the gig and then get stonkingly drunk. Friday, I go home. And then start sorting out the tech stuff for the next two pieces, which at least are by me and count towards my portfolio. And I need to sort out my stretched piece which is a disorganised mess and start writing a 20 minut piece, which I haven’t done at all and needs to be done very soon because I need to graduate and I have not spent all this busy time working on my own music, although the tools I’ve written should be kind of valuable. All I can think about now, going over and over in my head is all the stuff I have to do. And snogging. That thing about men thinking about sex every 7 seconds has never been true for me before, but it is now. And it’s actually quite annoying except that as the alternative is thinking about everything that I have to do, I actually prefer it.

Ha ha, trans people sure are funny

John Oswald:

Pretender (based on ‘The Great Pretender’ written by Buck Ram) features the opportunity for a dramatic gender change, suggesting a hypothesis concerning the singer, Ms.Parton, perhaps worthy of headlines in the National Enquirer. The first inklings of this story came from fans of Ms.Parton’s earlier hit single ‘Jolene’. As many consumers have inadvertently discovered, especially since the reemergence of 12′ 45rpm records of which this present disc is a peculiar subset, it is not uncommon to find oneself playing 45rpm sides at the LP standard speed of 331/3. In this transposed tempo ‘Jolene’ reveals the singer to be a handsome tenor. Additional layers of homosexual longing , convoluted mŽnages ˆ trois and double identities are revealed in a vortex of androgyny as one switches, verse to verse, between the two standard playback speeds.

Pretender takes a leisurely tour of the intermediate areas of Ms. Parton’s masculinity. This decelerando reveals, complete with suggestive lyrics, an unaltered transition between the ‘Dolly Parton’ the public usually hears and the normally hidden voice, pitched a fourth lower. To many ears this supposed trick effect reveals the mellifluous male voice to be the more natural sounding of the two. Astute star gazers have perceived the physical transformation, via plastic surgery, hair transplants and such, that make many of today’s media figures into narrow/bosomy, blemish-free caricatures and super-real ideals. Is it possible that Ms. Parton’s remarkable voice is actually the Alvinized* result of some unsung virile ghost lieder crooning these songs at elegiac tempos which are then gender polarized to fit the tits? Speed and sex are again revealed as components intrinsic to the business of music.
*chipmunked

From http://www.plunderphonics.com/xhtml/xnotes.html, which is associated with his tune Pretender, which you can download in a zip, from here. Click through to see his awesome, edgy and totally not race-baiting or queerphobic take on Michael Jackson.
I want to be on his side because he fought for fair use, but this stuff is really assholish. It’s like wanting to side with Larry Flint. I was trying to find out if he was gay or not, because that might sort of his explain his gender stuff or least make it possibly deeper than a cheap laugh,. All I could find was that his official bio claims he did sound for a Bruce la Bruce film, Hustler White, which he claims is a gay pron film. Wikipedia and IMDB imply otherwise (the latter doesn’t tend to cover porn films, for example Deep Throat has no entry) and neither mentions Oswald.
The Dolly Parton track, by the way, is really, really good (as is the Michael Jackson one). It’s just the liner notes that suck. And usually, changing the speed of a recording of somebody’s voice just sounds weird. But her voice slowed down gets a James Brown-like tenor quality which is quite remarkable. So he’s on to something, but then he went for the cheap laugh.
ha.
ha.

The vast emptiness of a blank page

I fire up my music software of choice, SuperCollider, and I open a new document and there’s nothing in it. It’s just a glowing rectangle of empty white, waiting for me to start typing.
Composing for SuperCollider is not like composing for a piano. First, you have to build the piano.
And you know, building a piano is hard. Maybe I don’t even want that sound. Maybe something else? Maybe anything I can think of? What should I type into that white void?
In my past, I’ve found that I actually have trouble talking about musical ideas. I mean, they’re slippery to talk about, obviously, but, I couldn’t seem to talk about them at all. People would ask me about music and I would start talking about technology. What’s my new musical idea? Well, I’ve got this P5 Glove, which I think I could use for gestural input. No, what’s my musical idea? Ah well, I have an algorithm that can compute scales based on spectra and I’m thinking of modifying it to be able to take amplitude modulation parameters like frequency, offset, amplitude and wave shape (including sine, triangle and square) or an array of partials for each wave form and thus generate scale steps that way. No but what’s my latest musical idea?
Ok, five years after discovering this disconnect, I think I can actually have musical ideas. Maybe. At least, the possibility is in my radar.
But, you know, if I’m thinking about technology, then at least it’s going to possibly suggest something musical, arising from the material possibilities it presents. And I think that might be a lot easier than staring into the hopeless void of a blank page. I think this might be why an analog synth is both easier and more fun. It’s not just the knobs, it’s the inherent limitations.
. . . Anyway, I’ve got this formula, and I think I found the formula for the spectrum of AM (and RM) and I really like the first few bars of Four Walls Act 2 Scene 4 by John Cage, so maybe a percussive attack on RM triangle waves and then I could modify the offset over time towards AM and also slide my scale mapping to reflect that . . .

Idea – any interest?

When I was studying analog electronic music in The Hague at Sonology, one of the techniques that Kees Tazelar really promoted was the re-working of recordings. The composer would record a sound and then playback that recording though another patch, like a filter or ring modulator or something and record the results of that and then repeat the process with the new recording.
This approach is nice because the resultant material has a link with the material that preceeded it. When the composer mixes it all togther, the material has a connection which may be audible. I used to record completely new patches with new sources for every sound in an analog work, but now I also do a lot of reprocessing.
My idea is to do a collaboration with other interested electronic artists. We could each publish one source sound and then publish some reprocessing of that sound and other artists’ sumitted sounds. We could then mix some of those sounds (with possibly some extra processing) and make new pieces with these collaboratively devloped sounds. These could then be released as a group via a netlabel or something.
I think this might be fun and if people document what they did, it could also be a nice learning tool. Anyone interested?

Gaga Over Information Overload

Penguin Books has a video about the future of publishing that’s quite clever. The cleverness starts halfway in and requires you to have watched the first half, so stick it out.
Part of what struck me about the video, aside from it’s strategic use of where it put the word “not,” was how it places caring “about what Lady Gaga is wearing” in binary opposition to caring “about what Gandhi did 50 years ago.” I find this annoying, because I actually care about both. I mean, obviously a liberation movement was more immediately vital while it was going on. But, for example. Gaga’s costume in the prison yard of the Telephone video, with the lit cigarettes on her glasses, is also interesting and worthy of discussion. It’s less vital than liberation movements that are going on right now, but I would not want to have to rank it against other bits of current cultural output.
Indeed, I think what she’s wearing is some of the most compelling part of her performance and presentation. Her music is acceptable pop music. Some of it is catchy. But the visual images in her videos and her glammness is stunning. In this age, visual information is much more dominant than audio – we read more than we hear and we watch even more yet. Videos and the written word are the primary means of dispersing information. So even though she’s ostensibly a musician, her artistry seems to be concentrated in the visual sphere.
I went to a club last night and the people I was with were all talking about her (well, they were shouting over the din of exceedingly bad DJing). Jack Halberstam (of Female Masculinities fame) has got a blog post up about her. There’s almost certainly conferences being planned at this moment: Gaga and Postfeminism etc etc etc. She is the hot thing right now in pop culture and cultural studies and litres of virtual ink are being spilt over her – by people who are “smart” enough to care about Gandhi. There are elitists who want to posit that the analysis of images and ideas within a culture s vapid. Such a bias is not only wrong, it’s boring. Snobbery is tiresome.
Gaga is all so very now, immediate and new and clamouring for attention. Blog posts, news articles, tweets, facebook wall posts, background babble, shouting in clubs. This is the kind of effervescent pop phenomenon that one could easily miss while on an extended holiday or just taking a break from media saturation. The hype is not, in and of itself, vapid, but some portion of it is intended to be distracting. The hype machine is less interesting than her fascinating videos. It constitutes part of the information overload that keeps one from working on one’s thesis. I want to create a piece that is about information overload in some way.
For my MA thesis, I incorporated the distracting barrage of information directly into my work. At that time, I was overly interested in cable news cycles and pundits. I could sample them directly. But sampling Gaga directly raises additional copyright issues as making music from her music is clearly a derivative work and requires permission. Also, her musical work is already music and her visual output is tied to her music.
So is it possible to engage her work within the genre of electroacoustic / noise music without taking recognizable samples of her directly? I could calculate her frequency spectrum and work within that or copy some of her timbres, like pitch correction or the glitchy repeating in the telephone song. But even if I was able to successfully allude to her music, it’s still not what’s most interesting about her. I’m instead taken with the changing contexts of corpses in Paparazzi and Telephone. And by her use of repeated images and objects to tie her videos together: the gold jaw of Bad Romance is referenced again in Paparazzi, where the dogs of Poker Face also make a brief cameo. There’s a boom box in Telephone that is also in a previous video (which one?!?). The camera lingers on it. The viewer is meant to notice. How could that be explored in my music? Or can it? Am I just distracting myself?

Gaga Video: Post Feminism and Americana

Unless you’ve been living under a rock, you’ve probably heard about Lady Gaga’s new video for her song Telephone:

What to make of this? There are some who want to put a feminist label on it, due to Girl Power-esque elements of the video, like the truck labelled “Pussy Wagon” and the female symbol at the end. However, I think this is a misreading. She references Thelma and Louise rather obviously at the end, but much of the rest of it is from exploitation movies of the 70’s. My media studies prof gf notes that these existed in dialog with the women’s liberation movement and thus the video is squarely within a post-feminist context.
I have the same problems with this video that I have with Natural Born Killers (which also clearly influenced it) in that it’s really much too violent to be camp. Lesbian serial killers are the stuff of exploitation films. And, of course, that scene of underwear dancing in the prison is just standard male-gaze music video stuff. It is slightly more complex than this, in that there are ‘real’ seeming lesbians in the prison yard scene. The leather clad dyke appeals to actual lesbians and is less easily placed in the male gaze.
There is also a lot of talk about product placement, which I think is also more complex than it initially appears. I’m sure Virgin was happy to be in the video and may even have paid for it, but Polaroid doesn’t even make those cameras or film anymore and I’m sure Wonder Bread and Miracle Whip are not exactly pleased to be linked with poisoning people to death. I think, instead, the products are meant to construct an image of Americana. The tropes of the video: prison, joshua trees, diners, cheap motel rooms, serial killers, pick up trucks, fuzzy dice; are all very american. And Gaga and Beyonce dancing around in pseudo Wonder Woman outfits at the end explicitly reference the flag, as do the placemats in the diner.
Thus we have an image of America made up of incarceration, road trips and violence. And the formation of (national) identity through consumption. Which may be depressing accurate, but at least is heavily satirised in the video. This is the biggest video in, like, forever and it’s been banned form MTV: the final sign of their irrelevance, as it’s easily viewable via YouTube. The major disappointment is the music. What in that song called out for that treatment? The lyrics talk about being too busy dancing ata club to talk on the phone. It’s ironic when paired with a prison fight scene, but, still, wtf? It’s no Thriller. And yet, every time I watch the video, it grows on me a little.

Taking Your Ball and Going Home

Who owns online communities?

First, a case study.

Jeff Harrington, the founder of New New Music has been pushed too far / is having a strop. He’s renamed the site to “New Music Shit Hole” and deleted a lot of the content. He sort of explains why in a post, in which he complains about trolling. The money quote is, “The big picture is that this online new music scene is basically 200 guys in their basements with MIDI synthesizers.”
What’s mostly surprising about this development is the timing, as the community had been surprisingly active lately. Last week, they released a compilation CD which they were selling will all proceeds going to benefit Haiti. Shortly before that, there was some sort of contest in which a great number of one minute pieces were created. The site actually was mostly populated by hobbyists (in their basement with synthesizers), which is why I wandered off. But aesthetically, some of the stuff that was going on there was worth paying attention to.
On the other hand, the number of people in the world who actually have interesting things to say about music is very small. The number of people who have interesting musical thoughts is less small, but putting those thoughts into words is notoriously difficult and can distract attention from putting those thoughts into music. So when composers (or wannabe composers) start talking about stuff, they most often start talking about sort of side issues like technology or gossip about composers or economic issues related to music or some kind of ideological whatever.
Tech talk abounds on the internet. It should be avoided if you actually want to make anything. Hobbyists don’t tend to have any good gossip and their economic interests are sometimes contrary to mine. As for ideology, well, this is probably where the flame wars came from.
So, in frustration, Mr Harrington renamed the site and deleted a bunch of content. There were no other moderators, and possibly no backups. The site, which was clearly valuable enough to have been doing projects even last week, is dead.

Community Projects are Hard

I worked for a couple of years on one for my day job, back when I was a music hobbyist and then, after enough time has passed for me to kind of forget the horror, I spent a year or so helping moderate a high traffic community on live journal. There is practical advice that helps: Have a team of moderators, enough so that if one or two of you wander a way for a bit, things keep going. Replace moderators when they burn out, which will take two years max. Have rules against stupid flamey crap and enforce them. Ban disruptive people – even if somebody is a god of music, it doesn’t mean they can participate well in a community.
One person trying to run a large community site is pretty much a guarantee that it will go up in flames. Which it did. And with it went the content. But any number of other things could have gone wrong. Ning, the company that hosts it, could have inexplicably decided to shut down this particular site (maybe they’re uptown). Or they could have decided to cease operations entirely. These scenarios expose a fundamental flaw in the way that community sites are structured.

Pyramid Shapes

A lot of people make content, but a few people own the distribution of it. I’m not talking about copyright, since a lot of the more casual content, like playlists, that populate this kind of site shouldn’t be under copyright anyway. But users spend time creating these and their discussions and comments and this is what actually forms the substance of the community. Yet, a very small number of people – the admins, the moderators, the hosting company – are actually the ones directly in control of the integrity of the content. The power of a community is it’s distributed user base, but all of it ends up concentrated in a single point of weakness, vulnerable to the whims of a few.
Web pages make for very nice front ends, and they can be a great way to organize how content is accessed, but in terms of actually working well with actual people who are not being paid to run them: usenet has a way better model. All the pre-web stuff was better designed for working with communities and had robust implementations. IRC and usenet are distributed. The content lives across many servers. There is no master copy. No one person can destroy a group. And yet groups can still be moderated.
The web was originally exciting because of inline images and some formatting stuff. It looked pretty. This might not sound like much, but back in those days, you couldn’t open a windows-created word file on a macintosh computer because there was nothing in common for different platforms of home users (a situation we are happily skipping back towards with phones, but that’s another post). The web let you actually all look at the same document. And it had pictures!
There’s a lot of reason to love that. We can all have our own little space which is ours and put up pictures of our pets and it was centralized in that we controlled our own space. Corporations loved the control aspect. They could entirely run some service and get users to pay for it and show them ads and if any user becomes annoying, they can be expelled. It’s sort of feudal, but, ooh, pictures! The major trend of web 2.0 is not user-generated content, since the early days of the web were all user generated. The major trend is centralization and corporate control. This transfers ownership of our content to a much smaller groups of people or individuals. They may treat it appropriately, or they might get really tired of trolls and delete all of it.
Everything old is new again in 2010. We need to go back to usenet and use it the basis for how community back ends work. If Net New Music wants to get going again, they should probably reconvene there.