{"id":69,"date":"2014-07-01T16:25:00","date_gmt":"2014-07-01T15:25:00","guid":{"rendered":"http:\/\/www.celesteh.com\/blog\/2014\/07\/01\/creating-music-with-leap-motion-and-big\/"},"modified":"2015-06-19T00:23:02","modified_gmt":"2015-06-18T23:23:02","slug":"creating-music-with-leap-motion-and-big","status":"publish","type":"post","link":"https:\/\/www.celesteh.com\/blog\/2014\/07\/01\/creating-music-with-leap-motion-and-big\/","title":{"rendered":"Creating music with leap motion and big bang rubette"},"content":{"rendered":"<p>Leap Motion is cool, he says.<br \/>\nrubato composer is software that allows people to do stuff with music and maths structures and transforms. It&#8217;s MAXish, but with maths.<br \/>\nThe maths are forms and denotators, which is based on category theory and something about vector spaces. You can define vectors and do map stuff with them. He&#8217;s giving some examples, which I&#8217;m sure are meaningful to a lot of people in this room. Alas, both the music AND the math terms are outside of my experience. &#8230;. Oh no wait, you just define things and make associations between them.  &#8230;. Or maybe not&#8230;..<br \/>\nIt sounds complicated, but you can learning while doing it. They want to make it intuitive to enter matrixes via a visual interface, by drawing stuff.<br \/>\nThis is built on ontological levels of embodiment.  Facts, processes, gestures (and perhaps jargon). Fortunately, he has provided a helpful diagram of triangular planed in different colours, with little hand icons and wavy lines in a different set of colours, all floating in front of a star field.<br \/>\nNow we are looking at graphs that have many colours, which we could interact with.<\/p>\n<h4>Leap Motion<\/h4>\n<p>A cheap, small device that track hands above the device. More embodied than mouse or multitouch, as it&#8217;s in 3d and you cna use all your fingers.<\/p>\n<h4>Rubato<\/h4>\n<p>Is built in java, as all excellent music software is.  You can grab many possible spaces. Here is a straightfoward one in a five dimensional space, which we can draw with a mouse, but sadly, not in five dimensions.  Intuitively, his gui plays audio from right to left.  The undo interface is actually kind of interesting.  This also sends midi&#8230;.<br \/>\nThe demo seems fun.<br \/>\nNow he&#8217;s showing a demo of waving his hands over a MIDI piano.<\/p>\n<h3>Questions<\/h3>\n<p>Is the software available?<br \/>\nYes, on sourceforge, but that&#8217;s crashy. And there will be an andriod version.<br \/>\nAre there strategies to use it without looking at the screen?<br \/>\nThat&#8217;s what was in the video, apparently.<br \/>\nCan you use all 3 dimensions?<br \/>\nYes<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Leap Motion is cool, he says. rubato composer is software that allows people to do stuff with music and maths structures and transforms. It&#8217;s MAXish, but with maths. The maths are forms and denotators, which is based on category theory and something about vector spaces. You can define vectors and do map stuff with them. &hellip; <a href=\"https:\/\/www.celesteh.com\/blog\/2014\/07\/01\/creating-music-with-leap-motion-and-big\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Creating music with leap motion and big bang rubette<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[1],"tags":[63,54,55],"class_list":["post-69","post","type-post","status-publish","format-standard","hentry","category-uncategorised","tag-gesture","tag-live-blog","tag-nime"],"_links":{"self":[{"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/posts\/69","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/comments?post=69"}],"version-history":[{"count":1,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/posts\/69\/revisions"}],"predecessor-version":[{"id":2261,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/posts\/69\/revisions\/2261"}],"wp:attachment":[{"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/media?parent=69"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/categories?post=69"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.celesteh.com\/blog\/wp-json\/wp\/v2\/tags?post=69"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}