We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Music is the Instrument

00:00

Formal Metadata

Title
Music is the Instrument
Subtitle
Innovation for Impact
Title of Series
Part Number
98
Number of Parts
188
Author
License
CC Attribution - ShareAlike 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Matan's incredible journey from musician & film maker to award winning inventor started with the realization that his actions could have more 'real, positive impact on the world'. In the past 2 years he has developed ways to translate heartbeats, brainwaves and motions into music while turning everyday objects such as hats, glasses and gloves into instruments, working to empower people with special needs to express themselves in new ways, speaking and performing on stages worldwide and building interactive installations for museums & galleries. As the founder of Shift, a company which specializes in positive innovation, Matan is now laying the foundations for a new kind of lab - one which works with emerging technologies while focusing on their potential to do good in the world. During this fascinating talk Matan will not only share his story, insights and inventions, but also perform a live demo of his latest prototype, which enables anyone to play music using nothing but hand movements.
2
Thumbnail
1:01:39
5
Thumbnail
57:37
14
52
Thumbnail
1:00:21
55
Thumbnail
1:02:36
96
102
Thumbnail
59:03
115
Thumbnail
1:01:49
128
148
162
176
185
HypermediaSicWeightMultiplication signBitDigitizingMusical ensembleTranslation (relic)BackupObject (grammar)XMLComputer animationJSONLecture/Conference
Shift operatorSicMultiplication signMusical ensembleRight angleDemo (music)ArmBitLevel (video gaming)TouchscreenPrototypeLecture/Conference
QuicksortArithmetic meanField (computer science)Group actionFood energyVideo gameOnline helpComputer animation
Shift operatorIdentity managementShift operatorProjective planeDemosceneVideo gameDirection (geometry)Arithmetic meanCausalityMathematicsPosition operatorUltraviolet photoelectron spectroscopyFocus (optics)Self-organizationComputer animationMeeting/Interview
Different (Kate Ryan album)File formatEvent horizonFrequencyMultiplication signWordSoftware developerCondensationLecture/Conference
Musical ensembleDifferent (Kate Ryan album)Pattern languageVideo gameClient (computing)Shift operatorPrototypeComputer fontProjective planeMathematicsLecture/ConferenceMeeting/Interview
Moment (mathematics)Musical ensemblePhysicalismComputer animation
Musical ensembleBitGoogolGame controllerLecture/Conference
Group actionCartesian coordinate systemMultiplication signTouchscreenArithmetic progressionLevel (video gaming)Lecture/Conference
Level (video gaming)Disk read-and-write headPoint (geometry)Musical ensemblePrototypeVideoconferencingCartesian coordinate systemLecture/Conference
Sound effectPoint (geometry)Disk read-and-write headTouchscreenPrototypeDrop (liquid)VideoconferencingGodDot productTrail
WaveLoop (music)Graph (mathematics)Signal processingDisk read-and-write headDifferent (Kate Ryan album)Type theoryGame controllerMultiplication signCartesian coordinate systemSound effectLecture/Conference
Line (geometry)MathematicsGraph (mathematics)MereologyPrototypeMusical ensembleMetropolitan area networkLecture/ConferenceMeeting/Interview
Metropolitan area networkMusical ensembleLevel (video gaming)Local ringLecture/Conference
DampingGoogolConnectivity (graph theory)Alpha (investment)Multiplication signMusical ensembleTouchscreenEvent horizonDisk read-and-write headLoop (music)PrototypeField (computer science)ProgrammschleifeElement (mathematics)Demo (music)2 (number)MeasurementWaveVideo gameComputer animation
Metropolitan area networkDifferent (Kate Ryan album)PrototypeRule of inferenceMusical ensembleWavePulse (signal processing)Computer animation
Level (video gaming)Event horizonWaveMusical ensemblePattern languageGoogolVideo gameWater vaporReal-time operating systemTouchscreenComputer animationLecture/Conference
Shape (magazine)Installation art
MeasurementSynchronizationMusical ensembleMultiplication signProjective planeVideoconferencingMappingShift operatorInteractive televisionCurveLecture/Conference
Connected spacePhysicalismMusical ensembleFood energyLecture/Conference
Musical ensembleWaveAsynchronous Transfer ModeMultiplication signVirtual machineDrum memorySurfaceRevision controlTunisSocial classBitComputer animationLecture/Conference
Drum memoryFilm editingBookmark (World Wide Web)Asynchronous Transfer ModeDifferent (Kate Ryan album)Row (database)Reading (process)MereologyTheoryMultiplication signLecture/Conference
Shift operatorSicMusical ensembleCognitionTheoryLecture/Conference
Musical ensembleEvent horizonVideoconferencingTheoryShift operatorWordLecture/Conference
Shift operatorArmVariable (mathematics)Musical ensemblePrototypeMeeting/InterviewComputer animation
Software developerMusical ensembleMultiplication signArmMachine visionMeeting/InterviewLecture/ConferenceJSONXML
Line (geometry)Multiplication signPower (physics)Projective planeMetropolitan area networkMusical ensembleRight angleMeeting/InterviewComputer animationJSONXML
Newton's law of universal gravitationQuantum stateSoftware developerOperator (mathematics)Line (geometry)Vulnerability (computing)PlanningComputer animationMeeting/Interview
Moment (mathematics)Green's functionChord (peer-to-peer)Type theorySet (mathematics)WordSelf-organizationStudent's t-testData miningBitPhysical systemMeeting/InterviewJSONXML
Metropolitan area networkInformation systemsPersonal identification numberPhysical systemComputer programmingWeb 2.0JoystickNeuroinformatikMusical ensembleDisk read-and-write headProgramming paradigmMeeting/InterviewSoftwareComputer animation
Duality (mathematics)TelecommunicationMathematicianProgrammer (hardware)Hacker (term)PrototypeMultiplication signMeeting/InterviewComputer animation
Projective planeVideo gameContent (media)Term (mathematics)Goodness of fitMusical ensembleSource codeMeeting/InterviewLecture/Conference
PrototypeEvent horizonArithmetic meanMusical ensembleXMLMeeting/InterviewLecture/Conference
Metropolitan area networkCurve fittingComputer iconMusical ensembleACIDNormal (geometry)Event horizonMeeting/InterviewLecture/ConferenceSource codeComputer animation
Analytic continuationEvent horizonBoundary value problemVariable (mathematics)Lecture/ConferenceMeeting/InterviewJSONXML
Maxima and minimaMusical ensembleEvent horizonLecture/Conference
Product (business)Musical ensembleSpeech synthesisPrototypeMassTheoryDot productPower (physics)Lecture/Conference
PrototypeEvent horizonShift operatorPosition operatorProjective planeProduct (business)Machine visionEvoluteImage resolutionOnline helpContext awarenessLecture/Conference
Volume (thermodynamics)Musical ensembleComputer programmingMereologyLevel (video gaming)PrototypeMultiplication signHacker (term)Computer fontType theoryLecture/Conference
Demo (music)Lecture/ConferenceMeeting/Interview
Lecture/ConferenceMeeting/Interview
Series (mathematics)Universe (mathematics)Meeting/InterviewLecture/Conference
Information systemsMultiplication signMathematicsMessage passingOptical disc driveLecture/Conference
HypermediaLecture/ConferenceJSONXML
Transcript: English(auto-generated)
excited to announce Martin Bachovitz. Sorry, Martin Bachovitz is here with us today. I'm
particularly excited to announce him because he is currently reinventing body percussion. You could say he's the upcoming rock star of digital music performance art and has developed a new way to translate movement, brainwaves and heartbeats into music, turning everyday objects into instruments. Please give a big warm welcome to Martin Bachovitz,
music as the instrument. Hello, everybody. My name is Martin. I came here from Tel Aviv to talk to you about what I do,
which is basically translating physical signals into music. I'm going to show some of the prototypes and inventions I've made, and talk a little bit about working with the special needs population to enable people with disabilities to play in new ways. And also at the end of the talk, I'm going to demo something I'm working on these days, which translates
into music, and hopefully we're going to play some music on stage today as well. So, let me start by really going from the top to the very beginning. My background, as you can see, this is some of the things we're going to talk about soon. It's kind of like a spoiler. Full screen, right? This is kind of a spoiler of some of the things we're
going to talk about, but my background is actually in music and film. I came from the city of Tel Aviv, and I did some art, and for many years, that's what I did. I was a screenwriter and a director, and I was travelling the world as a musician, and I was happy. But then gradually, I started feeling like something was missing.
This little voice inside me kept telling me that my actions and my resources and my energy could be spent doing something more meaningful, something that would influence people's lives directly, and help improve other people's lives. And as I started thinking about what that could be, I reached the conclusion
that two things were missing. One was that sense of impact and meaning, and the other one was a sense of innovation, of making things that are new, that are unheard of or that are actually innovative in their field. And so, without knowing too much about what I was doing, I decided to start a company. This kind of feeling of not really knowing who you are,
that kind of identity crisis, not knowing what you want to be when you grow up was foreign for me, because ever since I was a little kid, I knew I wanted to be a filmmaker and a musician, and that's what I became. And when I started this company, I called it Shift, because it was a shift for me. It was a change in my direction in life.
And I decided to focus on innovation for purpose, meaning how to use technology, how to harness technology and innovation for positive impact for important causes. And for the first year, 2014, of this company, that's exactly what we did. We worked with start-ups, we worked with organizations, non-profits, municipalities, even a hospital,
and all of our projects were about merging technology and impact. It was a very, very educational year where I learned a lot of new things, but I also started getting into this kind of scene of innovation and start-ups, and I was fascinated especially by one thing, and that thing was hackathons.
For those of you who don't know what a hackathon is, it's basically an event where people come together from different disciplines and different backgrounds. Usually you'll find developers, designers, makers, and they all build things together in a very condensed period of time, 24 hours, 48 hours, 72 hours straight, non-stop. And once you build these things, you come and present them in the end of the hackathon.
You show what you've made and judges award you some kind of prize to the best teams. And this format was amazing for me. I started experimenting with different things I could do at a hackathon. Usually hackathons, they have some kind of center. It could be a new technology, it could be a theme where people build around that theme
and try and create different things for it. And what I found to be my theme was music technology. And this pattern started to emerge. I would come to a hackathon, I would start a team, we would build some kind of music technology prototype, and win.
And as this win started to accumulate, my life started changing. Because instead of focusing on the work I was doing with clients, I started focusing on the work I was doing with music technology. And the more dominant that became, the more the company shifted from working with clients to doing in-house projects.
And I want to show you some of these prototypes and inventions. So the first thing and also the first hackathon I ever did made me realize that what I'm fascinated by is the relationship between music technology and the human body. How can we translate our physical body into music, into sound?
And I started making this distinction in my mind between what we could do physically to control our body like moving our hands, moving our head, using our voice. We could use these things musically, we could control them. But also there are other things in our physical body, more biological things that we can't really control
like our heartbeat or our brain activity. These things are musical, at least for me. They seem very musical. But on the other hand, you might be able to influence them but you can't really control them. So how do you make music with an instrument you can't really control? I'm going to show an example of each of these now.
The first one would be the first hackathon I ever went to which was for Google Glass. Do you guys remember Google Glass? It was an experiment for Google to launch the wearable device, a glass device that would basically have a camera and a microphone and all these different sensors on it.
It was a bit early, a bit premature. And when it came to Israel, there was this big hackathon for Google Glass and it was the first time any of us has ever seen it. And when I was there, I noticed that these different groups started forming and they were forming around ideas that I felt were kind of awkward. For example, one group was trying to make a dating application using Google Glass.
They reasoned that if you read a date and you're not sure what to say or what to do, well, you have a camera and you have a microphone and you have this little screen so the Google Glass could tell you what to say If you've ever been on a date, you know it's a horrible idea. Why would you go with Google Glass to a date and say what the screen tells you to say? I wouldn't take Google Glass to a date but I might take it with me on stage.
So I started thinking, what could I do with Google Glass on stage? And what caught my mind, my curiosity, was that every Google Glass has this sensor called gyroscope that basically tracks your head movements so it knows where your head is at every given point. How could you translate those movements into music?
So I built the Google Glass Glass Beats which is basically an application that turns the Google Glass into a musical instrument. I'm going to show you a little video of that very first music technology prototype I made. If you look at the screen behind me in this video,
you see this little dot that's moving. It's moving with latency and it's tracking my head movements to show where my head is at any given point. And with this dot, I can control different effects on my voice.
So this was the very first prototype I made
and it won the Google Glass hackathon. We actually won that dating application for the Google Glass and that really got my appetite going. I was like, all right, we can make all these different things and especially, again, I was fascinated by the relationship with the physical body but if this was controlled by my head movements allowing me to loop and create layers,
control effects using head movements now came the time to try and use something more like the Google Glass hackathon something more biological, something you can't really control and so I started working with EEG. To those of you who don't know, EEG is basically a way to measure electrical activity in the brain so you can try and detect different brain waves, different types of brain activity using this technology
and I teamed up with an Israeli startup called Neurostere that developed a new way to do signal processing for EEG to detect more data from brain waves and brain activity and if you look at this graph behind me, you could see one of the things that inspired me to try and use this technology because all this red and yellow data on this graph
is basically brain activity and it's very chaotic but the guy who we're measuring here is an experienced meditator and that part where there's nothing but a very thick red line is when that guy went into very deep trance so he was able to consciously manifest change in his brain activity
and that got me thinking this might become an instrument this might become musical neurofeedback using neurofeedback to create music and the way this came about, the first prototype was working with Seffi Udi Seffi Udi is a paraplegic man so he's basically constrained to a wheelchair
and he's a very inspiring individual before he became paraplegic, he used to play guitar ever since then, he missed playing guitar he missed playing music but he couldn't really do it with any conventional instrument the EEG was a great opportunity for Seffi to try and express himself musically so teaming up with Neurosteer we created this EEG musical device
that translated Seffi's and anyone's basically brain activity into music later that day this was a hackathon as well called Tom and later that day Seffi was on stage in front of a lot of people just like now and he was playing music also, he was the only person I've ever met who was able to consciously
make the music go on and off his mind was so sharp and focused that he could say something like now I'm gonna stop the music for 20 seconds and the music would stop me personally, I played many shows with EEG and I could never do that because for most of the time and for most of the people this is very hard to control the most you can do is try and relax
or get very agitated so the EEG could kind of measure your alpha brainwaves and detect how awake you are but for any other use it's pretty limiting this is why I thought maybe we can take this one step further and make a musical hat the idea with the musical hat was to combine both things see the Google Glass was a wearable device
but it was also a ready made wearable device I didn't make it I was just using it and I was curious to see what I could do if I start from scratch so we took this designer hat that was made especially for us by Inspiralla and we added two components the first thing was a gyroscope just like the sensor in the Google Glass
that could track my head movements and the other thing were these buttons you see on screen that were enabling anyone to basically loop themselves and create layers just like the demo I showed you but the twist for this is that inside the hat I also put the EEG reader so now while you're doing loops and controlling music using hand movements
your head was controlling consciously controlling the music and your brain waves, your brain activity were unconsciously creating music as well basically merging the physical and the biological elements of making music using the body this prototype was made at an event called Music Tech Fest which is this pretty incredible event to anyone interested in this field
and it's happening at the end of this month in May in Berlin so you should probably check it out this next prototype was also made at Music Tech Fest this time in London both of which won Music Tech Fest for wearable devices this is the prototype of a glove that measures your heartbeat so just like the brain waves
I could convert the pulse of a person into music and gradually as I accumulated these different kinds of prototypes and inventions I started creating shows that were based around the physical body making music these shows were mainly made for big stages
this for example is a Microsoft stage a big event for Microsoft and for this show we had both the EEG brain waves and the heartbeat sensor I was playing an electric guitar there was a drummer, there was a didgeridoo player and we were running the whole thing through water and sand to create these geometric patterns that you see on screen behind us in real time
at another show for Google I just went on stage without any instruments and all of the music was made with the body one person was meditating on stage and kind of affecting his brain waves live while another girl was running on stage and increasing her heartbeat live and I was using motion to create more music and all of the music was done using nothing but the body
using the same technologies I started experimenting with interactive art so this for example one this is RORIM this is an interactive installation I made for Herzliya museum which is basically like this alien cocoon shape and when you stand in front of it
it feedbacks your movements your body and it gives it light and sound but the interesting thing about it is that if two people stand on both sides of this it doesn't only mirror one of them it mirrors both of them so once they sync and start moving in the same way at the same time
the whole thing comes alive the lights and the music climax and basically it measures how in sync you are with another person in your movements this kept going I made this interactive kind of dance thing with video mapping and motion gestures but as I was working on these projects I started thinking wait a minute
what about positive impact you remember how for the first year I started Shift and I was all about yeah let's do something that matters let's help people but a lot of these things were back to just having fun musical hats and dancers it's pretty cool but how are we helping people how are we changing their lives so if you think back about Sephiot the paraplegic
the more I thought about this the more I realized this connection between the physical body and music means the most for people with disabilities this is Rachele she's a young girl from Jerusalem and she has this amazing positive energy about her even though she's both cognitively and physically impaired
she can do basically nothing almost at all she can't really move she can't really speak at least not consciously the main thing Rachele could do other than smile is to wave her hand and when my friend Eris Simon came to me and said I want to create a musical instrument for Rachele
I want her to play music that was a great challenge for me because basically all Rachele could do was move her hand that's what I call a one button machine because she can't even really fine tune her movements she's just moving how could you really make music using nothing but that how could you make music accessible for a person like Rachele what we did was we created a glove
this glove this is the first version of the glove there were more versions later and this glove has three different modes so the first mode for the glove was drum mode basically every time Rachele hits a surface it creates first a kick sound and then a snare sound that way when she would play it
time after time she could play drums like this this was very empowering because she was able to start experimenting with rhythm nothing but hand movements one hand moving could enable her to play drums the second mode was DJ mode where I basically took Rachele's favorite song
which is this very uplifting positive song about the Messiah and I basically cut it into different segments different bars and so instead of just passively listening to this song Rachele could trigger the next part of the song in time she could choose when to bring the next part of the song in so this listening experience
also became an empowering active participatory experience for Rachele and the third mode wasn't even musical I took Rachele's mother to my home studio and I recorded her reading two of Rachele's favorite children books I then took those recordings and I cut them into individual sentences that way Rachele could trigger
the next part of the story whenever she wanted to and instead of being completely dependent on her mother she could use this glove to read herself a story using her mother's voice and her own movements inspired by what this allowed me to experiment with and what it allowed other people to feel I decided to take this one step further and I came up with this theory
called the music accessibility pyramid at the top of the pyramid you have professional musicians these are people who have technical abilities they have equipment they know musical theory and they spend money on music and they also make their money for music then you have people who are hobbyists they have all the same things but usually they don't really make music for money they just really spend their money on it
because it's their hobby then you have people who are not musicians at all basically thinking oh I should have started playing guitar when I was 14 or I could never drum and all these people are obviously wrong because if they wanted to any of us could just pick up an instrument at any given point and start playing but we tend to forget about
the special needs populations people who might want to play have all the passion and dedication they might be extremely talented as well but they have these challenges preventing them from playing music cognitive challenges, physical challenges making it much more difficult to experience the gift of music and my theory was what if we connect the two ends of the pyramid
what happens if we try and merge the professional musicians and the special needs population and this became an event called DISCO Tech DISCO Tech stands for disability community technology and it was the first event of its kind in the world dedicated to the creation of music technology
for people with special needs it was produced by my company Shift and also by an Israeli NGO called Imagine I made a video about this event and I'd like to show it to you are you guys ready?
DISCO Tech stands for disability community technology the idea was to take four musicians with special needs to enable them to fulfill all their fantasies and musical dreams we have four different musicians with four different challenges four different teams working on four different floors
to create four working prototypes I was born without a hand I've always wanted to be able to play so I can perform by myself the main challenge was to build the actual extension and at the same time to make the feel and the sound of the actual strumming
of the guitar pick to sound like an actual arm when I was 18 I went to a snowboarding accident since then I'm on a wheelchair we are trying to combine a few instruments together an almonica and a microphone
and a special kind of guitar everything will be connected to a looper it's all modular that you can actually disconnect and connect it back so my project here is to be a one man band Roy now is 18 years old we discovered when he was 15 months
that he has a brain tumour after the operation we discovered that he is blind also he became autistic and after two months he started to play as a weakness of his left side he played with his right hand with four fingers and the left hand with only one finger
what we did is we used one finger he has on his left hand and whenever he hits a note we turn it into a chord by supplying him the ability to set the type of the chord using his legs Alfred Green is a very talented
electronic musician he was a student of mine when I met him he could still move a little bit and talk a little bit and after a while his situation worsened we will create a system that will send midi notes to the program so he can write scores there is going to be the camera
that follows the eyes he can use his right pinky this is going to be his click and the music that he hears inside his head can get on the computer and from there to your ears we have here 3D printers
electronics and Arduino everybody is a musician and a programmer and a mathematician designers and the most talented brilliant people so it's kind of fun I'm hacking and in the background people are jamming in different prototypes all over
all the people that came here they are volunteers it's a project for them and for me it's more than a project it's my son and this is his life these four people represent so many people out there that will need these things and can benefit from them in the long term it's good for people with special needs but it's also good for hobbyists
it's also good for children and it's also good for professional musicians the main goal and ambition here is to make music accessible to as many people as possible I've never even thought that I could play I never even thought about it
music has been my psychologist it's been my lover it's been my best friend it saved me I think music is
the most powerful medium in the world and when you combine that with technology which is a massive enabler I think that's the perfect blend the main idea behind this event
is to create continuity without boundaries I really, really hope it's not the last event I really hope that it will grow not just in Israel, but everywhere disco tech is going to help a lot of people rock on
thank you guys so, one second going back to the music accessibility pyramid
for a second this event was successful in some ways because it inspired a lot of people and I went on this tour and my theory was basically, that if you take this pyramid and you connect the dots what happens is the thing reverses what helps a person with a great challenge
will definitely benefit people with a lesser challenge people who've never played people for whom it's a hobby and of course for people whom all of their lives are revolving around music but also in other ways I learnt a lesson from disco tech because as I started going on a public speaking tour speaking about this all over the world
I saw how many people were inspired and touched but I also realised how difficult it is to bring these kinds of inventions these kinds of prototypes into the mass market how difficult it is to actually make them into products that assist and help and empower a lot of people all over the world and the reason is
money, this is a niche market how could you make these inventions these prototypes into fully formed products if they're not commercially viable this got me thinking a lot about what's the next step because I thought originally I should have more of these events all over the world and I did make a lot of contacts with people wanting to make these events
but the more I thought about this the more I realised if we make more events and more prototypes more inventions but we never make the products that actually get to the hands of the people who need them what are we doing and this brings us to today and I'm very excited for this talk not only because this is an amazing event and you're a great audience
but also because I want to announce something I've been working on kind of secretly for a while and it's two different projects the first of which, the bigger one is the evolution of the company and of the vision shift is on its way to becoming an innovation lab but it's not just an innovation lab it's an innovation lab for positive impact
it's an innovation lab meant to create things that will empower and help people and solve challenges I've been fortunate enough to go on these tours at the MIT Media Lab, NYU Innovation Lab Harvard Innovation Lab, Google X I saw all these people working on inspiring projects and I asked them questions and I've been seeking the advice of people much more experienced than I am
and I'm hoping that by 2017 we're going to launch these labs talking to potential partners now and dreaming about making this a reality and in the meantime I'm working on my latest project which I have with me right here and I'm going to demonstrate for you guys are you ready? are you ready? come on
this project is called Airstrument and it's the first project for the lab this is a prototype obviously kind of looks like a prototype first let's see if the sound even works alright, one second give me some volume alright, so what this does is basically
this is the accumulation of what I've been talking about I again went to music tech fest this time in Sweden and I created this prototype for an instrument that's controlled by gestures by hand movements because I realized this might be the most efficient and the most intuitive way for people who don't play music to play music, to learn music understand music
this spatial intuitive movement could be what makes music accessible in a whole new way and once we made this prototype it won the hackathon and we got into this incubation program called music bricks which is part of the European Union and we're now finishing the incubation program and going into the next level
and I'm gonna try and do a little demo for you guys hopefully it works, let's check it out alright, thank you very much
for your time
so just just to finish off thank you guys I just want to leave you with this one simple message
find the sweet spot of what you're excited about what you would do if no one would pay you what you think about when you get up in the morning and try and find try and find where that meets what you think could benefit the world what the world needs and when you find that sweet spot go for it and make a change my name is Matan, thank you very much
enjoy