We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Jazzperiments

00:00

Formal Metadata

Title
Jazzperiments
Title of Series
Number of Parts
90
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Interactive musical improvisation Jazzperiments is an open source Java application which enables musicians to have an interactive 'jam' with their computer. Imagine you sing, whistle or play an instrument and your computer plays along ... not just a like a dull 'rhythm box' with some ever repeating chords, but really interactive, following your own free improvisation. Jazzperiments is a project to achieve just this, open source, based on the beautiful Gervill JavaSound library of Karl Helgason (FOSDEM veteran). ... ready to try out or even use in performances ... click on JAM and start 'jamming'. However as the system works better and better there are more and more options to improve and extend it: new user interfaces (something with a camera would be very nice to 'direct' the app), reducing latency, even more tricks with live samples etc. etc. If you combine love for programming and music (and who doesn't?) a lightning talk is long enough to challenge you to participate in any way ... and it's not just a talk ... there will even be time for a lightning concert/jam...
25
Thumbnail
15:46
51
54
Thumbnail
15:34
55
57
Thumbnail
1:02:09
58
Thumbnail
16:08
62
Thumbnail
13:26
65
67
Sound effectKey (cryptography)MereologyProjective planeMultiplication signInteractive televisionMusical ensembleLecture/Conference
Musical ensembleNatural numberInterface (computing)Program flowchartLecture/Conference
Computer programmingNeuroinformatikMoment (mathematics)Java appletPhysical systemProcess (computing)Program flowchart
Interactive televisionMusical ensembleMereologyCausalityMaxima and minimaCASE <Informatik>Instance (computer science)Multiplication signLecture/Conference
Power (physics)SynchronizationProgram flowchart
BitComputer programmingTouchscreenNeuroinformatikKeyboard shortcutLecture/Conference
TheoryComputability theoryKeyboard shortcutMusical ensembleComputer programmingProgram flowchart
BitScaling (geometry)Keyboard shortcutPhysical systemSynchronizationLecture/Conference
Scaling (geometry)Instance (computer science)Right angleChromatisches PolynomKey (cryptography)Musical ensembleKeyboard shortcutProgram flowchart
Scaling (geometry)NeuroinformatikPhysical systemInstance (computer science)Lecture/Conference
OctaveScaling (geometry)Sound effectProgram flowchartLecture/Conference
Sound effectJava appletCartesian coordinate systemWebsiteProgram flowchartLecture/Conference
Computer programmingGoodness of fitLaptopNeuroinformatikFeedbackMusical ensembleHacker (term)MIDIKey (cryptography)Java appletLibrary (computing)Lecture/Conference
Special unitary groupSet (mathematics)Library (computing)Musical ensembleSampling (statistics)Program flowchartLecture/Conference
Computer animationProgram flowchart
Lecture/ConferenceProgram flowchart
Row (database)Instance (computer science)Sampling (statistics)Lecture/Conference
Instance (computer science)Sampling (statistics)Program flowchart
Multiplication signSampling (statistics)Projective planeLecture/ConferenceProgram flowchart
Instance (computer science)Projective planeVideoconferencingInterface (computing)Lecture/Conference
MereologyForcing (mathematics)Computer animation
Electronic visual displayProjective planeComputer animationProgram flowchart
Positional notationMusical ensemble
Musical ensembleSampling (statistics)Moment (mathematics)Computer programmingAreaDependent and independent variablesUser interfaceMultiplication signType theoryNeuroinformatikPressureBitDifferent (Kate Ryan album)Mathematical analysisFrequencyMetropolitan area networkInternetworkingFeedbackAlgorithmIntegrated development environmentPrice indexDirectory serviceMIDIComputer hardwareLecture/Conference
Source codeSound effectSet (mathematics)BitMereologyTouchscreenDifferent (Kate Ryan album)Scaling (geometry)Chromatisches PolynomGreatest elementPattern recognitionAxiom of choiceLecture/ConferenceComputer animationProgram flowchart
Multiplication signScaling (geometry)Musical ensembleInstance (computer science)BitGroup actionMoment (mathematics)LogicPattern recognitionLecture/Conference
Row (database)Maxima and minimaProgram flowchartLecture/Conference
Multiplication signMenu (computing)InformationNoise (electronics)outputLecture/Conference
Multiplication signForcing (mathematics)Program flowchartLecture/Conference
Forcing (mathematics)CASE <Informatik>Right angleMultiplication signProgram flowchart
BitSet (mathematics)Multiplication signLecture/Conference
Transcript: English(auto-generated)
Thank you very much. I want to talk about jazz pyramids, and that's a project which is running over some time already To make interactive music and it's already started as you hear the whole idea was in originally that we wanted to Do something with effects and sounds while I was playing the clarinet
Well, you see a lot of keys on these instruments And it means that when you want to play extra sounds like a bass part, which is already running Then you need Paddles or something but all the whole idea was what's the more natural? Interface for music than a microphone and that's what we did. We hooked up a microphone and we started
experimented to Make automatic improvisation automatic Accompaniment and things like that. I can give you a little example already What what happens when you play a clarinet with this? Computer program and and how it sounds
So the computer listens to what I do
Fourier It process this sound in a very intelligent way Thanks to Carl Helga's on this Java sound engine switch off the Microphone for a moment and you have a kind of system which allows you to Play play interactively in this case. It plays a bass part while I'm playing the clarinet and
You hear that it follows me. Of course, you have to do is latency The thing doesn't know what you will play so it has to measure it and that takes time and that was one of the big problems with all kinds of automatic improvisation and
Interactive music that latency causes Delays, which you can't can hear. Well, is this the maximum speed? No, it isn't you can play a lot faster For instance when I play now You see the metronome is is going faster, too
Now it's already in sync, can I go faster yes, I can even go faster when you go to Now it uses all the power it has to calculate things you get this
But You see what happened. This is the maximum speed it doesn't Do anything with the musical speed anymore what it did at the previous speed it was
short presto note What it does now is maximum speed and it's out of sync you clear the kind of ad that the delay is even more Nasty than the previous one, although it's almost half as short but a good kind of
Being too late is better than being just a little bit too late And that's the idea behind a lot of thinking in this program So you see already a metronome on the screen and a computer and a keyboard of a piano And you see all kind of instruments mentioned there and intervals and you can do something with always musical
terminology musical theory This there is a lot of computer theory inside this program, but there is also a lot of musical theory so this latency stuff that you Try to solve the latency problem by Playing in sync, although it's a little bit too late, which is better than just as the maximum speed
That's the musical approach the same you can do with the accuracy of the whole system You see you listen that you hear that It's quite accurate already and that is because it doesn't recognize all notes It only filters out the notes you want to recognize and it converges
Eventual problems with Intonation of a clarinet to notes which are there in the scale as you can see on the on the on the piano keyboard on top of Course in most music you don't use all the notes which are on a piano So you can even converge more and I do you like this now
We had a chromatic scale and for instance when I choose a blue scale My piano gets all kind of great keys at top. So these notes aren't there anymore So it can't make a mistake in that respect and when I play now you get I should play in a bluesy style but then you get another solution for this problem of tonality
On the keyboard even changed because it notices that my first note was a C and that it has to switch the scales to the right to play the right scale over there. In fact what we
What you do in this way is that you can make a kind of presets of accompaniment and Play quite freely. We did a lot of experiments with kids and and and and in schools You can play quite freely and the computer always plays something which is well more or less agreeable. You can handle it
it is it's a way of adding extra voices to When you're singing or when you play a clarinet or something, it is actually kind of Accompaniment and of course, there will be improvements possible I will come to that later, but it's already quite useful in that respect
I can give a little impression what you can do more could do with the system for instance when you have You can kind choose all kinds of intervals You can you can set that at well play an octave lower or higher than what you played
It can play in a certain octave always so that when whatever height I play it played notes on in us in a certain Scale plays it back and even what you can do you can invert it and now you get a very strange effect When I play high it plays low and other way around
Going up and down and that's It's just fun to do. It's on the website. This is Java application and
You can just start it and it's fast enough to play with Reasonable computer you need Kind of good microphone when you do it with the built-in microphone of a laptop you get Feedback and it's it's not as nice as when you have some kind of microphone But anyone know any microphone of fewer euros is good enough
So this is the idea behind automatic Improvisation automatic music making and of course you you have talked about And using technology to make more or less a new musical instrument, but that's nothing new
people have always Used technology to make music this this this instrument is built in the 19th century at the beginning of the 19th century We had two copper little copper Keys to close some holes now you see there are 18 of these on it and that's technology of the 19th century and you can be we can can be sure that it has a lot of hacking to get this done and
When we have to do some hacking to use computers in a nice way for music. That's I think a very good idea Of course, you can also go to experimental music and the previous Talk, I liked very much because then you see you have you have a completely different approach to music more experimental
And in fact, you can do this here, too We use a lot of MIDI notes in this in this Program as you see all the notes what you hear till now was MIDI and also from the Java sound library of So you have a nice set of 128 instruments you can use for everything you want
but the idea was also what can we do with samples and How we can we record samples in such a way that you can use them in music well, I showed you that sorry for windows in between
Strange sounds or everything made just right now and it's even possible to continuously
Record new samples For instance when I go Now it will Automatically record new the tonal samples in this green voice. So I have four voices
Two voices are noisy. Now, that's some kind of percussion is just because I handled the microphone in a destructive way the first one is this Sample of the of the tuning fork and the last one is now for instance my voice
Also in time you can move But you see that that this is more of a much more creative but also much more unpredictable way to use your
Instruments, but of course you can use that in many ways and in in we did a project on John Cage last
Autumn and then we had Not only this very technical musically technical Interface but also other interfaces to use Here you show the notes in harmony
notes To the voices which are playing those
So every voice has its own character and use a part of the song so you can see which note was played in Which voice when you're fast enough, but it's just fun to look at It's a nice this is another display which which I like a lot
This is one the one we did for John John Cage's project don't cage created this
Music notation because it's so intuitive and it made it for the very nice piece called aria in 1952 so you see that new music isn't like my
Isn't that new and I think we have when you're when you love music you have to also more or less the Responsibility to think of new things in this respect Of course this program we worked quite a lot of time already on it already But there are lots of opportunities to improve it. First of all these algorithms both musical
what is smart to do when you have delay where you have to cope with or Technically new engines better Programming for for reducing latency or other other things But there are other things which I think of what could be very nice. I
Love it. I died II that a user interface for music is in microphone. You don't need anything else. No pedals. No button no stuff But the camera inside the computer could be used for tempo indications. Let's be clear when
Directories for an orchestra. He uses his hands just to make gestures and why Couldn't a computer recognize those all the things you can think of is that there is special hardware for Fourier analysis so which is built to Measure as fast as possible the frequency of a note you could use that too
So everybody who likes this idea and wants to and anything to do with it or to work on it You know the website it's in the in the little booklet and and and just experiments when you type in the name You will find it soon enough When there are any questions just ask them maybe there are some people who want to want to do something with it. Yes
More more more or less, but the men sitting there right behind you and knows a lot more about this
Technical stuff Carl. Can you please answer this question?
What in practice in the in in in Using MIDI notes, there is no problem with latency whatsoever
So you have it's fast enough simply because these notes are played and when they are played a milli of a second too late And you saw what trick I do that I just play them on the right time in the timing of the music. You don't find anything troublesome in that respect latency in that
That is caused by the fact that the computer Recognizes the voice too late and that's something that has to do with the type of instruments even with a Wind instrument each note you recognize is too high too low when you start because the pressure isn't built up yet And when there's a percussion instrument or a piano every note you play
starts too high because it hits with a lot of overtones and dampens a little bit out so latency is inevitable But there you have a different kind of latency and what what Carl said when you make samples Of course, these samples are recorded at the moment that someone isn't singing then I switch off everything take a sample of what what I hear and
Move and moves on. Oh, sorry. It's it's taken at the moment that my program isn't playing anything So then I switch off everything listen to what what the player is doing and then make a sample of it Also very handy that you never have feedback. Yes. Yes
That's true it in effect what what you can do is with and and I can pick the setting
you see that here we have a Yes in this on the bottom. Have you have the scale can be? Selected automatically when you know what you want to do. You don't want an automatic scale you choose one and you have a choice of scales
With a little bit part of the screen is falling off, but there are About 80 different scales from Egyptian Dorian chromatic blues, of course It's a very well known but we put everything in it So when you say I want to play in the blue scale of C and you go
Then you have a very accurate recognition because it only recognizes of the notes it will use and The speed is also a little bit better because you can be in in in the in the recognition of the notes You can be a little bit less accurate because you know that there are bigger intervals between the notes
Then there you go. There comes this automatic stuff in when you Play and what I did wasn't a play the C then with this automatic switching
It knows I have to start in the scale of C then I can leave a little pause after for instance four bars and then move to the F and Play a little bit and isn't that follows it again, but I must say
It's This is this is you have to really get used to it so when when it when does this intuitive playing where you just let it follow and most of the time I use then a whole tone scale over or a Chromatic scale which is always right or not, right, but this works always works and
That's they have a lot of freedom Whereas but I work with a group of people who sing Choreons chant at the moment They know exactly what they have to do to to fix always this so and they write music to Sing along with this thing with their own voices
Yeah, yes That's quite simple
The logic is that you have and you can see that over here It records notes manually then you have to switch this little button and it records in this voice a red or yellow blue or a green voice are maximum via four voices, that's that's
technically Almost the maximum you can can process and so you can switch to note manual note Once note automatic, that means that it will take tonal information Only record it when you want it record it once and then keeps it or
Record it every time it has the chance to record something and the same is applies for noises so you can do percussion, too that's different Processed in a completely different way, by the way, because yes, you can't transpose it and and stuff like that But so you can switch F for every voice you can switch to manual noise manual note input or something like that
No, no, no when when you left when you want to organize this Maybe you should because it's nice when things happen by chance
But when you don't organize it and two people play at the same time you have a mixed sample But and it's put in one of these voices you can of course say when this and you see this white ball there That's the red voice is now ready for recording when I say you play the red voice
And I have to keep my mouth shut while you are doing something But okay, but it's also in a museum with kids and everybody was thinking On this time nobody knew who was who and in this case, yes
Mm-hmm Yes, it is inter you're here to let it right now It did it of course it depends of how is this setting is not ideal and was a little bit correct microphone You don't have this problem But it can when you when you change the settings a little bit it can play for hours
without you being there even any other questions You see a lightning talk is long enough when it's when the subject is interesting Yes, I'm over time. Oh Okay, thank you very much for your attention