Jazzperiments
This is a modal window.
The media could not be loaded, either because the server or network failed or because the format is not supported.
Formal Metadata
| Title |
| |
| Title of Series | ||
| Number of Parts | 90 | |
| Author | ||
| License | CC Attribution 2.0 Belgium: You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor. | |
| Identifiers | 10.5446/40298 (DOI) | |
| Publisher | ||
| Release Date | ||
| Language |
Content Metadata
| Subject Area | ||
| Genre | ||
| Abstract |
|
FOSDEM 201343 / 90
2
5
8
10
12
13
14
15
17
19
21
24
25
28
29
31
32
34
36
39
40
43
44
46
50
51
52
54
55
57
58
62
65
66
67
78
79
87
88
00:00
Sound effectKey (cryptography)MereologyProjective planeMultiplication signInteractive televisionMusical ensembleLecture/Conference
00:36
Musical ensembleNatural numberInterface (computing)Program flowchartLecture/Conference
00:56
Computer programmingNeuroinformatikMoment (mathematics)Java appletPhysical systemProcess (computing)Program flowchart
01:37
Interactive televisionMusical ensembleMereologyCausalityMaxima and minimaCASE <Informatik>Instance (computer science)Multiplication signLecture/Conference
02:12
Power (physics)SynchronizationProgram flowchart
03:08
BitComputer programmingTouchscreenNeuroinformatikKeyboard shortcutLecture/Conference
03:31
TheoryComputability theoryKeyboard shortcutMusical ensembleComputer programmingProgram flowchart
03:49
BitScaling (geometry)Keyboard shortcutPhysical systemSynchronizationLecture/Conference
04:31
Scaling (geometry)Instance (computer science)Right angleChromatisches PolynomKey (cryptography)Musical ensembleKeyboard shortcutProgram flowchart
05:20
Scaling (geometry)NeuroinformatikPhysical systemInstance (computer science)Lecture/Conference
06:13
OctaveScaling (geometry)Sound effectProgram flowchartLecture/Conference
06:34
Sound effectJava appletCartesian coordinate systemWebsiteProgram flowchartLecture/Conference
07:02
Computer programmingGoodness of fitLaptopNeuroinformatikFeedbackMusical ensembleHacker (term)MIDIKey (cryptography)Java appletLibrary (computing)Lecture/Conference
08:33
Special unitary groupSet (mathematics)Library (computing)Musical ensembleSampling (statistics)Program flowchartLecture/Conference
08:59
Computer animationProgram flowchart
09:30
Lecture/ConferenceProgram flowchart
09:55
Row (database)Instance (computer science)Sampling (statistics)Lecture/Conference
10:25
Instance (computer science)Sampling (statistics)Program flowchart
10:50
Multiplication signSampling (statistics)Projective planeLecture/ConferenceProgram flowchart
11:55
Instance (computer science)Projective planeVideoconferencingInterface (computing)Lecture/Conference
12:15
MereologyForcing (mathematics)Computer animation
12:53
Electronic visual displayProjective planeComputer animationProgram flowchart
13:14
Positional notationMusical ensemble
13:52
Musical ensembleSampling (statistics)Moment (mathematics)Computer programmingAreaDependent and independent variablesUser interfaceMultiplication signType theoryNeuroinformatikPressureBitDifferent (Kate Ryan album)Mathematical analysisFrequencyMetropolitan area networkInternetworkingFeedbackAlgorithmIntegrated development environmentPrice indexDirectory serviceMIDIComputer hardwareLecture/Conference
18:15
Source codeSound effectSet (mathematics)BitMereologyTouchscreenDifferent (Kate Ryan album)Scaling (geometry)Chromatisches PolynomGreatest elementPattern recognitionAxiom of choiceLecture/ConferenceComputer animationProgram flowchart
19:08
Multiplication signScaling (geometry)Musical ensembleInstance (computer science)BitGroup actionMoment (mathematics)LogicPattern recognitionLecture/Conference
21:03
Row (database)Maxima and minimaProgram flowchartLecture/Conference
21:26
Multiplication signMenu (computing)InformationNoise (electronics)outputLecture/Conference
22:05
Multiplication signForcing (mathematics)Program flowchartLecture/Conference
22:35
Forcing (mathematics)CASE <Informatik>Right angleMultiplication signProgram flowchart
22:59
BitSet (mathematics)Multiplication signLecture/Conference
Transcript: English(auto-generated)
00:01
Thank you very much. I want to talk about jazz pyramids, and that's a project which is running over some time already To make interactive music and it's already started as you hear the whole idea was in originally that we wanted to Do something with effects and sounds while I was playing the clarinet
00:21
Well, you see a lot of keys on these instruments And it means that when you want to play extra sounds like a bass part, which is already running Then you need Paddles or something but all the whole idea was what's the more natural? Interface for music than a microphone and that's what we did. We hooked up a microphone and we started
00:46
experimented to Make automatic improvisation automatic Accompaniment and things like that. I can give you a little example already What what happens when you play a clarinet with this? Computer program and and how it sounds
01:18
So the computer listens to what I do
01:22
Fourier It process this sound in a very intelligent way Thanks to Carl Helga's on this Java sound engine switch off the Microphone for a moment and you have a kind of system which allows you to Play play interactively in this case. It plays a bass part while I'm playing the clarinet and
01:46
You hear that it follows me. Of course, you have to do is latency The thing doesn't know what you will play so it has to measure it and that takes time and that was one of the big problems with all kinds of automatic improvisation and
02:00
Interactive music that latency causes Delays, which you can't can hear. Well, is this the maximum speed? No, it isn't you can play a lot faster For instance when I play now You see the metronome is is going faster, too
02:25
Now it's already in sync, can I go faster yes, I can even go faster when you go to Now it uses all the power it has to calculate things you get this
02:48
But You see what happened. This is the maximum speed it doesn't Do anything with the musical speed anymore what it did at the previous speed it was
03:00
short presto note What it does now is maximum speed and it's out of sync you clear the kind of ad that the delay is even more Nasty than the previous one, although it's almost half as short but a good kind of
03:20
Being too late is better than being just a little bit too late And that's the idea behind a lot of thinking in this program So you see already a metronome on the screen and a computer and a keyboard of a piano And you see all kind of instruments mentioned there and intervals and you can do something with always musical
03:41
terminology musical theory This there is a lot of computer theory inside this program, but there is also a lot of musical theory so this latency stuff that you Try to solve the latency problem by Playing in sync, although it's a little bit too late, which is better than just as the maximum speed
04:04
That's the musical approach the same you can do with the accuracy of the whole system You see you listen that you hear that It's quite accurate already and that is because it doesn't recognize all notes It only filters out the notes you want to recognize and it converges
04:22
Eventual problems with Intonation of a clarinet to notes which are there in the scale as you can see on the on the on the piano keyboard on top of Course in most music you don't use all the notes which are on a piano So you can even converge more and I do you like this now
04:41
We had a chromatic scale and for instance when I choose a blue scale My piano gets all kind of great keys at top. So these notes aren't there anymore So it can't make a mistake in that respect and when I play now you get I should play in a bluesy style but then you get another solution for this problem of tonality
05:13
On the keyboard even changed because it notices that my first note was a C and that it has to switch the scales to the right to play the right scale over there. In fact what we
05:25
What you do in this way is that you can make a kind of presets of accompaniment and Play quite freely. We did a lot of experiments with kids and and and and in schools You can play quite freely and the computer always plays something which is well more or less agreeable. You can handle it
05:44
it is it's a way of adding extra voices to When you're singing or when you play a clarinet or something, it is actually kind of Accompaniment and of course, there will be improvements possible I will come to that later, but it's already quite useful in that respect
06:06
I can give a little impression what you can do more could do with the system for instance when you have You can kind choose all kinds of intervals You can you can set that at well play an octave lower or higher than what you played
06:22
It can play in a certain octave always so that when whatever height I play it played notes on in us in a certain Scale plays it back and even what you can do you can invert it and now you get a very strange effect When I play high it plays low and other way around
06:53
Going up and down and that's It's just fun to do. It's on the website. This is Java application and
07:01
You can just start it and it's fast enough to play with Reasonable computer you need Kind of good microphone when you do it with the built-in microphone of a laptop you get Feedback and it's it's not as nice as when you have some kind of microphone But anyone know any microphone of fewer euros is good enough
07:26
So this is the idea behind automatic Improvisation automatic music making and of course you you have talked about And using technology to make more or less a new musical instrument, but that's nothing new
07:42
people have always Used technology to make music this this this instrument is built in the 19th century at the beginning of the 19th century We had two copper little copper Keys to close some holes now you see there are 18 of these on it and that's technology of the 19th century and you can be we can can be sure that it has a lot of hacking to get this done and
08:06
When we have to do some hacking to use computers in a nice way for music. That's I think a very good idea Of course, you can also go to experimental music and the previous Talk, I liked very much because then you see you have you have a completely different approach to music more experimental
08:23
And in fact, you can do this here, too We use a lot of MIDI notes in this in this Program as you see all the notes what you hear till now was MIDI and also from the Java sound library of So you have a nice set of 128 instruments you can use for everything you want
08:45
but the idea was also what can we do with samples and How we can we record samples in such a way that you can use them in music well, I showed you that sorry for windows in between
09:51
Strange sounds or everything made just right now and it's even possible to continuously
10:01
Record new samples For instance when I go Now it will Automatically record new the tonal samples in this green voice. So I have four voices
10:26
Two voices are noisy. Now, that's some kind of percussion is just because I handled the microphone in a destructive way the first one is this Sample of the of the tuning fork and the last one is now for instance my voice
11:22
Also in time you can move But you see that that this is more of a much more creative but also much more unpredictable way to use your
11:55
Instruments, but of course you can use that in many ways and in in we did a project on John Cage last
12:04
Autumn and then we had Not only this very technical musically technical Interface but also other interfaces to use Here you show the notes in harmony
12:37
notes To the voices which are playing those
12:41
So every voice has its own character and use a part of the song so you can see which note was played in Which voice when you're fast enough, but it's just fun to look at It's a nice this is another display which which I like a lot
13:07
This is one the one we did for John John Cage's project don't cage created this
13:48
Music notation because it's so intuitive and it made it for the very nice piece called aria in 1952 so you see that new music isn't like my
14:03
Isn't that new and I think we have when you're when you love music you have to also more or less the Responsibility to think of new things in this respect Of course this program we worked quite a lot of time already on it already But there are lots of opportunities to improve it. First of all these algorithms both musical
14:25
what is smart to do when you have delay where you have to cope with or Technically new engines better Programming for for reducing latency or other other things But there are other things which I think of what could be very nice. I
14:45
Love it. I died II that a user interface for music is in microphone. You don't need anything else. No pedals. No button no stuff But the camera inside the computer could be used for tempo indications. Let's be clear when
15:00
Directories for an orchestra. He uses his hands just to make gestures and why Couldn't a computer recognize those all the things you can think of is that there is special hardware for Fourier analysis so which is built to Measure as fast as possible the frequency of a note you could use that too
15:21
So everybody who likes this idea and wants to and anything to do with it or to work on it You know the website it's in the in the little booklet and and and just experiments when you type in the name You will find it soon enough When there are any questions just ask them maybe there are some people who want to want to do something with it. Yes
16:00
More more more or less, but the men sitting there right behind you and knows a lot more about this
16:08
Technical stuff Carl. Can you please answer this question?
16:35
What in practice in the in in in Using MIDI notes, there is no problem with latency whatsoever
16:43
So you have it's fast enough simply because these notes are played and when they are played a milli of a second too late And you saw what trick I do that I just play them on the right time in the timing of the music. You don't find anything troublesome in that respect latency in that
17:00
That is caused by the fact that the computer Recognizes the voice too late and that's something that has to do with the type of instruments even with a Wind instrument each note you recognize is too high too low when you start because the pressure isn't built up yet And when there's a percussion instrument or a piano every note you play
17:20
starts too high because it hits with a lot of overtones and dampens a little bit out so latency is inevitable But there you have a different kind of latency and what what Carl said when you make samples Of course, these samples are recorded at the moment that someone isn't singing then I switch off everything take a sample of what what I hear and
17:46
Move and moves on. Oh, sorry. It's it's taken at the moment that my program isn't playing anything So then I switch off everything listen to what what the player is doing and then make a sample of it Also very handy that you never have feedback. Yes. Yes
18:19
That's true it in effect what what you can do is with and and I can pick the setting
18:28
you see that here we have a Yes in this on the bottom. Have you have the scale can be? Selected automatically when you know what you want to do. You don't want an automatic scale you choose one and you have a choice of scales
18:43
With a little bit part of the screen is falling off, but there are About 80 different scales from Egyptian Dorian chromatic blues, of course It's a very well known but we put everything in it So when you say I want to play in the blue scale of C and you go
19:00
Then you have a very accurate recognition because it only recognizes of the notes it will use and The speed is also a little bit better because you can be in in in the in the recognition of the notes You can be a little bit less accurate because you know that there are bigger intervals between the notes
19:32
Then there you go. There comes this automatic stuff in when you Play and what I did wasn't a play the C then with this automatic switching
19:43
It knows I have to start in the scale of C then I can leave a little pause after for instance four bars and then move to the F and Play a little bit and isn't that follows it again, but I must say
20:01
It's This is this is you have to really get used to it so when when it when does this intuitive playing where you just let it follow and most of the time I use then a whole tone scale over or a Chromatic scale which is always right or not, right, but this works always works and
20:23
That's they have a lot of freedom Whereas but I work with a group of people who sing Choreons chant at the moment They know exactly what they have to do to to fix always this so and they write music to Sing along with this thing with their own voices
20:56
Yeah, yes That's quite simple
21:03
The logic is that you have and you can see that over here It records notes manually then you have to switch this little button and it records in this voice a red or yellow blue or a green voice are maximum via four voices, that's that's
21:21
technically Almost the maximum you can can process and so you can switch to note manual note Once note automatic, that means that it will take tonal information Only record it when you want it record it once and then keeps it or
21:40
Record it every time it has the chance to record something and the same is applies for noises so you can do percussion, too that's different Processed in a completely different way, by the way, because yes, you can't transpose it and and stuff like that But so you can switch F for every voice you can switch to manual noise manual note input or something like that
22:15
No, no, no when when you left when you want to organize this Maybe you should because it's nice when things happen by chance
22:24
But when you don't organize it and two people play at the same time you have a mixed sample But and it's put in one of these voices you can of course say when this and you see this white ball there That's the red voice is now ready for recording when I say you play the red voice
22:41
And I have to keep my mouth shut while you are doing something But okay, but it's also in a museum with kids and everybody was thinking On this time nobody knew who was who and in this case, yes
23:01
Mm-hmm Yes, it is inter you're here to let it right now It did it of course it depends of how is this setting is not ideal and was a little bit correct microphone You don't have this problem But it can when you when you change the settings a little bit it can play for hours
23:23
without you being there even any other questions You see a lightning talk is long enough when it's when the subject is interesting Yes, I'm over time. Oh Okay, thank you very much for your attention