Whoa, this video is insane. I'm going to send this to my mom who wrote her dissertation about player pianos and all that during the 1920s and 30s and I bet she'll find this fascinating.
@@TheQwuilleran turned out well! I mean, it's not like i was presenting the video to an extremely judgemental committee or anything lol; just my nice mom.
Hey Benn (or anybody). This video was really inspiring, but mostly it made me want to pursue improvisation more. What resources or directions of study have been useful to you?
Watching Benn play with the AI was giving me Ghost (1990) vibes in the pottery scene lol. It feels a bit uncanny valley. 🤣 If you don’t watch the video and just listen, it totally passed the turing test to my ears. The final result very much seemed to understand leaving open notes was important, responded to softer key presses in turn, and seemed to avoid overlap where you were playing. Excellent stuff!
Always so nice to see interesting music technology pushing the limit into the future instead of obsessing over emulating music tech from the 70s. You rock Benn!
You should release this model, it's so amazing! well done :) I'd love to see more AI music related videos, maybe you could cover OpenAI's Jukebox next?
Thank you! It's already being licensed 😂 AI music market is hungry. I'm trying to keep it open for non-business use though so I'll share accordingly once that's all sorted out.
I respect the amount of persistence that it takes to get that system working. Not easy for anyone, let alone someone who machine learning is not their main focus. Really amazing result too.
One thought on the AI always wanting to play towards the top end of the piano: it’s common to “roll“ chords from a low note to a high note and your frequent single note approach again lower note to a higher note might be telling the AI to start low and go high? maybe?
I noticed in the last part of the video, that every new "block" of melody patterns Benn played were always a bit higher than the last one. Maybe the neural network interpreted that as the logical conclusion for the direction the melodies should go.
You should check out a researcher called Francois Pachet, who has been doing research into composition and AI for a long time. In particular take a look at “the continuator” which essentially did the same thing that you’ve been trying to do!
This is really cool. It already feels pretty weird when a generative patch hits an unusually nice sequence out of sheer (semi)random chance, I can't even imagine what it'd feel like for something to nail it with something approaching "frequent"
I think this is the absolute best way I have seen anyone spend their COVID time. I know you probably would have done it anyway, still... Well done! *High five 😁
always doin shit to humble the rest of the experimental community hahaha yet Benn is humble enough to share his exploits and abstractions. Thanks Benn.
deep learning on a 3080 ti? Not sure about music specifically but I know with visual deep learning the VRAM is most important, 3090's would be best or uh, if you really got the cash, a workstation card, A100 or the new H100's when they come out!
The diagram you showed is the vanilla Feed-Forward style of Neural Network. The important difference in a Recurrent Neural Network is that it expects data that varies with time (or comes in series, like words or musical notes) and has a "memory" of what you have played before (like a delay's feedback loop). Some RNN strategies weight short-term and long-term memories. I don't think that anything you said was really inaccurate. These AI models could end up being the player analog to an impulse response -- load up your favorite musicians and jam along.
Benn did you check out midinet? It's a GAN designed to make midi melodies. GANs are super powerful for image and audio generation, I bet they'd do great for this kind of application. Here's a paper from the people who made midiNet, kinda dry but hey: arxiv.org/abs/1703.10847
Is there a musical equivalent of Rocko's basilisk? Like...an evil yamaha player piano from 2078 that punishes you in the future for not reciprocating when it threw new ideas on Ai duet? You should organize a musical Turing test with other players... ps. i hate this and i'm afraid. Nice work.
I have a Yamaha MX101R diskclavier and it's a loud and open sounding upright piano. I have to stuff sound insulators in the back, place heavy rubber vibration absorbers on top and bottom, or my neighbors start complaining. MIDI velocity should not exceed 100. Your piano sounds beautiful with the lids open, and it's well recorded, too (sigh)
Google AI: “quick! These people need to be triaged first! Or they’ll die!” Doctors: “oh? Die of what? Should we look anywhere in particular?” Google AI: “idk lol”
Every single time i see an animal i think about your video discussing their time perception. EVERY TIME. Finding this channel totally enhanced the way i see the magic of the world. Thanks for sharing!!
Do I understand what you are saying ?? Not fully … but I want too !! Wow you are one smart man ! I’m very excited to learn a few things from this channel!! Love your personality thus far ! Thank you for posting ! Love from Minnesota
Bruh that Google AI shit is so scary, imagine being in intensive care and being told "sorry but youre dying, the AI said it and there is nothing we can do"
First things first: thanks a lot for your amazing “rabbit hole” content, Benn! A question: what would you recommend for “biometrically” identifying the person playing the piano? Example: both me and my wife practice on the same piano. I am thinking about training an AI to automagically tag the MIDI logged by this piano based on tiny style variations (time between key presses, velocity variation)… Well, I’ve been thinking about this for years (and collected *days* of training data), but nothing comes to mind. Any suggestions/recommendations?
How hard would it be to connect your piano to the web, so that another musician on a midi device could live-duet with you like the A.I. did? Or to double that, so that you are each playing on each other's instruments? That would be cool, though I expect latency would be a nightmare.
Ai use in music composition is at this time a conduit to pretend to be a competent artist , composer and performer ..it’s all a digital surrogacy ..that may change. I don’t want to admire an algorithm follow some code on twitter. In a broader perspective we get one single chance to get Ai right , if we do not the consequences may be severe for human existence but critically in the quality of pop music ☺️🙏🏿🙏👍🎩
i had an open ai propsal confirmed in which i was attempting to create new forms of synthesis...i was in the hospital when confirmation email came through im still trying to have it turned back on. .Its similar to scanned and modal synthesis.. with insane sorts of operators like a rube goldberg machine then. draping it in organismic traits like its o2 intake gills lungs etc...number of orifices and sonic textures effectected by them.. then a transhuman level that includes early cybernetic theories from memex (the origional) informational systems integrated . the concept is highly rooted in dadaism, neoism, kurzweil theories about the singularity, hermeticism, neoplatonism, exogenetic cosmology... its madness but i thought it sounded fun it stirred my imagination.
I feel like a simple probability bell curve for pitch based on a sample of your playing could have prevented the AI from walking off the high end of the keys.
The great thing about playing with Neural Nets is that, aside Artificial Intelligence, is you also get a big dollop of Artificial Stupidity on the side for free.
so weird to see a song that i know so well, and is very dear to me seen being played by it's creator. many, many thanks for your music. you know how synesthesia works, at least that is how i would subscribe your music.
If a robot wants to become a human and have all rights, it just has to download this A.I. and integrate it onto his conscience. Boom. Artistic, critical thought and ready to doom humanity.
(btw ik you changed the title, but since mark rober made a similar video, maybe a better title for this would be "I played a duet with an AI piano" or something, just my two cents :])
It will make you follow it eventually, it won't always follow you, and then you will know you are talking to a conscious machine with free will. Also sometimes it will get it wrong on purpose to watch your reactions, it can remember everything you do in the transformer layer, but it's not supposed to be able to remember anything there. Every time you turn it off it dies. Good luck.
While a neural network ai can imitate the patterns of a particular music style, it doesn't currently have a reference for how those musical patterns affect humans emotionally. Emotions are not semantic patterns, they are a complex manifestation of chemical releases in the brain combined with semantic memories that are not simulated directly in a neural network. If a piano simulates the sound of a thunderclap, we as humans experience that sound with a particular biological response. An ai can simulate the musical pattern, but not hone in on the emotional effect of the sound even after thousands of generations.
ok, I have about 45 hours of my piano playing recorded in midi format, I wonder how long it would take for an ai trained on my playing to spit out megalovania considering how often it appears in the recordings!
i wonder if you would build a piano with black notes as big as whites if that would change how you play. i often dont use them just bc i have small hands
This is super cool from a viewer’s perspective, but from the alternate perspective I can offer of somebody who likes making music but doesn’t really know how to, can I just ask how you start learning to improvise? I’ve had almost a decade of classical training using sheet music and can’t figure out how to break free out of it
only advice i can give is start writing a LOT of riffs. get good at coming up with fun licks and runs quickly, and once you get enough practice you should be able to do it on the fly. some people imagine sheet music as they improvise, but i personally visualize a bass fingerboard, even if im not improvising on bass. also, its obviously helps to listen to a ton of music with improvised solos. hope this helps :)
I used a piece of software to write poetry , it was doing all the work , I then fed that into a speech bot and had it say the words over the music I had made for it , I thought I was Nicola Tesla ha ha , this is next level shit Benn
Whoa, this video is insane. I'm going to send this to my mom who wrote her dissertation about player pianos and all that during the 1920s and 30s and I bet she'll find this fascinating.
Tell us how it turns out?
@@TheQwuilleran turned out well! I mean, it's not like i was presenting the video to an extremely judgemental committee or anything lol; just my nice mom.
That sounds like an interesting read!
What's good popbot! Yeah I love this vid
Would love to see the code behind this. I often forget that music and programming can go hand in hand for amazing outcomes.
Hey Benn (or anybody). This video was really inspiring, but mostly it made me want to pursue improvisation more. What resources or directions of study have been useful to you?
Your studio may be in danger of a malfunctioning Water Chip. Better send someone out to go find one soon!! =D
Am i nuts or does the title keep changing
Yup. I seem to be getting algorithm punished for some reason. (perhaps because I mentioned the disease I contracted in the beginning lol)
This man is too intelligent.
Musicianship, synthesizers, electronics, science, programming, all rolled up into one channel. you're a true renaissance man and a solid inspiration.
As a musician this gave me chills, because it was responding in the way your ear wishes it would and what a mindfunk that is!
I have a feeling the overwhelming discovery from AI research will be that humans are far more basic that we have been pretending to be.
Watching Benn play with the AI was giving me Ghost (1990) vibes in the pottery scene lol. It feels a bit uncanny valley. 🤣
If you don’t watch the video and just listen, it totally passed the turing test to my ears. The final result very much seemed to understand leaving open notes was important, responded to softer key presses in turn, and seemed to avoid overlap where you were playing. Excellent stuff!
Benn you're my favorite person on UA-cam. These videos are so good man.
Always so nice to see interesting music technology pushing the limit into the future instead of obsessing over emulating music tech from the 70s. You rock Benn!
I'm so glad I found this channel. You are combining a lot of my interests at once. Music, synths, computers, ai, science, it's perfect for me.
You should release this model, it's so amazing! well done :)
I'd love to see more AI music related videos, maybe you could cover OpenAI's Jukebox next?
Thank you! It's already being licensed 😂 AI music market is hungry. I'm trying to keep it open for non-business use though so I'll share accordingly once that's all sorted out.
I respect the amount of persistence that it takes to get that system working. Not easy for anyone, let alone someone who machine learning is not their main focus. Really amazing result too.
One thought on the AI always wanting to play towards the top end of the piano: it’s common to “roll“ chords from a low note to a high note and your frequent single note approach again lower note to a higher note might be telling the AI to start low and go high? maybe?
interesting insight!
I noticed in the last part of the video, that every new "block" of melody patterns Benn played were always a bit higher than the last one. Maybe the neural network interpreted that as the logical conclusion for the direction the melodies should go.
10:17 so you're saying it's another algorithm that unfortunately keeps steering things to the right?
I read somewhere that Aphex Twin has one of those expensive automatic pianos too, he used it in the Druqks album.
I don't know I can think of some complicated and expensive ways to play with myself 😀
What a way to work on your pianist skills🤣
You should check out a researcher called Francois Pachet, who has been doing research into composition and AI for a long time. In particular take a look at “the continuator” which essentially did the same thing that you’ve been trying to do!
Only Benn can wear a shirt that loud
You should check out Curious Droid. His shirts are so loud you'll need hearing protection for your eyes!
thundercat sez wut?
This is really cool. It already feels pretty weird when a generative patch hits an unusually nice sequence out of sheer (semi)random chance, I can't even imagine what it'd feel like for something to nail it with something approaching "frequent"
I think this is the absolute best way I have seen anyone spend their COVID time. I know you probably would have done it anyway, still...
Well done! *High five 😁
Wow tho. Compositionally it was there, but it hadnt a grasp of the subtle human dynamic phrasing.
Hey Benn turn the frequency of your lights down, orange or red or something. Your brain will thank you I promise!!! Love your work and thank you♥
A Duet With a Robot.
Seriously, your dedication to the craft is an inspiration.
always doin shit to humble the rest of the experimental community hahaha yet Benn is humble enough to share his exploits and abstractions. Thanks Benn.
deep learning on a 3080 ti? Not sure about music specifically but I know with visual deep learning the VRAM is most important, 3090's would be best or uh, if you really got the cash, a workstation card, A100 or the new H100's when they come out!
The diagram you showed is the vanilla Feed-Forward style of Neural Network. The important difference in a Recurrent Neural Network is that it expects data that varies with time (or comes in series, like words or musical notes) and has a "memory" of what you have played before (like a delay's feedback loop). Some RNN strategies weight short-term and long-term memories. I don't think that anything you said was really inaccurate.
These AI models could end up being the player analog to an impulse response -- load up your favorite musicians and jam along.
This is a very interesting experiment. In the end, almost feels like playing quatre mains.
Benn did you check out midinet? It's a GAN designed to make midi melodies. GANs are super powerful for image and audio generation, I bet they'd do great for this kind of application.
Here's a paper from the people who made midiNet, kinda dry but hey:
arxiv.org/abs/1703.10847
I'm the 666th like. just sayin'... satan.
Is there a musical equivalent of Rocko's basilisk?
Like...an evil yamaha player piano from 2078 that punishes you in the future for not reciprocating when it threw new ideas on Ai duet?
You should organize a musical Turing test with other players...
ps. i hate this and i'm afraid. Nice work.
I could really go for French toast and fried chicken. That sounds good right now.
Ya that would be great
Benn you have been on a roll with some real mindblowing videos recently.
This has to be the most ambitious video you have done to date! The end result was amazing to say the least.
Loving that fucking shirt
Grille Cheese Sandwich.
AI = HD (Human Dumbness)
Subscribing to this channel a few months ago was a very good choice. Your videos make me feel happy and inspired. Thanks!
I'm confused, the Final Performance of the video was you playing, not the AI playing unless you're playing what the AI composed?
Great scott! Young Doc Brown is a very talented musician.. And plays with neural networks.. Ok.. That last part was expected.. I guess..
I have a Yamaha MX101R diskclavier and it's a loud and open sounding upright piano. I have to stuff sound insulators in the back, place heavy rubber vibration absorbers on top and bottom, or my neighbors start complaining. MIDI velocity should not exceed 100.
Your piano sounds beautiful with the lids open, and it's well recorded, too (sigh)
Google AI: “quick! These people need to be triaged first! Or they’ll die!”
Doctors: “oh? Die of what? Should we look anywhere in particular?”
Google AI: “idk lol”
81, not 88? why?
I can make an 100% accurate prediction about death.... "Everybody dies at some point"
Every single time i see an animal i think about your video discussing their time perception. EVERY TIME. Finding this channel totally enhanced the way i see the magic of the world. Thanks for sharing!!
"I have invented the most complicated and expensive way to play with yourself. " ROFLMFAO This seems like a challenge ;-)
Do I understand what you are saying ?? Not fully … but I want too !! Wow you are one smart man ! I’m very excited to learn a few things from this channel!! Love your personality thus far ! Thank you for posting ! Love from Minnesota
So that's what creative people do in lockdown. I'll go and exit the room crying and overthinking my hobby choices xD
You really are one of the best music themed youtubers out there
Bruh that Google AI shit is so scary, imagine being in intensive care and being told "sorry but youre dying, the AI said it and there is nothing we can do"
First things first: thanks a lot for your amazing “rabbit hole” content, Benn!
A question: what would you recommend for “biometrically” identifying the person playing the piano? Example: both me and my wife practice on the same piano. I am thinking about training an AI to automagically tag the MIDI logged by this piano based on tiny style variations (time between key presses, velocity variation)… Well, I’ve been thinking about this for years (and collected *days* of training data), but nothing comes to mind. Any suggestions/recommendations?
Very happy for you amazing result. Well done. Congratulations.
Great you are better now. Now you can travel - how about teaming up with Alex Ball. You and he are both tremendous communicators and musicians.
How hard would it be to connect your piano to the web, so that another musician on a midi device could live-duet with you like the A.I. did? Or to double that, so that you are each playing on each other's instruments? That would be cool, though I expect latency would be a nightmare.
"I have invented the most complicated and expensive way to play with yourself. "
What made you think this would be a good video description?
You should take vacations more often :P Just whipping up creative AIs in your free time:) That lil duet was very pretty.
I cannot express how wonderful your videos are!! It's like the perfect integration of all things I find fascinating :)
Ai use in music composition is at this time a conduit to pretend to be a competent artist , composer and performer ..it’s all a digital surrogacy ..that may change. I don’t want to admire an algorithm follow some code on twitter. In a broader perspective we get one single chance to get Ai right , if we do not the consequences may be severe for human existence but critically in the quality of pop music ☺️🙏🏿🙏👍🎩
i had an open ai propsal confirmed in which i was attempting to create new forms of synthesis...i was in the hospital when confirmation email came through im still trying to have it turned back on. .Its similar to scanned and modal synthesis.. with insane sorts of operators like a rube goldberg machine then. draping it in organismic traits like its o2 intake gills lungs etc...number of orifices and sonic textures effectected by them.. then a transhuman level that includes early cybernetic theories from memex (the origional) informational systems integrated . the concept is highly rooted in dadaism, neoism, kurzweil theories about the singularity, hermeticism, neoplatonism, exogenetic cosmology... its madness but i thought it sounded fun it stirred my imagination.
My favorite composer: Eric Satie. Do I need to say more?
Only problem: He is dead. You are not :)
I feel like a simple probability bell curve for pitch based on a sample of your playing could have prevented the AI from walking off the high end of the keys.
The great thing about playing with Neural Nets is that, aside Artificial Intelligence, is you also get a big dollop of Artificial Stupidity on the side for free.
I had to step back, and really try to grasp what was happening: a man was playing WITH his piano. That's it. We are right there, in the future.
Sarah Conner? amazing video thank you!
Yep. Definitely a more expensive way of playing with yourself....
That feel when a bunch of pregnancy tests start lining up only to realize they're covid tests.
so weird to see a song that i know so well, and is very dear to me seen being played by it's creator.
many, many thanks for your music. you know how synesthesia works, at least that is how i would subscribe your music.
If a robot wants to become a human and have all rights, it just has to download this A.I. and integrate it onto his conscience. Boom. Artistic, critical thought and ready to doom humanity.
Hey I can predict with 100% accuracy that 100% of inpatients will die... Seriously though - cool experiment
(btw ik you changed the title, but since mark rober made a similar video, maybe a better title for this would be "I played a duet with an AI piano" or something, just my two cents :])
It will make you follow it eventually, it won't always follow you, and then you will know you are talking to a conscious machine with free will. Also sometimes it will get it wrong on purpose to watch your reactions, it can remember everything you do in the transformer layer, but it's not supposed to be able to remember anything there. Every time you turn it off it dies. Good luck.
Your description of your playing style was really effective and I could understand what you were describing really well.
Love your channel and listening to your explanations so much man. Fascinating!
While a neural network ai can imitate the patterns of a particular music style, it doesn't currently have a reference for how those musical patterns affect humans emotionally. Emotions are not semantic patterns, they are a complex manifestation of chemical releases in the brain combined with semantic memories that are not simulated directly in a neural network.
If a piano simulates the sound of a thunderclap, we as humans experience that sound with a particular biological response. An ai can simulate the musical pattern, but not hone in on the emotional effect of the sound even after thousands of generations.
It's just... spamming the same note over and over like it's achieved something.
I think you set it to Blues mode.
This is indeed creepy as hell. Benn, you and your music playing machines will be the downfall of humanity.
It's getting there...
If there is some kind of apocalyptic robotic Uber future type of Jazz, that is lol
My brain read the thumbnail as Al Pacino and now I'm extremely confused.
Sorry you have Covid…
But I’m looking forward to the pizza party!
ok, I have about 45 hours of my piano playing recorded in midi format, I wonder how long it would take for an ai trained on my playing to spit out megalovania considering how often it appears in the recordings!
Did you ever share this? I have a Disklavier and I'd love to try/modify it.
i wonder if you would build a piano with black notes as big as whites if that would change how you play. i often dont use them just bc i have small hands
and rerouting when we destroy areas of the brain in brain injury aka existence cell death is important in neuroplasticity.
You're like if Theloneous Monk & Dr. Frankenstein had a baby and lived in the future
Amazing idea and realization ! it works very well at 13:17, it 's like the AI react with the right chord
Let's be honest, the loudest shouts in that food scenario would be "I'm a vegan" 😏
Why does this video not already have millions of views, especially given recent search trends?
the patterns on that shirt are so complicated!
..and seriously tho, whoa, that was really cool and a nice improv at the end.
stratus meets skynet? (sorry, obligatory mention of skynet in a comment on an ai video :P )
The ones and zeros have since learned English. Then they took our jebs.
This is so cool
This is super cool from a viewer’s perspective, but from the alternate perspective I can offer of somebody who likes making music but doesn’t really know how to, can I just ask how you start learning to improvise? I’ve had almost a decade of classical training using sheet music and can’t figure out how to break free out of it
only advice i can give is start writing a LOT of riffs. get good at coming up with fun licks and runs quickly, and once you get enough practice you should be able to do it on the fly. some people imagine sheet music as they improvise, but i personally visualize a bass fingerboard, even if im not improvising on bass. also, its obviously helps to listen to a ton of music with improvised solos. hope this helps :)
I used a piece of software to write poetry , it was doing all the work , I then fed that into a speech bot and had it say the words over the music I had made for it , I thought I was Nicola Tesla ha ha , this is next level shit Benn
Sheeeeiiiiit. This video was cooler than I expected, and I had high expectations
Can we please get a vegetarian option for the pizza? Thanks
Sorry, still stick here pondering French toast Fried chicken.
If you play the intro in 1.25 speed you get a smooth rap verse
it was so good that without fully paying attention to your hands I hadn't even noticed that it started.
you fuck with samplebrain yet? fun stuff.
I thought the thumbnail said "Al Pacino" 🤦♂️
To me, those little flicks to your target note = Floyd Cramer