Data Scientist Explains Why AI Generated Music Is Extremely Difficult To Make
Вставка
- Опубліковано 29 чер 2024
- Follow Max Hildorf's Medium articles here: / maxhilsdorf
Music LM Paper: google-research.github.io/sea...
🎹 🤖 Be The First To Discover The Latest AI & Music News/Developments: www.music2.ai
Listen to the Music 2.0 podcast: music2.buzzsprout.com/share
Great Interview! Lots of new (to me) and important pieces to the puzzle in there. Max is a great resource. I want to mention also that I haven't heard you talk about (maybe I missed it?) what I think could be an elephant in the room. I think with the rapid improvements in artwork and video production via AI there will be a huge increase in the volume of the need for high quality music in the video game industry as that industry becomes much much bigger as many more creative people are able enter the field, because the cost to produce ivideo games drops a lot and the quality of the output goes up a lot. That industry is already growing rapidly due to the advancement of technology which is allowing the games to become increasingly more interesting to play. Folloing that and probably more importantly I think the same thing will soon happen in the movie industry. New creative people will enter the film production industry in large quantities, due to the drop in production costs and increase in production quality, and the demand for high quality music in the industry will skyrocket along with it.
I love the shift in energy with this interview, great job Jesse and Max! Left me feeling hopeful and inspired. Max truly has an incredible and unique skill set! Hoping to watch more conversations between you both. A couple questions:
1. What is the difference between stock and sync music and why would stock libraries be more disrupted than the sync industry? They're both licensable music, used for media, and incorporates the use of libraries, no?
2. Im wondering why electronic music will be one of the easier genres to create? Are these AI music creation platforms going to be using MIDI data in the future?
3. Really curious as to HOW AI is coming up with music. What is the AI music creation process? How is the timbre of a piano replicated? Are they using machine learning from pre-recorded audio to determine what a violin sounds like and then using synthesis to re-create the sound of a violin?
Cool interview. As Max said, 2 main obstacles to high quality AI music generation are Big Data and Copyrights (those 30 sec samples at Spotify need to be cut down in the Era of AI where potentially rouge models can ilegally tap them in, maybe congress hasnt thought about that?). We should also keep in mind that consumers' music taste also gets trained based on what they listen (a bit like an AI model). So over the long run, as AI music penetrates our world, don't be surprised if many humans start preferring machine made music. I love jazz, but not many Gen z kids care about it as they were not exposed to it like I was...
Great interview, Jesse! One legal aspect I'm not sure I've really heard talked about is from sample library providers. I don't necessarily mean loops and such but more like orchestra libraries or Kontakt sample instruments, things like that. It's probably very parallel to the copyrighted music issues, and likely harder to prove the AI is mimicking tones it heard from songs using these libraries. But I wonder what sample library creators' takes are on this.
Really good question - I had a sample library owner reach out to me about that very issue. That's still being sorted out right now.
Great conversation y’all
This interview brought many different factors to life. This subject is definitely something that is going to require producers to not hide their heads in the sand and hope it goes away. Real issue calls for real action.
Another excellent video/interview and again, well done Jesse for engaging with these people within the AI sectors, to ascertain where it's all headed and how it'll impact on music creators. With each interview, we gleen more about the aims of these Generative AI Music companies, and this helps us to fit the jigsaw pieces together. Im a realist/pragmatic and a reason whyer, and what I look for now, is who is funding these companies and what their possible aims with this tech are. Jesse asked a very pertinent and important question/s "why, why are these AI companies doing this...why do they want to create music, where musicians have traditionally fulfilled that purpose". I find it amazing but puzzling as to why this new tech, all of a sudden, has came into being, not just in music, but other art forms and business sectors too. Why all of a sudden are we all worried about this tech, from Accountants, GP's (MD's), Marketing/Advertising people, to writers, videographers/fx/filmmakers etc etc....why within the past year or so has this tech stood up and faced us head on ?! From what I can gather is, that most of these companies are being "funded" by or have investors who are venture capitalists, who will want returns on their investments. Make no mistake, the AI sectors will drive and drive their R&D very hard, to achieve control of music and other markets. But why ? This tech now poses serious risks to millions of jobs worldwide, in all sectors. Somewhere down the line, the "machine" will produce our art, music, photos, design, truth content, news, et al and I find it very concerning. The smaller companies will be bought over and absorbed into the larger corporations and I can genuinely forsee an end to individualism, the end of the independent muso, artist, writer, thinker. For centuries, if not millennia, the state or powers that be, have sought to control the thoughts and actions of mankind, they have banned, music, and other cultural tools, to maintain an element of overlordship over people/cultures and I see this as no different to that. This is the bigger picture I look at. You have to understand how important music is to humans. Research "Cymatics" and Frequency/Tesla and you'll understand how important music is to humans, their soul and dna. People who researched Cymatics etc believe that frequencies affect our dna, the tones resonate with us as such a molecular level, hence our need to listen to music. Over a few centuries, large bells from cathedrals/churches worldwide were destroyed, some believe the bells were used as healing tools in churches / cathedrals (buildings which were repurposed to be churches/cathedrals). Music was banned in Scotland (where I am) and Ireland by the British state in the 17/1800s and also by the Church. I see this AI tech being part of that mechanism to control or remove humans ability to connect to something much deeper than we understand. So, lets say in a year or two years from now, the AI platforms pretty much provide the music for most functions, imagine the funders of these companies have certain criteria they introduce which the AI companies must adhere to, like say the music output from AI platforms can only be used on such and such TV show, because they are our partners, or...maybe they will introduce certain other criteria for that music to be used in certain areas. Remember, AI generated music is "owned" by the AI company and ultimately, their investors. One of Boomy's investors is/was "Warner Music Group". They are a massive organisation, what's to stop them putting in criteria as part of their investment funds, saying that the output from Boomy must be used with certain partners and nowhere else. Do you see where all this could lead to ? If there is mass adoption of generative AI music, you can bet your bottom dollar, rules and regs will be introduced as to where that music can be used. Don't just take all the AI discourse at face value, look at the investors and ask where it can lead to and remember this, in 1939, it was John D Rockerfeller (a globalist elite from a banking family) who changed the standard tuning from 432Hz to 440Hz (this leads into Tesla/Frequency healing etc) - whether you believe frequency healing etc or not, why would a banker make such an effort to change the standard orchestral pitch ! Be very careful of what you wish for, because one day, we may be left with very few cultural and creative options, which will be gatekeeper'd by AI platforms. You wont own the music, and what happens if they shut down your account, or use your/their music for their own ends/clients ? The tech is remarkable but I feel it's going to be an absolute mess within a year and every Tom, Dick and Janey will be pushing out crap, and music will be even more cheapened than it has by streaming. I have an eleven year old and I continue to buy him dvd's and cd's, because they're physical and we own them. Long comment I know, but as this develops and Jesse digs more, so do we. Rock On people, we are the power !
Amazing interview! I would love to see Max on again.
Thanks! Any specific questions you'd have for him?
super interesting interview. as always thank you Jesse!
It's a tool designed to assist musicians, producers, and songwriters. However, the demand for original human music will always remain. It can be compared to a digital audio workstation (DAW).
In the past, musicians had to possess instrumental skills to create music, but now with a DAW, one can utilize prerecorded sounds from real instruments without needing to play them. This technological shift may evoke mixed feelings in musicians from earlier times.
Some may have embraced the adjustments and thrived, while others may have struggled and been left behind. We must adapt and leverage technology to our advantage. However, individuals who are not tech-savvy or lack a background in computers might find this intimidating. Nevertheless, they still engage with it because it has become deeply ingrained in society, and they often learn the basics to perform their job effectively.
Concerns about AI generative music replacing human creativity are more prevalent among non-tech individuals than those who are tech-oriented. We will be fine family :-)
10 mins in, “democratising music creation.” I have a problem with this. Typing what you want into a text box is not musically creative, maybe it’s creative writing, but not if you have GPT write your prompts too. Furthermore, It’s the value created by skilled musicians and producers that create money that can be reinvested into their personal process in the form of tools and skills developed (you earned the advantage over time through effort). Diminishing the ability of skilled musicians and producers to earn and replacing the process with text to music AI may “democratise music creation”, but it is not musically creative for the users of that AI. Humans who can no longer earn money from their work will no longer be able to invest in their tools and skills, which over time, will give the ever improving AI an unbeatable advantage and destroy human ability to compete imo. This is so dangerous.
It's really going to be the 'wild, wild west.' We need laws or a kind of watermark that distinguishes whether music is generated by AI or made by humans, so that there is a choice to choose.
Yeah, I agree with this. I don't see anything good coming out of prompt based generative AI for music. Nothing. We already have AI "tools" to assist with the production and mastering processes like the Izotope products and chord finders, etc. like Scaler. Isn't that enough? Do you need AI to write the music too? Absolutely not unless you have no musical skills or you're a company that wants all the profit and doesn't want to pay composers. That is what I think is the problem. Generative AI for music is meant to actually compose the music. It's not just a "tool" and it will get much better. When everyone can get access, if what it composes is useful for corporate video and TV, licensing companies will just generate music they can license without paying humans and maximize their profits. Shutterstock has already added 107K tracks from their AI subsidiary, Amper Music.
@@aimusictv1 Seriously. Scaler itself is an open door into music theory through chords, progressions and scales. Combine that with some genre tricks and tutorials on youtube and the skies the limit.
But automating everything sends its market value down to the lowest common denominator.
My concern is this past decades trend of executive authorship (particularly in films and gaming) controlling the parameters of what artists, musicians, writers and producers create for companies to conform only with annoying, repetitive overarching meta narratives and visions.
It could just make the complaints people have about the bland mainstreaming of entertainment properties even worse. Instead of a contract, the LLMs limits controls your canvas.
Through AI the only power would go to the chief curators and owners of models that control or censor what people generate. Taking real power away from the individual over time.
I don't get how people immediately overlook the fundamental relationship between rarity/contrast and value.
Or has a tunnel vision grown from fostering this discovery they think this economic fundamental can be beaten or reengineered by technology, instead of people simply becoming more spoiled, and raising their bar of good vs bad?
Equality is a great condiment, but it doesn't necessarily taste great on EVERY single food.
Imagine you are a video editor, and your video editing software contains an AI music generator. You just need to indicate the emotion, the style, the instruments etc., for the scene you are working on.Then you add a mark where you want the sting to happen so the track can have the emotional ending and it will automatically give you 50 options to choose. Producers and composers are not needed inside this equation.
Fantastic interview!
Wow thanks to UA-cam for bringing me straight to this!
I really appreciate your videos; you are a light in the darkness.
Thanks!
Great interview guys. Good points about the sound quality, It's playing catch up with human music already and it may not get there, not in a real way. It's hard to imagine feeling anything real from AI music as Max pointed out. I agree with both you guys that good human music and musicianship will become more sought after especially after the flood of AI music hits. 👍
I've not even been able to find synths that do as great a job as the saxophone. Maybe AI can manage it though, who knows?
But as a lot of musicians have their own sound, it's hard to get what will be considered the best. Is Van Halen a better guitarist than Kurt Cobain? Most likely but people wanted KC's guitar playing because it was his sound and fit his singing.
The timing of this talk is gold. I have a question about datasets:. I think a potential future is artists creating their own datasets. Would like to hear how to do this ?
Great question! We'll ask Max that next time we have him on.
The point made toward the end about the social aspect of music is one of the bits I'm optimistic about. Sorry to all of the library/sync license composers and producers, ...I'm not making money that way so it's easier for me to care a little bit less about AI taking over the kind of music I'm in a hurry to mute every time I hear it. 😅
Sheet music there is tons of it our there super expressive would make good dataset
This aged well.
Incredible conversation. Also, completely irrelevant but I have the same wedding ring (for me at least) as Max. 😅
Pls answer my Question:🙂
I’m a singer/songwriter and I want to license my songs. I write with no beat and when I obtain beats I explain to the producer how the beat sounds in my head.
Whats my best option for getting beats that i can use for sync? Meaning should i try and find a producer who will let me buy out the beat? See if i can make A.i beats? Just type up a contract? Thanks on advance.☺️☺️
Collaborate with other musicians/producers.
Thanks but thats the obvious that i would collab. That’s not the question lol
@@Allthatwethink What is it then lol
A question for Jessie. Thanks
This "Whig" Progressive view of History is really destructive... never questioning once what is lost...
Read about Chesterton's Fence!
"Evil data scientist mwahahahahahaha!"
Is the expert…AI? 😳
Dude 😆
Why don't we "democratise" DATA SCIENCE?
Aren't they admittedly an "elite group" too?
What gives them the right to COLONISE all other disciplines?
We will. Everything will become more accessible as a result of AI technology.
Democratize music. Pick up a guitar and learn to play.
You know that's not an easy thing to do, right? (I'm a guitar player myself)
@@SyncMyMusic not easy doesn’t mean anti-democratic.
I need to see the windows…