AI Sound Effects Are Here and they ROCK!
Вставка
- Опубліковано 11 чер 2024
- ElevenLabs is capable of generating a wide variety of sound effects for practically any use case. It's great for film & media, video games, commercials, and more.
▼ Link(s) From Today’s Video:
elevenlabs sound effects: elevenlabs.io/ai-sound-effect...
RTX 4080 Super Giveaway! • I'm Giving Away an RTX...
► MattVidPro Discord: / discord
► Follow Me on Twitter: / mattvidpro
-------------------------------------------------
▼ Extra Links of Interest:
✩ AI LINKS MASTER LIST: www.futurepedia.io/
✩ General AI Playlist: • General MattVidPro AI ...
✩ AI I use to edit videos: www.descript.com/?lmref=nA4fDg
✩ Instagram: mattvidpro
✩ Tiktok: tiktok.com/@mattvidpro
✩ Second Channel: / @matt_pie
-------------------------------------------------
Thanks for watching Matt Video Productions! I make all sorts of videos here on UA-cam! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
-------------------------------------------------
► Business Contact: MattVidProSecond@gmail.com - Наука та технологія
I'm a game designer/game dev. Started in 2004 on The Witcher. Went indie in 2015. Bought a microphone to record audio, bought a mocap suit to record animations, etc. :-). Now you can get pretty much everything by just typing something into a text box :-)
if only...
As a dev how do you feel about technology such as this? Really curious to hear from someone who has been in the field for a long time.
P.S: Thanks for The Witcher games a reality (that goes for all the devs and people involed).
@@michaelsimonsen2017 I do woodworking as a hobby :-). So worst case scenario, I'll be making furniture.
@@michaelsimonsen2017 i dont have tje same depth as the (only 12 years in) but im frankly excited. I also dont work in games. I work mainly on the touchscreen devices you see everywhere to put it simply. from medical to automotive to aviation. My 2c is that it will be useful to senior devs, i wonder how a jr dev does get a foot in the door depending on the flavor of the engineering. In my line of work, its still a little too complex to be 'automated'
That being said, i was also a general contractor before this so...back to swinging a hammer or fixing plumbing which isnt exactly a bad job.
Give it a couple of years and you will not have a job. It's coming for you next.
Mario Wahoo and ASMR had me ROFL
this combined with sora will make the movie producers worried
It's more of a threat to actors, voice and foley artists than producers.
Going to make it aaaaaalot easier/more accessible for people wanting to visualize their imaginations. It’s going to be awesome
I'm a movie producer I am not worried I am sure this will speed up production but Sora is not yet up to standards for film production and unreleased
why would they be worried about the job of their employees getting easier?
@@LetsGetSmarted their employees jobs will be getting eliminated eventually, followed by their own jobs. Also they are the producers subordinates not their employees.
ASMR is definitely the highlight of this video 14:35, I'm in tears laughing at the people who expected normal ASMR. However the warp drive sounds pretty good in stereo 11:50.
This is incredible, all the pieces for video game production are almost complete. Using this with Suno + Sora + potentially GPT-5 / GPT-6 you'll have the power of a small company.
Hollywood😅 awaiting patiently 😁
🤣🤣🤣@@PdWOLFG4NG 🤞
Did you see yesterday and today news of Devin? That's the biggest piece of your puzzle
that sadly seems more like scam@@markmuller7962
@markmuller7962 I did, just after posting this 😂 will be amazing to see what Devin or a similar agent could do if it's given access to all these tools
What do you guys think!? I was blown away!
Every day, getting closer and closer to AGI
This technology is incredible!
Speaking, however, of what I thought, I must say that it makes sense that the model is not able to generate contiguous sounds such as "train followed by the scream of a man" or "unicorn followed by the sound of glitter". After all, in any online/offline sound effects library we don't find composed sounds. They just have no purpose. If you think about it, this is a good thing, because the sounds must be taken individually and composed in post production to give the best experience. So having one sound followed by another within the same audio track would mean having to adapt the video to the sound and not vice versa, making the sound essentially useless or more difficult to deal with. To conclude, if you noticed, the model you used managed to generate single sounds very well and with high quality, but the composed ones sent him into paranoia.
I think it would have been interesting to see if it could generate sounds like "storm", "drowning under water", "drone sound", "hit", "whooshes", "foleys" or any other named sound used in cinematography. What do you think about it?
That's fantastic! However, you need to be a bit more specific. For instance, when you say punching or punch, what exactly are you punching? I believe specifying the object or material you're punching will make the sound much more closer to what you're expecting to hear.
Well I think it's amazing
you should check out my edit AI, has great sound fx like this and u can use now...
that‘s a lot of stairs 🤕
Elevenlabs the King of AI voice. Still waiting for more emotion control and speed control👀
You could try their relatively new Speech-to-Speech model; upload an audio file of yourself speaking with the emotional expression and pace and cadence that you want the narrator to emulate, and the AI will simply replace your voice with that of the narrator of your choice.
Not sure; I haven't had either a reason or opportunity to try it myself; I know only what I've read on the ElevenLabs website. I am working on a video that requires narration, though, so I might give it a go this weekend@@notBeggingMattandLissy2PlayRE4
A lot of those would SEEM a lot more realistic when paired with video showing the event. Hearing the can crunching by itself is sort of "Okay, I can kind of imagine it". But show a man crunching a can with the sound effect and we'd be, "Yep! That's real!" Same with the man falling down the stairs. Without seeing the man falling, the sound is a bit cartoonish. But with the visual? Absolutely.
It's a bit like the talking piano, if you know what I mean.
10:33 I laughed so hard at the mario one :D
Can we hold a moment of silence for the men falling down the stairs, I'm pretty sure none of them will ever stand up again 😢🪦
😰 That may have hurt a lot . . .
I use a lot of sound effects on my channel reading classic comic books, and most sound effects come from UA-cam, so this tech may come in really handy when I need one of those really hard to find sounds!
Loving this video! As I'm watching this, I'm hoping Matt is currently recording one about devin lol
this is really cool, i can see this being utilized in indie games or maybe even some short movies
11:01 Feel like I can almost hear the samples on some. Goldeneye Theme, CSI Miami Theme. Probably others.
Mario 3 start (crowd in the dark, not as close but maybe a Mario link for why it generated that).
This would be sick for sound effects in a horror game
Matt if you go to 16:50, you’ll hear “help me please”
Wow
@@HelamanGileomg
That unsettled me...
11:37 too.
the man falling down the stairs was kind of scary in a way. i could feel the impacts xD
Lol was that vomit ASMR 😂
Not only in stereo, sounds like it's binaural too. About the man falling...that's looong staircase. I'm an audio editor so I know what to hear in a sound effect. Can someone try...'neighbors having a kinky session while your roomate is snoring in the background
This could be good for sound design for music production
Matt! another home run review Thank a lot 🔥🔥🤟🔥🔥
This episode had me rolling! LOL!
This is an insane features, I cant wait to try them on my projects!
6:41 Oh yeah, the creepiness has _nothing at all_ to do with the implications of a man falling hard down a set of stair for 10 seconds straight.
I wonder if you can cover the new self-teacing humanoid robots. I see it's huge topic but it'd be cool to talk about it
put quotation marks around parts you want to be spoken and it speaks them.
This will see the light of day unlike Sora which I'm afraid be massively delayed maybe someday
Just saying, 11 seconds adds a great deal of humor.
we needed something like this
As usual for these things it works well about 20% of the time. And they ding you 10 characters for each of 5 generations out of which 1 may be useable. Cool though! Maria wahoo is amazing!
Dudee.... I cannot wait to make my next horror trilogy :D
Listening to this. Last time I toyed with audio was more than 20 years ago. Impressive quality. Mindblown.
Without a doubt one of your most fun videos. Never laughed so hard. Thank you so much!
Temporal AI like video/audio don't like past-tense prompts. Humming works better than hums. Talking works better than talks.
Neither hums nor talks are past tense words…
@@DumPixels I'm pointing out two things.
@@zippythinginvention Ah, ok my bad
8:09 Eleven Labs starts breaking out into a rendition of Low Rider
This is pretty cool. If I want to suggest something for your AI audio video series how do I go about that?
I love how "Viewers" is its own chapter in the AI-generated chapters lol
Video on consistent characters? Honestly can't wait 🤩
I think soon we'll be able to do consistent everything, for example just today I read about a new LLM called Command-R, which apparently is more accurate than anything else in answering "needles-in-a-haystack" type of prompt, which is promising. I'm hopeful GPT-5 will also be more than an incremental change and put pressure on the whole industry so we'll eventually see it trickle down to open-source models too.
"mario wahoo" is the magic formula to get zombies sfx :)
15:59 oh no it's ocean gate all over again
Mario wahoo reaction matt epic live for this lol priceless and the stereo futuritic sound effect love
Your expressions while listening are hilarious!
I guess with AI sound effects, we're past the days when someone could record their fart, slap a copyright on it, and sell it for 50 bucks a pop.
they sound amazing in surround sound
I’m already holding my phone Matt as I’m watching this video on it
Pov: hoping you try the "falling down the stairs while eating an apple" sound effect
What my brain decides to produce right before I fall asleep 16:35
sound quality is pretty nice. signed up.
The mario ones made me laugh out loud 😂
It's giving me some impressive sounds related to speculative biology.
Like, non existent animals.
Made a python project that like; no mans sky's a bunch of text based creatures and uses a shitload of generated noises i made with it.
It definitely, definitely is already aboce AudioLDM 2.
think the biggest issue with sfx data used in these models is that 90% is very noisy and low quality data … unless these companies can get access to the sfx libraries from hollywood and the likes and build the models
from those libraries alone, the quality will not improve as rapidly as with music or image/video.
like i had a 1530 GB (1.8 million audio files) pack of sfx and had to delete 800 GB because it was unusable
Freesound is shaking in their boots right now 😂
Someone didn't watch the video
I lost it on the Mario wahoo 😂 😂 😂
Bro what do you think about Devin? Will you make a video about it?
Those bizarre car ones feel like they belong in a Game Theory video. The AI's alive and trapped, what's it trying to say?
They need to integrate this directly into their projects UI so you can insert them quickly
Some high quality ASMR...
Love the Mario, ASMR and car eating you sounds!😅 Bonus: your facial expressions while listening to these abominations.😂
oh... mh ... i thought this would take a video as input an then lay out a sfx layer timed to the animation/video. describing every single soundeffect is a bit ridicoulus isnt it because its will take the same time to generate and evaluate each soundeffect to record and edit it myself, exept the recording is way more fun.
I have purchased ~100GB of AFX and the problem is that there are SO many files, it's impossible to find what I'm looking for. I would gladly use this instead, but maybe in another version or two.
Have You seen about Devin! By cognition labs it actually blows my mind.
11:08 What the FUUUUCK, lock that thing in the basement and set it on fire, holy hell! XD
I like computer .
Let’s hope computer like us back
@@wedontexist369thats what im sayin
Ye
It would be cool if we could pick the exact number of seconds & milliseconds that we want our sound effect to be.
Tbh if I am making a game I would rather use meme soundeffects.unless they become better
I really hope that the developer don't patch out the Mario Wahoo and ASMR generation. Let those be a nightmare fuel hidden prompt lol
I want to know when the equivalent of Automatic1111 is going to surface for SFX. :-)
12:09 woah
You could have said "Man Hums" on the later sound effect, because it would be easy to layer the sounds anyway.
What other sounds effects generators we have now?
Now I regret watching this at night 😳
Ahhh I missed the give away 😅 only running rtx 1080
"This is such nightmare fuel! How can we dial it back a notch? I know : 'Man shrieking in terror'" 😉
I wonder how well it would do sounds for aliens or monsters in a horror game.
It gave me a bunch of ideas immediately
Good stuff, not on the suno AI level, , feels more like a suno AI v1 type of thing. SO maybe in 2 generations it'll be totally usable.
That was a lot of stairs
Ffing amazing
It would be interesting if ElevenLabs learns how to do overlapping sound effects. I guess it’s probably complicated to have multiple different things happening in one sound effect.
It's also a balancing act of whether training for that introduces it where you don't want it which may be more of an issue. Like the "falling down the stairs" audio, it's all a bit uncanny without any screaming or grunting but I may have a specific idea for what I want with that and if I have those human sound effects mixed in, it would either make the sample unusable or I would have to use techniques to extract the bits I wanted. Ideally, you could ask for something happening while something else happens but unless they can really eliminate concept bleeding, I think this way is better.
Typing ceramic cup will get better results its about how u say things
I think some parts of your prompts aren't needed, like the "coming out of a faucet" isn't really needed when you could just have "water being poured into a cup." So that may be messing up the generation, especially when it seems like you had more success the simpler your prompts were.
Plus, usually sound effects are made separately and then combined later because it's more flexible. For instance, the sound of a train engine would be separate from the horn, and the sound of a man falling down stairs would be separate from the sound of a hundred marbles dropping.
"Wahoo" in the style of Mario
12:27 Cloverfield vibes
Nice way to get license free sound fx.
Not great but still cool, my job is safe for now :)
Mario wahoo 😂😂😂
The foley industry is gonna shake!
🎯 Key Takeaways for quick navigation:
🎵 11 Labs presents AI-generated sound effects, showcasing impressive text-to-speech technology.
🎧 Sound effects range from soda can crunching to water dripping, with variations and nuances in each generation.
🌟 Impressive audio quality and stereo effects enhance realism and usability for various applications.
💥 Explosion sounds demonstrate significant improvement in AI sound generation capabilities.
🤖 While capable, AI struggles with more complex prompts like overlapping sound effects or abstract scenarios.
👾 Models excel in typical sound effects, such as punch sounds, suitable for video games and media production.
🚀 Early access limitations acknowledged; AI still evolving, not yet mastering intricate or elaborate prompts.
🎮 Overall, 11 Labs' AI sound effect generator shows promise for practical use in gaming and media production.
Made with HARPA AI
When the man starts talking
👍
Yo! 👋
Provided you get a useable effect…. LOL What’s the copyright and usage status?
You get the IP rights insomuch as Elevenlabs can provide them. The US copyright office's policy is that a prompt isn't sufficient for a copyright but that's probably not much of a concern for sound effects anyway. But yes, you have commercial usage rights.
@@user-on6uf6om7s Thank you for the info.
You can overlap, episodes and post and just make single sounds video Game makers will or should embrace this. I can’t wait until LTX is more of a thing then we can start making actual movies.
Are you going to cover Devin?
Just saw it!!! will def talk about it!
Nice
AI haters will say "Just learn to do foley"
Hi
😮
It's ok.
They should add thumbs up thumbs down to help train the model
Ask it to make wookie sounds
Your prompts kinda blow