AUTOMATIC LIP-SYNCING
Вставка
- Опубліковано 5 лют 2025
- Check out Brilliant.org for fun STEMmy courses online! brilliant.org/...
THE SOURCE CODE IS NOW PUBLIC! Here's info on that: • Automatic lip-sync sou...
Lazykh source code: github.com/car...
Lazykh UA-cam channel: / @lazykh_
Part 1 of this video: • Automatically making Y...
Cary in a few weeks: "My entire UA-cam channel is now running automatically"
Can you see the future? Perhaps that is where this is all going :P
Cary in three years: Forcefully taking control of UA-cam and running it using AI
wait you watch cary? so do you watch bfdi?
Cary in 5 years from now: AI handling UA-cam's algorithim and everything else somethimg special
Cary in 6 years from now: AI automatically buying companies every week
For the legal aspect: Google has a way you can filter images by commercial reuse with modifications
What how??
@@PlasticSinks After you search look under the search bar and click Tools > Usage Rights
He did say that the cc image library was "lame" in the video
Yep. It also defaults to this setting when you try to search for images in Google Docs, which can be kind of annoying, but I understand why.
@@samuelthecamel gboard does that too, that part sucks but there's not a lot of keyboards with a web search function out there
This man is working hard so he doesn’t have to work hard.
Every automated system ever
Aint that the most true sentence
That's how humanity has progressed this far
@@RinInABin until AI got so advanced and started making an automation for themself which is the automation is also an AI and then they got so advanced that they made an automatic machine for themself and so on.
@@kakyoindonut3213 _the singularity_
Cary 1 year ago: Did editing, voices, animating, coding, etc.
Cary 1 year in the future: COMPUTER, MAKE A VIDEO!
*computery ;)
@@martysh1226 Cary's just going to become an AI at this point
Alexa, make a youtube video.
and thats it. the computer just makes a complete, perfect video, in half a minute at longest.
@@blueninja012 That might be the end goal
My man just automated his whole UA-cam channel, he's my new hero
the bigger picture is that he actually just enabled a new wave of youtube creators who don't want to/can't put much effort in their videos. They can just draw some basic shapes, write a script and video done. Not only did he automate his channel, he automated countless other channels
Teri Hornych madlad
similar bot have been done but this one is next level
@@kdojeteri gonna recreate and sell it xdd
Teri Hornych well he did not open source the sourcecode of the program, so thst won’t gonna happen any time soon.
1 minute of animation = around 1 day of work.
cries in 3D
Sometimes 2D is harder than 3D
me who only traces in desmos
3D animation is underrated
Animation is underrated
@@onefinalobjectepisodes oh really
Anything: is manual
Carykh: *visible agitation*
wont take him long until he creates automatic breathing
“Digital animation isn’t real animation. The computer does it for you”
Animator: Lmao, I wish that was true.
lul
YES THATD BE AWESOME
True...
:((( it takes me like 10 minutes to SKETCH a 0.5-2 SECOND CLIP- TwT
((probably because I don't draw stick figures and I draw cats and people at least semi-realistically-))
@@Xox_InSocks aaaaa I get how you feel lol
what about after effects animators ?
YOU NEED TO SELL THIS
Just having a program that makes the timing and inserts the right lip flap into Premiere would be so incredibly helpful to the entire animation industry. I know quite a few abridged series that could benefit from such a thing.
I could definitely use that.
Also VTUBERS COULD MOD IT TO BE LIVE SO EVERY FEW SECONDS IT FITS THE EXPRESSION IT HAS TO HAPPEN!
Yea ik
And now skip 10 years into the future and Carykh has just a button next to his bed that when presses searches for an interesting topic, creates a script and uploads an entire UA-cam video about it.
A button? How primitive. A brain interface definitely requires less energy and is faster to use, he just has to think about doing it.
@@thoregrimm6042 lmao
@@thoregrimm6042 Thinking would also require effort - just schedule it to run every week
@@OpenKeith Just let the AI decide when it's the best time to upload
@@timgreller first of all there's no AI in this, it's just a bunch of python scripts. second of all why use an AI when a cron job is simpler and would produce a more consistent upload schedule
The next thing you need to make is an automatic KH joke generator.
You can do It yourself, just get all of the words that start with k, generate a random number and pick that, repeat with h. My best result at this choosing specifically is kleptomaniac hallucinogenic
@@Adix_Null
Sure, but then it's not really automatic
i mean this method could be automated really easily. random number generator + list of words that start with k and h. done.
@@entropy687 "Hi, Kindergarten hallucinated here!"
@@entropy687 Well there is one problem, it could choose two nouns or two verbs and may sound weird or nonsensical, so it should also be scripted with structure with verbs are followed by a noun, adjectives are followed by a noun, etc.
Holy heck I just now realized this was one of the guys who produced BFDI! Dude thanks those animated shorts made up a huge portion of my childhood.
Same
If you filter google images by "licensed for noncommercial reuse" there will be no copyright issue! I had to learn to do this for school. Upvote so he sees this.
OMG that's really smart! I should go implement that into the Google-Image-searcher, and see how well it works. If the resulting images are still up-to-par, that might solve this whole issue!
I think this would probably be commercial reuse, though. He is earning money from it.
The problem is I don't think UA-cam videos qualifies as non-commercial if they are monetized.
@@carykh make sure it's licensed for commercial reuse, as you are making money off your videos the noncommerical ones aren't allowed
"Licensed for non-commercial reuse" isn't the same thing as "royalty-free" nor "open". It's sufficient for school presentations, since those aren't commercial, but Cary's videos are commercial, he earns money from them. This wouldn't help him in the slightest.
This works so much better than I thought it would
Lmao
Nailed it
Hello
Subbed
Ikr!
Cary:
kaleidoscope hoarder??
Viewers:
It's... Acceptable.
STOP HOARDING THE WHIPS CARY!
Cary in a decade: “my body is moving automatically”
How I get 77 likes
@@14_bryce65 80.
81*
@@pendantperuke9440 248*
😢😮😅
Plot twist: Cary was automated the whole time.
plot twist: this is not automated
@@appl.ju1c Plot twist : you missed the joke
@@appl.ju1c r/woooosh
@@Dragona- plot twist:
That's not a plot twist, it's just obvious
This popped up in my reccommended. I wanted to stop in and say WOW!
The stars have aligned and we got a Jacknjellify, a carykh, and a humany video all in one day.
THE ANGELS HAVE BLURSED US
thats why ruby took out the freesmart supervan duh
@@justoh312 LOL
Sebastian Lague too
who?
And here he calls himself Cary kaleidoscope hoarder. The funniest shit I ever heared
Once he called himself “Cary key hole” lmao
@@kiana.118 that’s the one i heard first and what i thought he meant.
pyro tf2 is right
Mmmmmph
Language dude
6:03 They’re talking about Pencil’s mouth not being on her body. You’ve gotten 0 complaints about the lip syncing!
Google has an "advanced image search" so you can filter by non copyrighted images
Yeah
Carykh: post video, me: SPEED IS NECESSARY
yep
yep
SPEED IS KEY
@@por1264 yep
@@captcalvin2293 yep
He hates animating mouths because he’s too busy hoarding kaleidoscopes
0:20 Mom, look! I'm on TV!
lucky man
Nice
BRUHHH
No way!
Lucky
8:37 cary's "lip synced mouth" is broken
Lol
I watched this long time ago thinking it was a normal video now I come back with honor
Cary: *Talks about the mouth shapes he used*
My Brain: One for Pho
noodle
@@tastyyoylecake2069 The Pho taste very nice
Pho
10 bonus KH points if you can find where I am in this video.
hi demipixel!!!
Ok.
you must be the swatter at 1:24!!!!!
found it
@carykh when is next TWOW
the timed drawing segment honestly looks like it would be fun as something like a party game to play with friends
so basically gartic phone
Cary: My dog just died
TheOdd1sOut: Yeah, they do that
lolololOLOLOLolololOLOLOL
Lol
XD XD XD i get it
irrelevant cringe meme :/
Lolooloolooollololololoolololol9olololololllollololololololololololoololollololololololololololololololololoollolololololololololoolololololollo
Every singer ever could use this
2Pac hologram: 😱
1:26 meanwhile me taking a month to animate a 10 second animation: haha jokes on you
Dude. This is one of the most awesome things I’ve ever seen accomplished with a UA-camr coder :)
2:19 “stop using images we don’t have the rights to”
*Uses images he probably has the right to as images he doesnt have the right to*
Hi stalliongd from 3 years. I'm thefakesdslayer in 3 years
OMG ITS THAT GUY
StallionGD lmao
5:18
"I used in BFDI"
*proceeds to show BFDIA*
"If you give a lazy person a difficult job, they'll find the fastest way to do it" Steve Jobs, in The Art Of War, circa. 69420
Bro, that was Ghandi in "The art of the Deal"
Eduardo P What’cha Talking about. It’s Sun Tzu from 1984
@@eduardop2111 "Most quotes on the internet are misattributed." - Abraham Lincoln
@@spidercubed9718 well that's the point, if you can't tell
69420
Hey, Cary! We have a channel that uses a lot of animation and we have been struggling with incorporating lip sync, because it is sooo time consuming. Adobe animate has an auto-lip sync feature but it is not as clever and smooth as yours. I think that your piece of software might have serious commercial potential. Also, is there a way we can try the software ourselves?
CuriosaMente lol no
Nope
nop
Sully Bully you don’t know and so do the rest...
Who knew the day would come when cary could vibe check his fans
why did yt recomended me this 4 year video
Scratch Lip Sync Engines: “Am I a joke to you?”
???
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh @@retiredaccount6032
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
he meant scratch.mit.edu
He addresses this.
Yes
category:
*g a m i n g*
Ah yes, *g a m i n g .*
But Cannot See The Category :(
Did UA-cam Removed Them :( Plzzz Tell Me 😭😭
@@MFahrulRozi huh
Ny Favourite.
Danny Devito has entered the chat
only a gamer could do this
HELLO?! This is actually SO cool and you've explained it so well omg, it just makes me want to learn how to code even more!!
This man is single-handedly reworking how videos are made.
when he finishes making these tools, he should release them with the assets removed so people can replace it with their own. that'd be really cool of him
I would pay for this software.
@@markus3666 same !
some of these already exist; there are the pamela and rhubarb projects connecting speech recognizers with lipsync output. commercial studios have already been using neural net based ones for a while but it's not generally talked about.
@@TheSkrylar can u please name one that actually has decent auto lip sync
the lazykh really was in your face. i dont watch this channel, this is the only wideo i'we seen, but i guessed it instantly w/ the 2 letters
The moral of the story was to not let your dog walk without you.
I must say that the lip sync system is pretty amazing and well made. With a few tweaks, it could improve the video creation pipeline 100 fold
that "go away" was personal
Big brain ideas: If you too lazy to do lip-syn just wear mask.
**GENIUS**
How topical.
@Paper Towels Nope, they meant topical
Or don’t draw masks
Pull a let me explain studio on em
BAK Robert Johnston did you mean mouths? Or just masks?
next: automatic animator
after that: accurate voice synthesizer
etc.
in the end: fully automatic video creator and uploader.
I wonder how much money he'd get from that...
what about Automated Movie Producer
I mean, Vtubers are already a thing. They're absolute shite so far as I know, but they exist :)
final result: fully automated Pewdiepie
Final: Automatic viewer. I robot that'll watch the whole thing. Each with separate personalities that’ll help decide whether to like or dislike.
0:31
“I hope this isn’t my legacy”
Lowkey that whole sentence explains all my dramatic pasts-
as an animator, i struggle with lip sync. this actually boosted my understanding! thanks!
you create stuff on gacha life. that isnt animation.
@@crash-wb8ij don't be toxic, dude.
@@crash-wb8ij everyone starts somewhere my guy
@Nem Gam Boi if y'all were to actually look at their channel they have hand drawn animated content too lmao. Y'all just hateful to be hateful.
I can't believe Cary just found a way to automise animated story time UA-camrs
In a few weeks he won't even be recording the videos
Ah finally those story time youtubers would be even more lazier
i remember watching this a while back and i came back today and realized this is the cary who made bfdi.
Him: This Video.
Animators: Here is thousands of dollars, share this technology!
A BFB episode AND a carykh video?!
ON THE SAME DAY?!
=D
Ik what is going on
Quarantine makes house job easier.
this is the video that introduced me to your channel. i did not even know bfdi existed back then
your gonna to leave one day and just leave this thing running.
yes
maybe he already did
8:37 there is a mouth glitch here
Here before Noodle sends his cronies to your video to attack you for “disrespecting animators”
At 8:37, Cary’s mouth doesn’t move when he says last time.
You found an error :0
It's actually him performing entriloquy.
oMg DiSlİkEd
@@jerrysimon8771 ventriloquy*
Leave the poor robot
He did whole video correct except this
The bouncy-ness of the automatically generated character makes me nauseous.
Same
I got used in 5 minutes.
8:42 "Instant jumpcuts it is!"
Yaaaaaay..... Perfect for my ADD. Something on the screen needs to bounce around and be exciting every 0.5 seconds or I can't stay focused.
Yeah, same
Bouncy Bouncy
Made: 1 year ago
Cary: “I know we’re all stuck at home because of the pandemic”
*me realizing it’s been over a year since covid*
As much as its "lazy" to automate animation, making the entire machine to do it is an amazing job!
Cant wait for more :D
have you done," I am Cary kommits homicide."
Hank Just moika
@@suwinkhamchaiwong8382 Moika
@@suwinkhamchaiwong8382 Moika
You’ve got a profitable idea to market to UA-cam animators. Also, the jigglyness is fine, it just needs to be animated more subtly, or replaced with a slight expression change to more intensity
I am actually interested in seeing how this program can be adapted to different types of avatars and mouths. My avatar is essentially a 3D model, so having it without the mouth is kind of tricky. I can recompile it without the mouth, I still have the source files, but having the mouth itself separate is something I don't know what to do. I am thinking of resorting to do several shots of my avatar performing various actions, similar to some storytime animators, but that seems like it's too much trouble for it, and like you said, work smarter, not harder.
I mean it kinda was adapted to some vtuber avatar softwares using audio.
in 3d easier would be to just predefine different mouth shapes and then animate them according to audio
Wow, that lip sync is amazing! Though, I think it's better to have more than 5 poses, it still feels somewhat repetitive, especially the one where the avatar is holding its chin. That pose doesn't feel like you're supposed to talk, so that kinda felt "weird".
Yeah the holding chin one didn't fit at all.
It looks like he is taking a moment pause, tbh
I personally liked it
Doing more work to do less work. A true genius.
It seems like the jigglyness is because the avatar switches to a default pose of some sort for 1 frame in between the 2 poses
No, when you watch in slow motion you can see that there are several intermediate frames with no apparently default pose. I think he should try to make them less jiggly or get rid of them all together.
I actually love the jigglyness of his new character
Should have animated transitions and not just change poses
“Cary kaleidoscope hoarder”
Much better, thank you
four years later THIS IS STILL GREAT!
This can actually be a game changer for animation videos, props
that’s so well programmed omg.
your avatar will be amazing what ever it is lmao B)
commented thrice but thats ok
Cary's mouth is got mistake when removing recomended characters
i've just started watching the video - but u have inspired a lot of my university projects over the past two years and are much of the reason I chose to pursue CompSci with AI! Thanks a bunch man
That was you best KH joke yet! Kaleidoscope hoarder? That just cracks me up!
This man is literally creating automatic animation
Animators: my job is to hard for a robot to do
Cary: im about to ruin this mans whole carrier
Man, Cary Kaleidoscope Hoarder is such a fun UA-camr to watch.
There's already a way to automatically animate, you just have to outsource to China
Good
At least I got a nice stable job
Till it's outsourced to china or rEpLaCeD bY a rObOt
@@rerease *haha odd1sout quote go brrrrr*
@@rerease i was thinking that too when I read that comment too lol
@@rerease *are you my classmate in disgui-*
*OHHHH WHAT OH YEAH I’M A GOOD PERSON!!*
This is very interesting. I have been thinking of how to do a project exactly like this (auto animation, mainly for lip-sync) and it is great to see that it is actually possible. Could you share how long did it take you to train the model, and how big was the training set?
what a mistake that this isn't a yellow face ad, "are you tired of animating and you wana let AI take over? well buy our revolutionary AI bot, witch can animate in SeCoNdS "
at some point, this channel is going to be completely replaced by an AI and we'll have no idea
0:03 it sounds like he was banging his head on the keyboard while typing.
Cary in the next decade: I made an automatic robot to make an automatic robot which will run my channel.
letting out a sigh of relief after seeing he stopped using pygame
0:30, Farted at the right time
4 years and no replies? Sad.
Four years and one reply. Sad…..
Four years and 2 replies? Sad
Four 444
4 years? 4 REPLIES? so sad
Carykh when animating 30 minute animation without lipsync: oh no, it will take an month
Me animating an single walk cycle in garrys mod: AHHHHHHHHHHHHAAAAAAHHHHHHHH👹 IT WILL TAKE MY ENTIRE... LIIIIIIIFE
9:40 Oh my goodness. You could make this a game.
Give players a prompt, they draw it, and then have them rate four other players' drawings from best to worst.
Players receive a score based on how well their drawings compared to others' drawings in the public eye.
You gradually end up with a library of all the "best" illustrations for any number of topics or prompts.
This might be how you get a library of 300 pictures of penises though... If cary or someone else acts as a moderator, that might work.
gartic phone?
*F* IS FOR FRIENDS WHO DO STUFF TOGETHER
*U* IS FOR U AND MEEE
*N* IS FOR- uhhh... guys, I forgot.
n is for anywhere at anytime at all
down here in the deep blue sea
Ni
Nice
N word
No
DUDE I CAME HERE A WHILE AGO TO SEE AN AUTOMATIC LIP SYNCING TUTORIAL, LEFT , THE CAME BACK YEARS LATER REALIZING U MADE BFDI!!
""LETS WORK SMARTER AND NOT HARDER" -carykh 2020
i really like the idea of still having to manually draw. might be cool to have it save the animation of you drawing so it can fit the process of you drawing the frame into and through the time it gets used on screen.
Holy shit can you just imagine what my channel would look like with this?
8:00 I see what you did there.
It looks like a fun game at 9:34 where you have time to draw something that someone else will try to guess what it is.
Gartic phone?
@@Elunatrixyes
i remember watching this video when it came out, not knowing anything about bfdi or animating in general and finding it now brings me endless amounts of joy
i laughed when cary said “its cary kelidoscpoe horder hahahaha”
You good bro?