AUTOMATIC LIP-SYNCING
Вставка
- Опубліковано 16 кві 2020
- Check out Brilliant.org for fun STEMmy courses online! brilliant.org/...
THE SOURCE CODE IS NOW PUBLIC! Here's info on that: • Automatic lip-sync sou...
Lazykh source code: github.com/car...
Lazykh UA-cam channel: / @lazykh_
Part 1 of this video: • Automatically making Y... - Ігри
For the legal aspect: Google has a way you can filter images by commercial reuse with modifications
What how??
@@PlasticSinks After you search look under the search bar and click Tools > Usage Rights
He did say that the cc image library was "lame" in the video
that's assuming the uploader is honest and actually knows what it means (look up "distracted boyfriend" with the filter on and see how many low-effort edits of the copyrighted you-need-to-pay-for-it image are there)
personally i'd like to see a crowdsourced thing where you ask a discord bot for a prompt and send it an image you drew matching it (of course with some sort of similarly crowdsourced report system so the video isn't full of garbage and dingdongs and "subscribe to my channel"s)
Yep. It also defaults to this setting when you try to search for images in Google Docs, which can be kind of annoying, but I understand why.
Cary in a few weeks: "My entire UA-cam channel is now running automatically"
Can you see the future? Perhaps that is where this is all going :P
Cary in three years: Forcefully taking control of UA-cam and running it using AI
wait you watch cary? so do you watch bfdi?
Do you want SkyNet? Because that's how you get SkyNet!
@@icecreamsandwich7522 that is youtube in a nutshel whitout the taking over or cary
This man is working hard so he doesn’t have to work hard.
Every automated system ever
Aint that the most true sentence
That's how humanity has progressed this far
@@RinInABin until AI got so advanced and started making an automation for themself which is the automation is also an AI and then they got so advanced that they made an automatic machine for themself and so on.
@@kakyoindonut3213 _the singularity_
“Digital animation isn’t real animation. The computer does it for you”
Animator: Lmao, I wish that was true.
lul
YES THATD BE AWESOME
True...
:((( it takes me like 10 minutes to SKETCH a 0.5-2 SECOND CLIP- TwT
((probably because I don't draw stick figures and I draw cats and people at least semi-realistically-))
@@Xox_InSocks aaaaa I get how you feel lol
what about after effects animators ?
Cary 1 year ago: Did editing, voices, animating, coding, etc.
Cary 1 year in the future: COMPUTER, MAKE A VIDEO!
*computery ;)
@@martysh1226 Cary's just going to become an AI at this point
Alexa, make a youtube video.
and thats it. the computer just makes a complete, perfect video, in half a minute at longest.
@@blueninja012 That might be the end goal
My man just automated his whole UA-cam channel, he's my new hero
the bigger picture is that he actually just enabled a new wave of youtube creators who don't want to/can't put much effort in their videos. They can just draw some basic shapes, write a script and video done. Not only did he automate his channel, he automated countless other channels
Teri Hornych madlad
similar bot have been done but this one is next level
@@110110010 gonna recreate and sell it xdd
Teri Hornych well he did not open source the sourcecode of the program, so thst won’t gonna happen any time soon.
1 minute of animation = around 1 day of work.
cries in 3D
Sometimes 2D is harder than 3D
me who only traces in desmos
3D animation is underrated
Animation is underrated
@@onefinalobjectepisodes oh really
Cary in a decade: “my body is moving automatically”
How I get 77 likes
@@14_bryce65 80.
81*
@@pendantperuke9440 248*
😢😮😅
Anything: is manual
Carykh: *visible agitation*
wont take him long until he creates automatic breathing
If you filter google images by "licensed for noncommercial reuse" there will be no copyright issue! I had to learn to do this for school. Upvote so he sees this.
OMG that's really smart! I should go implement that into the Google-Image-searcher, and see how well it works. If the resulting images are still up-to-par, that might solve this whole issue!
I think this would probably be commercial reuse, though. He is earning money from it.
The problem is I don't think UA-cam videos qualifies as non-commercial if they are monetized.
@@carykh make sure it's licensed for commercial reuse, as you are making money off your videos the noncommerical ones aren't allowed
"Licensed for non-commercial reuse" isn't the same thing as "royalty-free" nor "open". It's sufficient for school presentations, since those aren't commercial, but Cary's videos are commercial, he earns money from them. This wouldn't help him in the slightest.
And here he calls himself Cary kaleidoscope hoarder. The funniest shit I ever heared
Once he called himself “Cary key hole” lmao
@@kiana.118 that’s the one i heard first and what i thought he meant.
pyro tf2 is right
Mmmmmph
Language dude
YOU NEED TO SELL THIS
Just having a program that makes the timing and inserts the right lip flap into Premiere would be so incredibly helpful to the entire animation industry. I know quite a few abridged series that could benefit from such a thing.
I could definitely use that.
Also VTUBERS COULD MOD IT TO BE LIVE SO EVERY FEW SECONDS IT FITS THE EXPRESSION IT HAS TO HAPPEN!
This works so much better than I thought it would
Lmao
Nailed it
Hello
Subbed
Ikr!
The next thing you need to make is an automatic KH joke generator.
You can do It yourself, just get all of the words that start with k, generate a random number and pick that, repeat with h. My best result at this choosing specifically is kleptomaniac hallucinogenic
@@Adomas_B
Sure, but then it's not really automatic
i mean this method could be automated really easily. random number generator + list of words that start with k and h. done.
@@entropy687 "Hi, Kindergarten hallucinated here!"
@@entropy687 Well there is one problem, it could choose two nouns or two verbs and may sound weird or nonsensical, so it should also be scripted with structure with verbs are followed by a noun, adjectives are followed by a noun, etc.
6:03 They’re talking about Pencil’s mouth not being on her body. You’ve gotten 0 complaints about the lip syncing!
Cary:
kaleidoscope hoarder??
Viewers:
It's... Acceptable.
STOP HOARDING THE WHIPS CARY!
And now skip 10 years into the future and Carykh has just a button next to his bed that when presses searches for an interesting topic, creates a script and uploads an entire UA-cam video about it.
A button? How primitive. A brain interface definitely requires less energy and is faster to use, he just has to think about doing it.
@@thoregrimm6042 lmao
@@thoregrimm6042 Thinking would also require effort - just schedule it to run every week
@@OpenKeith Just let the AI decide when it's the best time to upload
@@timgreller first of all there's no AI in this, it's just a bunch of python scripts. second of all why use an AI when a cron job is simpler and would produce a more consistent upload schedule
Google has an "advanced image search" so you can filter by non copyrighted images
Yeah
8:00 I see what you did there.
Holy heck I just now realized this was one of the guys who produced BFDI! Dude thanks those animated shorts made up a huge portion of my childhood.
Same
8:37 cary's "lip synced mouth" is broken
Lol
0:20 Mom, look! I'm on TV!
lucky man
Nice
BRUHHH
No way!
Lucky
0:03 it sounds like he was banging his head on the keyboard while typing.
9:52
*Imagine if he didn't write the O on time*
Plot twist: Cary was automated the whole time.
plot twist: this is not automated
@@dat1pengu1n Plot twist : you missed the joke
@@dat1pengu1n r/woooosh
@@Dragona- plot twist:
That's not a plot twist, it's just obvious
Carykh: post video, me: SPEED IS NECESSARY
yep
yep
SPEED IS KEY
@@por1264 yep
@@captcalvin2293 yep
It looks like a fun game at 9:34 where you have time to draw something that someone else will try to guess what it is.
Gartic phone?
@@Elunatrixyes
3:45 right after this part, i got an ad
same
I got 2 ads
but I didn't
The stars have aligned and we got a Jacknjellify, a carykh, and a humany video all in one day.
THE ANGELS HAVE BLURSED US
thats why ruby took out the freesmart supervan duh
@@olgahapitan312 LOL
Sebastian Lague too
who?
"If you give a lazy person a difficult job, they'll find the fastest way to do it" Steve Jobs, in The Art Of War, circa. 69420
Bro, that was Ghandi in "The art of the Deal"
Eduardo P What’cha Talking about. It’s Sun Tzu from 1984
@@eduardop2111 "Most quotes on the internet are misattributed." - Abraham Lincoln
@@spidercubed9718 well that's the point, if you can't tell
69420
3:37, Cary here when the machine was supposed to lip-sync to you saying “two” the mouth stayed closed too long
@regentfernYT don’t be sad. It’s ok lol.
5:20 I just realized who this is
Cary: *Talks about the mouth shapes he used*
My Brain: One for Pho
noodle
@@tastyyoylecake2069 The Pho taste very nice
Pho
Cary: My dog just died
TheOdd1sOut: Yeah, they do that
lolololOLOLOLolololOLOLOL
Lol
XD XD XD i get it
irrelevant cringe meme :/
Lolooloolooollololololoolololol9olololololllollololololololololololoololollololololololololololololololololoollolololololololololoolololololollo
He hates animating mouths because he’s too busy hoarding kaleidoscopes
This man is literally creating automatic animation
category:
*g a m i n g*
Ah yes, *g a m i n g .*
But Cannot See The Category :(
Did UA-cam Removed Them :( Plzzz Tell Me 😭😭
@@MFahrulRozi huh
Ny Favourite.
Danny Devito has entered the chat
only a gamer could do this
Hey, Cary! We have a channel that uses a lot of animation and we have been struggling with incorporating lip sync, because it is sooo time consuming. Adobe animate has an auto-lip sync feature but it is not as clever and smooth as yours. I think that your piece of software might have serious commercial potential. Also, is there a way we can try the software ourselves?
CuriosaMente lol no
Nope
nop
Sully Bully you don’t know and so do the rest...
Who knew the day would come when cary could vibe check his fans
1:31 Kurzgesagt would like a word with YOU!
They're a team of animators
they have a giant group of animators
You’ve got a profitable idea to market to UA-cam animators. Also, the jigglyness is fine, it just needs to be animated more subtly, or replaced with a slight expression change to more intensity
next: automatic animator
after that: accurate voice synthesizer
etc.
in the end: fully automatic video creator and uploader.
I wonder how much money he'd get from that...
what about Automated Movie Producer
I mean, Vtubers are already a thing. They're absolute shite so far as I know, but they exist :)
final result: fully automated Pewdiepie
Final: Automatic viewer. I robot that'll watch the whole thing. Each with separate personalities that’ll help decide whether to like or dislike.
10 bonus KH points if you can find where I am in this video.
hi demipixel!!!
Ok.
you must be the swatter at 1:24!!!!!
found it
@carykh when is next TWOW
*A stranger threw my dog off the bridge*
WHAT KIND OF-
2:54 ''my dog just died'' i feel like thats a bad place to start off
8:37 there is a mouth glitch here
At 8:37, Cary’s mouth doesn’t move when he says last time.
You found an error :0
It's actually him performing entriloquy.
oMg DiSlİkEd
@@jerrysimon8771 ventriloquy*
Leave the poor robot
He did whole video correct except this
"If you ever animated yourself, you know that creating a ten minute animation can take several weeks" XDDD DEAD.
I've been working on my 8 minute graduation film full time since pretty exactly the upload date of this video. As a core team of two, plus a bunch of animators. And it's about halfway through rough animation after a year of production.. Automation is cool but my heart is with everything that's handmade, obviously (:
i laughed when cary said “its cary kelidoscpoe horder hahahaha”
You good bro?
I must say that the lip sync system is pretty amazing and well made. With a few tweaks, it could improve the video creation pipeline 100 fold
Every singer ever could use this
2Pac hologram: 😱
This popped up in my reccommended. I wanted to stop in and say WOW!
Wait... He animated Battle to dream Island??
Dude animated my _CHILDHOOD_
when he finishes making these tools, he should release them with the assets removed so people can replace it with their own. that'd be really cool of him
I would pay for this software.
@@markus3666 same !
some of these already exist; there are the pamela and rhubarb projects connecting speech recognizers with lipsync output. commercial studios have already been using neural net based ones for a while but it's not generally talked about.
@@TheSkrylar can u please name one that actually has decent auto lip sync
Scratch Lip Sync Engines: “Am I a joke to you?”
???
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh @@retiredaccount6032
Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh Bruh
he meant scratch.mit.edu
He addresses this.
Yes
1:19
I'm done, I never laughed so hard
THIS IS THE SAME MAN WHO MADE BATTLE FOR DREAM ISLAND WHY AM I JUST NOW LEARNING THIS
Big brain ideas: If you too lazy to do lip-syn just wear mask.
**GENIUS**
How topical.
@Paper Towels Nope, they meant topical
Or don’t draw masks
Pull a let me explain studio on em
BAK Robert Johnston did you mean mouths? Or just masks?
The moral of the story was to not let your dog walk without you.
I watched this long time ago thinking it was a normal video now I come back with honor
1:23 "Aren't i beautiful?"
"Go away." had me on the floor 😂
Dude. This is one of the most awesome things I’ve ever seen accomplished with a UA-camr coder :)
2:19 “stop using images we don’t have the rights to”
*Uses images he probably has the right to as images he doesnt have the right to*
Hi stalliongd from 3 years. I'm thefakesdslayer in 3 years
OMG ITS THAT GUY
StallionGD lmao
"Choose four emotions"
"Alright"
"Give each of them five different poses"
"Okay..."
"Give each of the poses three different stages of blinking"
"..."
"I drew all of them by mouse"
"I can feel the depression"
Holy shit can you just imagine what my channel would look like with this?
as an animator, i struggle with lip sync. this actually boosted my understanding! thanks!
you create stuff on gacha life. that isnt animation.
@@crash-wb8ij don't be toxic, dude.
@@crash-wb8ij everyone starts somewhere my guy
@Nem Gam Boi if y'all were to actually look at their channel they have hand drawn animated content too lmao. Y'all just hateful to be hateful.
Him: This Video.
Animators: Here is thousands of dollars, share this technology!
0:31
“I hope this isn’t my legacy”
Lowkey that whole sentence explains all my dramatic pasts-
Man, Cary Kaleidoscope Hoarder is such a fun UA-camr to watch.
Wow, that lip sync is amazing! Though, I think it's better to have more than 5 poses, it still feels somewhat repetitive, especially the one where the avatar is holding its chin. That pose doesn't feel like you're supposed to talk, so that kinda felt "weird".
Yeah the holding chin one didn't fit at all.
It looks like he is taking a moment pause, tbh
I personally liked it
This man is single-handedly reworking how videos are made.
I actually enjoy animating lip sync, it’s perspective and the rest of the body (expect for the eyes) moving that gets me.
1:26 meanwhile me taking a month to animate a 10 second animation: haha jokes on you
I can't believe Cary just found a way to automise animated story time UA-camrs
In a few weeks he won't even be recording the videos
Ah finally those story time youtubers would be even more lazier
I am actually interested in seeing how this program can be adapted to different types of avatars and mouths. My avatar is essentially a 3D model, so having it without the mouth is kind of tricky. I can recompile it without the mouth, I still have the source files, but having the mouth itself separate is something I don't know what to do. I am thinking of resorting to do several shots of my avatar performing various actions, similar to some storytime animators, but that seems like it's too much trouble for it, and like you said, work smarter, not harder.
I mean it kinda was adapted to some vtuber avatar softwares using audio.
in 3d easier would be to just predefine different mouth shapes and then animate them according to audio
Oh good I finally found you,
I watched this channel like a year ago then forgot about it
Cary in a few months :
Hello guys my whole channel is now automated and all my videos too. My channel runs by itself and it can even leave comments and heart comments! Ill be adding Pin feature soon!
A BFB episode AND a carykh video?!
ON THE SAME DAY?!
=D
Ik what is going on
Quarantine makes house job easier.
It seems like the jigglyness is because the avatar switches to a default pose of some sort for 1 frame in between the 2 poses
No, when you watch in slow motion you can see that there are several intermediate frames with no apparently default pose. I think he should try to make them less jiggly or get rid of them all together.
I actually love the jigglyness of his new character
Should have animated transitions and not just change poses
Cary in the next decade: I made an automatic robot to make an automatic robot which will run my channel.
12:30 ngl, that transition was smoother than butter.
0:30, Farted at the right time
4 years and no replies? Sad.
Four years and one reply. Sad…..
Four years and 2 replies? Sad
your gonna to leave one day and just leave this thing running.
yes
maybe he already did
the timed drawing segment honestly looks like it would be fun as something like a party game to play with friends
so basically gartic phone
9:40 Oh my goodness. You could make this a game.
Give players a prompt, they draw it, and then have them rate four other players' drawings from best to worst.
Players receive a score based on how well their drawings compared to others' drawings in the public eye.
You gradually end up with a library of all the "best" illustrations for any number of topics or prompts.
This might be how you get a library of 300 pictures of penises though... If cary or someone else acts as a moderator, that might work.
gartic phone?
Randomly, the mouth stops moving even though you're still talking. Just a heads up btw.
Also, even though you have no repeating poses, some poses show up too often imo.
Errors like 8:37, yes. But it stops most of the time because he has a “small” amount of faces relative to the amount of phonetics there are, and some of them can even be the same face.
Did not notice any repeat of poses. But I dislike a lot that he always smiles even talking on a serious topic.
@@happysongs4kyrone yeah I think simply changing the probabilities for faces to show up should solve the problem
Made: 1 year ago
Cary: “I know we’re all stuck at home because of the pandemic”
*me realizing it’s been over a year since covid*
For years I've waited for someone to make an Ai program that takes the audio & makes a good mouth animation to the audio. It's so crazy something like that doesn't exist yet. Mouth animation is so tedious & time consuming it makes the process so unenjoyable & grindy, PLEASE SOMEBODY MAKE A PLUG IN FOR SONY VAGUS PRO 14 & AFTER EFFECTS & MAKE IT PUBLIC!!!
As much as its "lazy" to automate animation, making the entire machine to do it is an amazing job!
Cant wait for more :D
have you done," I am Cary kommits homicide."
Hank Just moika
@@suwinkhamchaiwong8382 Moika
@@suwinkhamchaiwong8382 Moika
HELLO?! This is actually SO cool and you've explained it so well omg, it just makes me want to learn how to code even more!!
6:03 That one madlad who looked at every single frame that carefuly throughout the enitre series, just to find a flaw, what a simple yet hard and time-consuming achievement
that’s so well programmed omg.
your avatar will be amazing what ever it is lmao B)
commented thrice but thats ok
The bouncy-ness of the automatically generated character makes me nauseous.
Same
I got used in 5 minutes.
8:42 "Instant jumpcuts it is!"
Yaaaaaay..... Perfect for my ADD. Something on the screen needs to bounce around and be exciting every 0.5 seconds or I can't stay focused.
Yeah, same
Bouncy Bouncy
The kaleidoscope hoarder joke actually made me laugh harder than I expected 😭
This guy can teach every subject in school
This can actually be a game changer for animation videos, props
10:58 the blue guy sounds like Pin!
10:28 also it is often bad practice to reinvent the wheel. Each component of a project has probably already been done by someone else; it is just a matter of integrating them into your own project or workflow.
cary is the sort of guy to make entire conlangs for a gag