Turning Hand Drawn Animations to 60 fps with AI
Вставка
- Опубліковано 30 вер 2024
- These are the results of testing the deep learning algorithm DAIN (Depth-Aware Video Frame Interpolation) that can detect movement patterns of a video or gif and increase the smoothness.
DAIN code: github.com/bao...
Sources:
0:08 - www.pinterest....
0:24 - www.pinterest....
0:33 - www.pinterest....
0:47 - • Crimson Alpine
1:03 - www.pinterest....
1:19 - www.area-visual...
1:27 - www.pinterest....
1:50 - www.pinterest....
1:58 - www.pinterest....
2:14 - www.pinterest....
------------------------------
Night Out by LiQWYD / liqwyd
Creative Commons - Attribution 3.0 Unported - CC BY 3.0
Free Download / Stream: bit.ly/2BLdhW5
Music promoted by Audio Library • Night Out - LiQWYD (No...
------------------------------
![Больше кадров в секунду ≠ лучше [в 4K 60ФПС]](http://i.ytimg.com/vi/zxS-u4VhcxU/mqdefault.jpg)
![Больше кадров в секунду ≠ лучше [в 4K 60ФПС]](/img/tr.png)
![Smoother animation ≠ Better animation [read description]](http://i.ytimg.com/vi/_KRb_qV9P4g/mqdefault.jpg)
From what I've seen so far of DAIN and general frame interpolation it's really nice, but depending on the starting frame rate it can REALLY work or REALLY flop. That's not very surprising, though. I think frame interpolation is more suited to being a tool for footage or animation that plans to use it in post production and plans the directing around it.
Extended Thoughts/Why Interpolation Looks Weird(long):
I think the mathematics definition of "to interpolate" is the most accurate for this kind of tool: "insert (an intermediate value or term) into a series by estimating or calculating it from surrounding known values."
If you record a fast moving object (like a baseball being thrown) with a low frame rate you get motion-blur. This is fine if the recording is presented at it's captured FPS, but it can get exaggerated and sometimes look like it's a lower frame rate than the presented one. (Check out some 60FPS Lord of the Rings and look at fast moving objects)
With hand-drawn animation it's a bit different. Artists/animators can use a wild variation of frame rates to animate at depending on the medium(GIF, internet video, etc.) and at what speed they intend it to be presented. There's also the infinite amount of artistic styles and stylistic choices: blurring to exaggerate motion, CG, realistic, cartoon, etc. DAIN is by far the best FI so far, but for art/video not created with interpolation planned in post can still look really off-putting, and this is a combination of both the original FPS and art style described above.
If a video was shot in 30fps and interpolated to 60fps then there might be some artifacting but it won't be bad. For every frame of the video, a new frame is created, and the program creates an image that is an in-between image. (1---2---3---4 versus 1-a-2-a-3-a-4, but it happens with the same amount of characters) But if you shot the same video in something like 24fps, the program has to create an extra one and a half of a frame(60/24=2.5) versus the extra single frame which can lead to even more distortion. With an animation that plays at less than 30fps, artifacting happens a lot the lower the frame rate is.
Check out 0:40 and watch her legs(slow it down if you need to). There's no blur in the frames to indicate motion, and check out how far her legs move between each frame. Because simple interpolation can only infer what's going from the frames, it can only create an image that is an in-between of the two, it can't draw a new frame like the original artist can. DAIN is better at this because it's an AI that can learn, but it's still a program that can't tell you what looks right or wrong. That's why there's so much smearing, fading, and artifacting in the interpolated version. Look at 0:32 and watch the feet(again, slow it down if needed). Notice the way some of the feet just kind of fade out instead of moving as it should? In the original, the leg is there one frame and then gone the next. The AI doesn't know what a cat is or how it's body works and should move, it just knows what the frame was before and after, so it just tries to fill in the gap with what comes next, which is just white space, thus the fade-out.
This is why I think it has more potential as a tool to output a desired frame-rate while only drawing half of the intended frames, or maybe even a quarter(30fps playback speed, but only 15 frames drawn). Animators could learn through experience how their art-style gets interpolated and what details to change so the experience and finished product come out very smooth without spending hours or days drawing an insane amount of pictures for one second of animation.
(If I got something wrong, please feel free to correct)
Still curious? Definitely watch the Slow Mo Guys' video ("Why aren't Slow Mo Guys videos 60fps?") about FPS(not interpolation, but it could help understand it and the differences between play-back speed and FPS)
Thank you for coming to my TEDx talk.
Thats why the results can be so different, is basically a combination of the style and how the frames are distributed.
That makes a ton of sense, I noticed a lot of artifacts and stuff in the 60 fps version
1:28 is one of the ones that worked crazy good imo.
After reading this I rewatched and came my ratio of which version I liked more drastically increased in favor of the original arts. Some 60fps did look great but yeah those subtle imperfections compared to the original just made me lean toward the originals more
This. I was exactly thinking about how just because it’s higher frames, doesn’t mean the animation will be any better. The greatest films of all times use a combination of 1s, 2s, and 3s and by sticking to only one can make the animation feel mechanical as shown within some parts of this video.
Honestly, it entirely depends on the aesthetic you’re aiming for. Sometimes 60fps looks better, sometimes it doesn’t! This is amazing nonetheless.
Agreed. For some hand drawn animation looks miles better. It truly depends. For some charming comic-style animation 60fps looks odd as hell and just doesnt fit.
For fantasy and anime animations 60fps looks pretty good and arguably better
Stfu and watch the video boomer
60 fps makes everything look like a video game. Too smooth and jelly looking. Nothing moves like it has weight and moves like a robot is controlling it
absolutely agree. it always made the animation smoother, and smoother did look better in some styles, but in others it rounded off hard, intentional edges and details that were part of the style’s visual appeal. This will be a good tool for the post production of some types of animation, especially when the style is planned around it or if a final version of the system gets multiple selectable modes optimized for different styles, but even the, won’t work everywhere.
@@veronicaeatmon8725 oh look who just learned a new word
0:32 looked like a real video with a filter over it
Check it out at 0.25 playback speed and see the magic dissolve
It looks like they used motion capture for it rather than animated it. Hand drawn is clearly superior
@@lucafacchinetti2522 the original looks like a bad animation, theres a skip between the paper
but the 60fps doesnt change, it still moves smoothly
Yeah this is why i like 70 fps m9re
Something it looks good, sometimes nah.
It looks good when the motions aren’t repetitive
if the drawing is consistent and not so dependent on detail, this can really work out.
If you used this and just polished it, you could probably do a ton for most of these short animations.
it is
Especially if it’s still a rough animation. The detail could be added later. This could save time with inbetweens... but the running animation looks rough when slowed down so it’s probably better with small movements.
Is very recomendable for to archieve some efects like, alucinations, hd camera, or slowmotion.
But cut the effect of ' too fast for the eye' in dinamic actions.
Is nice for the girl with the shotgun becuse the camera is traveling at high speed and helps the effects of following the character while the camera is doing it's own movement. But not that nice, at least to me, with the other girl running.
kesinlikle 👍
it definitely doesn't suit everything, but some looked better in 60fps
Yup! Sometimes it made the original look like jelly or a filter. But, overall, pretty smooth and cool!
Yeah,I really like the look for a lot of these,but some don't work
I think if it's used in a project,or film,certain scenes and parts should only use this as it can look very out of place sometimes
Exactly what I thought
And some didn’t even need it
It's because the less draws per second they have, the more of a "jelly effect" they'll also have.
The more draws per second they have, the more natural their 60fps will feel.
Some things work perfectly, whereas most things look unnatural and don't have that rustic charm.
It would interest me to see a film that incorporated both frame rates.
Might not be exactly what you mean, but in Spiderman into the spiderverse there's a couple shots where the 2 Spiderman are on screen together while they are animated at different FPS, Miles uses 12 frames as he's still young and inexperienced while Peter has 24 and feels more secure and precise
Both ideas are similar but not quite what I was thinking of.
Have you seen the film Pan's Labyrinth? There's a scene where a man has been heavily drugged and he is stumbling through a chaotic battle around him. If this was an animated movie, it would be really trippy and cool if the fighting in the background was in 60fps and the person was in 30, or even the other way around.
Nah. Most of them are better in 60
@@zakr1187 I said I'd be interested to see it, not that it would necessarily be better.
Owl house
If this ai can suceesfully fill the gaps between keyframes, that's definitely dope.
Yeah, no longer needing a small army of badly payed taiwanese animators to do all the inbetweens would be a blessing
@@carso1500 yea, but where would they work then?
@@Antank8 they would still get work, even with this technique you still need people who check the animations every now and then when the AI makes a mistake to correct it, especialy for longer or higher budged proyects, my comment was more along the lines for people who don't have the resources to hire one of those companies and as such they have to do all the inbetweens themselves which is a huge pain in the ass
@@carso1500 I figured,but it's still less jobs overall going around
@@Antank8 not really, look at it this way now that the prices of animation are lower and you require less people to accomplish the same end result what do you think it would happen, there are going to be the same amount of animations with less people working as animators
Or
There are just going to be a higher number of independent animated projects with now animators being capable of creating their own series or movies at the level of high quality productions in a fraction of the time and money
Historicaly the second one has held true, just for example compare the amount of animated TV series or animes that where being released during the late 80s compared to today, computers really helped to reduce the time and effort that was required to create one of this projects compared with the old method of celuloce paper that was a pain in the ass to animate, as a result there are a fuck ton more animations being created right now than 20 or hell, even 10 years ago with far more animators today, but even with the advent of computers animation its still an extremly hard and expensive endeavor, i have seen some really good animators like terkoiz (really recomend his work he is amazing) that to create even a single 10 to 20 minutes animation on his own can take him up to 9 months of non stop work
Now lets compare animation with another art form, with videogames, right now is easier than never to create a videogame from scratch, the tools are more accesible than ever and the raw power of modern systems mean that games that 10 to 20 years ago required a budged of millions and computers with the highest specs available to run now can be created for a couple thousands dollars at much and run on basically every system from a high end gamer rig to your grandmas computer she just buyed yesterday to check facebook, as such the videogame world has seen an exponential increase on indie developers creating their own ideas, sometimes a single develper with a lot of willpower can create a videogame capable of competing with AAA productions, and big corporations with the resources to spare are creating bigger and bigger proyects with more and more stuff cramped into them, what this means is that the are more videogames on then market and even if you don't find the game that you want you can probably create it yourself if thats what you desire to do
Imaginé that something like that happening to the animation industry, where basically any single indie animator could create their own series, how many independent high quality animations do you expect could be created by a team of three or four experienced animators if they don't have to draw every single inbetween but let the AI do the hard work and they just need to make corrections, then you have another AI that helps with the coloring with again the human only having to give the AI the raw data and correct it's mistakes, eventually you would probably see a spike of series, movies, etc all showing high quality animations at the level of current AAA but made by just a couple of people on their spare time
So basically instead of believing that this technique will let people without work, think of all the people that could suddenly work for themselves without needing to slave themselves to a big corporation
Thanks for comming to my Ted talk
The sliding down the mountain one was actually pretty smooth
To be fair the original was already smooth as fuck! Crimson Alpine is God tier animation!
@@DoubtlessCar0 yes
yeah i could barely see a difference hats off to resh for that
That was one I didn’t notice a difference in lol. The cat spinning in circles looked the best to me. Looked 3D
I feel like DAIN did a incredible job because in 60FPS it looked pretty good. But I feel like it did lose some of it’s impact with the frame rate increase because the gun recoil just felt way too smooth. Might just be me but yeah definitely agree with you
The DAIN really shines in action-rich, fast-paced scenes where a lot is going on.
yes agreed, i noticed it struggled with bones.
Yeah, it has the chance to generate some eye-watering sakuga.
While it really makes action scenes richer, i'd say DAIN could spark up tons of ink-like animations. The swimming silhouette looked gorgeous and i'm sure it would ease the process, it's such wonderful technology!
Yes it look off and janky when you can see it in detail but when a fight is going it’s to determine what exactly the animation is doing all you think is “Damn”
Like a cat chasing its tail
Is nobody going to mention how talented the artist must be who created the original? ‘Cause all of the animations have very nice drawings.
Artists. All of these come from different sources
For what's it's worth this is extremely impressive.
I can only imagine how much this can improve in the future.
An original persona fan? rare to see you lot out in the wild
@@F4nta5y lol
300th like
Yeah, animation studios will can just spit out 24 or 30 fps animations then use this. They can literally only use half the budget for animation
@@F4nta5y funny, I came into the replies to comment on goblin's pfp too lmao
Original be like: - - -
60 FPS: -
Xdddd
Lol
0.0018310546875 FPS: *Error, the spaces go to the side of the page now*
0.003662109375 FPS: - - - - - -
0.00732421875 FPS: - - - - - -
0.0146484375 FPS: - - - - - -
0.029296875 FPS: - - - - - -
0.05859375 FPS: - - - - - -
0.1171875 FPS: - - - - - -
0.234375 FPS: - - - - - -
0.46875 FPS: - - - - - -
0.9375 FPS: - - - - - -
1.875 FPS: - - - - - -
3.75 FPS: - - - - - -
7.5 FPS: - - - - - -
15 FPS: - - - - - -
30 FPS: ------
60 FPS: -
120 FPS: -
@@alexandergreene461 That problem is due to how low the input fps (15 FPS) is. 30 FPS to 60 FPS looks better than this sample.
0 FPS:
I love how everyone is giving their honest opinion but no one's being rude about it. I think some of them look better and some of them don't.
That I do agree. with some of them looking really good and some of them look like ‘jelly’
The one I think that looks weird is the skeletal Deer, it looks like the legs are snapping back like a rubber band where as the original is so much smoother.
Yeah definitely
Forgot I was on UA-cam for a second
It depends on how natural it is like the skeleton deer look odd but something fantasy blends in well
Me watching on a 30 FPS device: ahh yes *smooth*
Wouldn't it be 30hz?
@@kiwimarshall3937 yes
Well maybe, it is about lower than 720p is not 60fps on youtube.
Do 30 hz devices even exist in this age ?
Stop lying there's like literally no screen out there that is 30, it's rare af
Honestly,the 60 fps feels kinda weird because of how 'jelly' it looks
I feel the same
Ikr
I like the charismatic vibes the originals have ☺️
I like the smoothness.. but say to smooth
Eh
there’s just a certain... charm to the originals, seeing animation being so _fluid_ kinda freaks me out
I feel like im high somewhat 😀
Ikr
Yea...
I thought the same thing
@@commanderleo calm down Jamal
*Sometimes the rough texture is what brings the animation to life*
Apparently to some people :T
no, fluidity, timing, principle and style does. using a slightly grainy brush ain’t changing anything. unless i’m completely missing the point of op’s comment.
I was searching this comment
@@hystericallover5989 he’s talking about the “roughness” of an animation, how an animation being just slightly imperfect can make it feel more alive
@@hystericallover5989 think they meant that the roughness/choppiness of some of the animations is what gives it more character than if it was perfectly smoothed out
The 60 fps takes away the impact & weight of the objects
YES. YES. THANK YOU.
Animators:
“Finally, now it will only take 2 weeks to animate instead of 3”
@Chilly Weathers -Imposter- yes but 60 fps can really help
@Chilly Weathers -Imposter- downhill... Like in the example with the girl sliding down the hill? ;D
@@randori- no absolutly 0 animator us 60fps
@Chilly Weathers -Imposter- exactly
@Chilly Weathers -Imposter- I think they mean that it takes more time to animate really smoothly, so this helps reduce the time lmao
I think everyone is seeing the flaws more than the actual fact that this is promising technology - a computer is literally guessing motions (very accurately) in-between frames based on complex math. It's not a human quickly drawing more frames in between or a type of motion blur.
We can make statements about how it should be used and how it shouldn't be used currently, but technology always improves - the fact that stuff like this even exists is huge.
True and I tried slowing the video down to 0,25x and you can actually kinda see the difference
Yep! This has great potential in helping animators get more bang for their buck without breaking an arm and a leg to get there- if not overused it can do wonders to help the animation industry and AI similar to this have already been used in things like puppet animation (i.e. tweening) so it has loads of helpful uses
Appreciate the sentiment but hasn't this been out for years? Sorry if it's a stupid question.
The thing about A.I. is that most of the time it guesses correctly, but sometimes it guesses Toronto. I don't want to be there when A.I. is controlling something important and it guesses Toronto.
Maddalena L’episcopo 🚇🚖🚗🏎🚚🚋🚋🚉✈️🚀🛸🚑🦯🚀🛵🚀🛵🛵🚲🛵🛵🛸🛵🛵🛸🛵🛵🚆🚆🚜🚆🚜🚒🚙🎻🚔🚔🚨🚠🚝🚞🚂🛰🚄🛳⚓️🚢🛶
honestly, the 60 FPS animations are so smooth that it may look like they're boneless.
1:09 brrr
Edit: Lmao 280 likes
THE BONES DONT HAVE BONES
They are flacid
That's a good way if putting it
@@effretibooyag7837 are you sure about that?
Cool it works as intended! Now let´s just never do that. :)
exactly :D
Yes
Good tool for the wrong type of animation...
I like it
Yes exactly! It’s the wrong type of animation! So to the creator of this video, Don’t use it that way!
Hentai artist: interesting...
Lmao 💀
Bet
Hentai in 60fps :0
Minus....
Shup up and take my money
Everybody: "Oh, that's so advanced!"
Me, not an animator: *"Ah yes, moving lines"*
As an animator, I can say it's complicated. If you look at my latest vid, you might know why XD I spent hours to get SMOOTHNESS on flipaclip.
@@LynxPlaysYT I don't have Instagram my mom would never let me get it. Also I'm not even done with the animation
@@TheTroggler yeah keep going with the animating you will get better
@@LynxPlaysYT I think I have been doing speedpaints and animation for about a year now so I'm still learning
@@eluartee cool. My animations kinda take longer because I usually animate dragons and stuff
After seeing this I can say with absolute certainty that AI is not advanced enough to successfully transfer a hand drawn animation to 60fps. The drawing seems solid and stable but the AI creates 60fps one seems like what ever the original was but made of jello. It seems way too inconsistent.
Thats kinda the effect of 60fps. Its too much.
the 60 fps with the sniper girl looks better ngl
AI is not perfect, but its advantage to hand drawn animation is that AI can be adjusted and optimized. It won't take too long for AI to outperform.
@@klaviergavin5401 Yes. More training data for the AI and it'll storm the world
@@default632 But,,, animation and any art is not a matter of outperforming, it's how art can capture attention, emotions, and societal issues. AI, used properly, can amplify art. If used on its own, it's useless, frankly.
I feel like, when it fill in the frames it gives things such a fluidity and bounce to it, that it loses some of the weight behind the drawing. Somethings are designed to be choppy or to hold for a second or two to give it umph. But when you just have the image constantly moving, that weight is lost and it's like the image is dancing in a void
I definitely feel like something gets lost in the process. The jitteriness of hand drawn animation adds a lot pf charm.
The technical achievement of this though is fantastic
Completely agree. The action shots in red especially demonstrate this charm that you can get in traditional animation, a type of edge that's smoothed out in this. Not only does the quick and sharp attitude of the animation get lost, but it makes the transition to 60 FPS look pretty bad.
It smooths out a lot of the more subtle movements and animation, making it look bad.
I prefer using it for stop motion videos, works well.
I mean the goal doesn’t have to be 60fps. Maybe this technology can one day be used to help artists with inbetweens for keyframes in animation and thus make 2D Hand-drawn animation more Profitable again. without making it 60fps but ending on 24 or 30, keeping that traditional animation vibe intact.
This could refined someday I'm sure for letting less hard work at postproduction.
In some cases I'd rather have the original because with the interpolation it smears it and ruins the feel for me.
Nah, its because you have a feeling like your crush is just using a filter on her facebook account but if you doesnt know, you will compliment it!
@@shirleendalman3975 LOLZ
The 60 fps thingy just ruins the entire timing of some of this animations
It only ruins it for Drawings, for Undertale anime’s and Swordfight things it’s better.
i mostly feel that for a lot of the rougher animations cause its too obvious and some frames just make it look weirdly jittery
0:31
Original: Cute cat animation.
60 FPS: Someone just recorded a cat and put a filter over it
(These would be my reactions if I didn't know it was the same image. Holy crap.)
That one specifically does looks kinda weird actually, like if you see closely the AI sometimes confuses the details of the cat and kind of merges lines with one another which is extremly weird, it's still awesome thou
The original one is probably rotoscoped anyway so you aren't completely wrong in that case
The cat has a lot of solid blobs of colour, so the morph-and-blur approach works pretty well on it. The very next example, the runner, shows how this technique is completely ignorant of lines. Sometimes it interpolates a pretty good motion-blurred version of an original frame, but 75% of the time it's a total hash.
In UA-cam's Web interface, you can frame-by-frame your way through paused video with the . and , keys (also marked > and < on a US 101 keyboard).
1:27 the gauntlet lost its weightiness from the original animation :(
Definitely. Everything gets so smoothed out that the intentional stutters in movement put their by the animators get erased.
@@gremlinchet well, its an AI. its not perfect
@@EmeraldLegate_ that's why you don't use it for animation.
@@EmeraldLegate_ Which is why we are critiquing it, so that people can realize this is not meant for animation.
@@idkhonestly7163 but it looks cool imo
The point of this isn't to like either version better, it's to show the algorithm.
Still cool as heck
Yeah it shows what ai could do to animation it could make it better
@@seantaggart7382 But something will be gone, like the charm that it gives you when its handrawn
@@rythemoire Wait, but those are still hand drawn...the computer just makes them basically smoother..
@@fredericksaxton9782 I thought an AI did it? So for me it's basically not handrawn anymore, (atleast I don't consider it)
Does this mean we could make Ah-Ha’s Take On Me music video 60fps?
Omg yes someone do it
+1 PLEASE SOMEONE~
Here, I did it ua-cam.com/video/dQw4w9WgXcQ/v-deo.html
@@tatteryt Should of used the indihome meme
@@tatteryt Bless your soul
The big problem I see with a few of these is that they make hand drawn stuff look like it was rotoscoped, which is really heckin weird
*heccin
*fucking
The problem is that the timing is lost because the AI is trying to fill it in with extra frames which result in weird looking animation
One of the reasons that I heard is that this AI is used for live videos, which is why the website has its examples for live photoge
Most of them look somewhat "trippy" to me with the AI, but the cat one at 2:00 is quite lovely and so is the girl sliding down the mountain.
oh yes the mountain sniper is where the AI did best imo
I noticed that when the front leg goes back the most the ai merges it with the ribs
The tippy feeling is common. That's because most people process movement close to 24 frames. That's why it's used. Some people are more sensitive to it then others. This video hurt my head a little...but I know a few people who see 24 as choppy. Its actually pretty cool, there's a test you can do to see how sensitive your brain is to movement. 60 frames is used for things that wanna seem more real or where time is crucial. Video games are in 60 frames.
I love the one of the cat going in circles in 60 fps
I don't think this AI did a convincing job at all, but give it like, 4 days, and it will be far better at it.
this should just be called “disney to cuphead converter”
what. they're both animated at 24fps, I don't get what your point is
T.K.A. Animations oh shit true lol
@@spaghettini268 didn't the cup head devs have to animate at 60?
@@voidofspaceandtime4684 no
They set the game to run at 60fps, but it was hand drawn at 24
0:32 Damn, it's so smooth that it just looks like a filter...
Ikr?
Ikr
Ikr!
Man why are you following me?
@@Panxownsowndksss Lmao Ikr?
it’s so smooth that it almost looks like a 3d model. personally prefer the hand-drawn but this could be quite useful for animators
It's just auto-tweening. It's been around for decades now, and it looks like crap. There is nothing new about this.
@@Keaze There’s more going on here than just tweening.
It looks so 3-D because it basically is. The program takes the info it can from the existing footage to essentially create an entire model of what's on screen and uses that to generate in-between frames, resulting in a hypersmooth and 3-Dimensional look.
@@Keaze It’s not the hammer but the carpenter. Even the shittiest tool can produce something great depending on the efforts and skills of the creator. The crap you’ve seen were most likely not well to suited for this tool
Someone doesn't know what tweens are... They are the frames that tie key frames together, they are already present in the originals, you could say it's adding more though. If you were to put an animation with only key frames through this program it would look awful. It can look bad, but quite a few of these look more than passable. Also what are you talking about when you say it's been around for years? Maybe a different process, but not AI extra tween generation.
1:37
The video: cool 60fps animation
Song: m a n k i n d w i l l b e
d e s t r o y e d
Lol
Mankind won’t be destroyed * mista u gotta listen better
@@schindy6385 sorry im deaf after giorno sucked me :(((
Don’t really like how they treated a sniper rifle like a grenade launcher.
@Chuerry i mean man and womankind xd
Original: Simple Animation
60 FPS: Looks like a 3D animation
301 likes, and not a single comments.
It looks odd
@@nitrixflex2622 whats the problem
I wouldn’t call it simple animation to be honest
the "chunkiness" in the originals is on purpose to add weight to the movement, it's like a timing thing. the 60 fps is very smooth, but not all movements are perfectly smooth, if that makes sense
0:28 Double animation is so smooth
Nice icon
@@nyaw1215 Nice icon too xD
@@nyaw1215 Derpixon lol
Bruh
men of culture.
idk how to properly articulate this but I've noticed Dain makes it look a bit "slithery" for lack of a better term.
perfect for hentai
I second the feeling, though I can't place it... I think it's the AI getting slightly confused what goes where around the finer details like the bubbly bits at 0:28
@@silverseth7 I think this clip demonstrates the possibilities and its limits. Seems to need a "proper" selection of keyframes to make sure, the AI does know, how to deal with it. With time artist will find a way to work with that in consideration and awesome results! Can't wait for it!
I think, I will give animation a try and begin to experiment a little bit. Time to get my old wacom into action agian. :)
it only works on animation with little to no weight , otherwise it looks wrong and takes the weight and energy out of the animation (which you call slithery ) walkcycles are a great example for this messup , the ai is not trained for 2d animation specifically but real video instead
the AI needs more drawn frames since the animators skip some spacing between frames to animate movement, so its just a little extra work for extra smoothness, rather making it look hella slithery
Interesting and useful technology? Yes.
Should it be used everywhere and eradicate 24 fps animation? Of course not.
Honestly someday it might be, the models need refining and perhaps studio specific training data to actually be practical.
As we get more and more sample the algorithme will get better and better. It might become a norm
But! It might be changing which frame animators choose to draw, if they don't need transition frame anymore they will need to do more key frame and at strategic point.
Hyped to see an anime entirely drawn to be smooth with this technologie
@@nicolasroure4589 This looks like it will probably be mainly used for in between frames if anything. It makes most of these look like video games or cheap CG, clearly inferior to their hand drawn counterparts, but you probably won’t notice that if it’s for less than a second long.
maybe eventually but it needs a lot more training and a better understanding of object permanence
cope cope cope
"How many blurry frames do you want AI?"
"yes"
the worst part about this is that when used properly, it can do amazing stuff. but this doesnt only downright shit it the face of the artist, but it also looks atrocious
The paint brush woman swimming looked totally different and 10x better. Felt like she was made of smoke
@Slava Gorbunov I think in this situation the smearing actually made it better. Felt very fluid and like a small bit of motion blur
1:19
It made it look like a video of a person edited to look like a drawn animation rather than a drawn animation that looked realistic
I think atheist original concept was to make every frame unique instead of making it look smeared, the outline should move smoother, but the insides should look rough instead of smoke
1:20
Everyone: *Sharing their thoughtful opinions on how the technology can be used and pointing out notable achievements of a new, possibly work-efficient animators' tool.*
Me, a comic artist and story-boarder who can't animate for shit and loves hand drawn animation:
*Hehe. Pretty lines go wheee...*
I feel you
We all feel you
Lol can relate
lmao *Pretty lines go brrr..*
Idk i like both. The originals have a certain charm to them, almost kind of rustic compared to the new. The news ones are obviously really great and smooth. It's amazing what AI can do.
The 60 fps looks 3D animation with a 2d filter on
Basically live2D
2.5D?
0:56 best of resh!
Resh was WAY ahead of his time!.
it's in 12 fps in the original so you were watching it in 24. You both dum. It wasn't 60 fps
1:19 the 60 fps looks real, a bit.
i agree
That was definitely one of the cooler and more effective ones.
If someone showed me just the 60fps version I'd think it was done over someone in a motion capture suit. Its too smooth.
Call me crazy, but it looks better without the 60fps.
Crazy
Crazy
I agree. With most of them at least.
Crazy
Crazy
dear commenters: the purpose of this is to showcase the AI, not produce a "better" animation.
The AI's not good if it can do something well, but if it can do something good.
@@nathanaelhahn4795 that sentence made no sense.
@@koooolk. Actually, it kind of does, he is saying that AI is only good if it actually helps individuals - not just something cool. I, personally, disagree completely. Every little milestone can and will add up to a greater cause.
@@nathanaelhahn4795 you obviously does not understand why these technologies are researched and what uses they can have, do you even know what an AI is?
So whats the end goal purpose then if this was just the learning/training phase for the AI?
*"I've seen enough, I'm satisfied"*
@HeyGemini I understand Sargeant, I shall change my opinion..
Call me old fashioned but I actually like the original more, the 60fp still looks good though
Edit: turns out I’m right if you pause throughout the video you’ll see how the art in 60fps is glitched and wrong.
Also watch this if you don’t agree with me ua-cam.com/video/_KRb_qV9P4g/v-deo.html
Same the 60fps looks too artificial the original feels more organic
The only one I thought the original looked better is 0:40
Yes, you are extremely old fashioned.
Same. It doesnt have as much weight
@@kevooo1250 yeah same
I wonder how some of the epic stick fights would look after having this done.
same
Because the in between frames crated by ai is making the motion more fluent.
If you are thinking of using it on already polished work it wouldn't make a diffrence. However, in a rough animation it will make a big diffrence.
Might harm the impacts of the fights since over fluid animation could just make a attack lack any impact
@@temkin9298 it would probably glitch on rough anims
0:32 on 60 fps makes it look like a filter
Yes, is awesome
oh wow, I see what you mean!!
just like 1:51
It's a filter lol
Check this, it's a software that interpolate every frame: ua-cam.com/video/sFN9dzw0qH8/v-deo.html
Some of them look like they're shifting into different dimensions..
The DAIN version makes it look like that subject doesn’t have any weight to it, which lowkey throws me off lmao
Exactly
you put it in words! you’re completely right
Yuo readed my maind
this^
0:33 makes it just look like a filter on a cat instead of a drawing!!
Yeah it looks so good!
Lavender_heart :3 it looks awful
Szlendak like you could do shit lol
@@coolrichkids I hope you are aware that you're talking about a program, right?
Twin Flame lmaoo trueee
Imagine converting a whole episode of an anime into 60 fps
Thank you for all the likes. I’ve never gotten this much and checking back on this comment really made my day, thanks!
will be best anime of the year
ferb i know what were gonna do today
It will feel like a real anime movie
Eeee
That was the first thing I imagined.
My God you guys, stop crapping on the AI interpolation videos. Anyone with a brain can do this, and that’s the point! AI interpolation like CAIN, DAIN, RIFE, FLAVR, etc, wasn’t used to replace artist’s work, it’s simply to prove a point that we are so deep in ai technology, that someone can do something like this with a free software. Obviously there are a lot of artifacts, but these videos weren’t perfected by humans, so stop slobbering all over Noodle’s knob.
0:24
the ai also adds smoothness to the numbers, it satisfies me too much-
IMO it looks better than the actual animation
I think the only things i dont like about the generated animation are the bottom tube/leg things glitching out
Edit: spelling and grammar for I have the dumb
@@flare_studios. actually, that animation came from a game called Skullgirls, it’s not generated
Wow the original has something human and special about it, the 60 FPS looks strange for lack of better terms.
For most of these, yeah. But that one with the girl with the metal arm was actually really good for an AI.
I understand your points. I think we have to get used to it at first.
99.9% of the comments: I like the original better!
0.01%: Seriously, is no one gonna talk about how good the animation is in general? Like god, people are so talented.
imagine if The Thief and The Cobbler had access to this technology... they wouldn't have wasted so much time and effort animating every single frame of animation on ones and avoid the end result of several decades worth of work being ultimately unfinished
It’s simple once you learn how it works. Even for the running one they only had about 9 fps which compared to pretty much any any animation is a walk in the park
Zeldagirl Yes, but the time and effort put into it is what’s really interesting. I can only dream of drawing like that someday!
i think the animation in the second one is amazing, i just personally have a soft soft for the way the first ones are animated
yes, most scenes where there is fast motion and action look very nice, it actually makes it look more life like with the animation. Personally though, there are some animations which don't feel right. The technology is very cool either way.
Honestly, I don’t really like the 60fps animations, they don’t feel as fluid and consistent as the original
Yeah that’s mostly a problem with the AI not being able to create extra information within the new frames, it just tries to puppeteer the pixels in a way that makes it closer to the next original frame. Actual hand drawn 60fps looks nicer, but is extremely time consuming and not exactly practical for larger scale animations.
This is especially relevant with the cat at 0:32
if you look, you can see the interpolated cat’s feet simply fade from existence, rather than move out of perspective towards the body (which is what our mind does to fill in the gaps in the original animation). this is because, since the ai doesn’t know or care what a cat is or how it moves, it just tries to match the pixels between one original frame and the next, and so it just fades the feet away. not to mention that shadow...
@@overthinkit_ Yeah, and whenever the frame interpolation does work well, it looks like a video game scene, not something in film
@@overthinkit_ this may also work better if the frame rate was interpolated to 48fps instead of 60
I think this really shows how sometimes we don’t need 60fps
This
I Personally think some Anime scenes like Naruto & Sasuke vs Momoshiki or One Punch Man Vs Genos look better in 60Fps. The Flashier the scene is, the better it looks. As long as they keeep the rest of the episode in 30fps though.
dude 60fps is way better what are you talking about😂
No.
Movies and Tv Series are in 24 fps so yeah. 60 fps looks kinda weird.
Maybe its just me, but the 60 fps kind of make things a little too "uncanny" for my taste. If that makes any sense.
I agree, it's cool that technology has gotten this far but idk how I feel about it
Interpolation makes the motions "flow" into eachother.
This will be fixed when AI is expanded to clean up visible interpolation frames and work with mixed frames on critical spot to trick our eyes (slow fast slow fast).
When this is achieved the 60FPS will be less strange and more appealing
I think it depends A LOT on the original
takes me back to my acid trips.
same!
This means in the future, people won't just make memes. They will make actual media content at home.
The 60 fps are similar to pop-up ads that say make sure your alone and it's so very addictive. Lol
at this point i’ll take anything to see a hand-drawn animated movie again
both are good tbh
Swordbird same. Hand drawn animations are just so much better. As much as I love the technological advancements and realism of scenery in movies like Frozen 2, they just don’t have the same charm or entertainment value as hand drawn movies
Well, good for you: wolfwalker is comming out soon
Io Som *iM SO EXCITED FOR THAT MOVIE YOU HAVE NO IDEA*
Watch anime
0:32 was the most satisfying in 60 FPS in my opinion
Squish that cat
To me it just looks a bit too slow, it is still cool either way.
@@fauxhuman0 in 1.5x that's seem better
Right? It looks like you just put a filter over a video of a cat
The one with the cat chasing it’s tail looked kind of weird in the 60 FPS. It looked slower and unnatural
You're absolutely right, it is slower. You can see towards the end that they're out of sync. Nonetheless I loved that animation, it looked like a camera photo filter.
ok
The deer skeleton just looked BAD.
@@jetpackdog3427The deer was pretty bad. It's the abrupt legs that do it in for me. If you want 60fps animation, you have to draw it so that the AI can handle it. Quality in, quality out!
@@jetpackdog3427 I think there was an anti-aliasing effect with the ribs because if two adjacent frames had more or less ribs on one side of the leg it would try to interpolate by *Squashing & Stretching* the ribs instead of by moving rigid bodies. that’s how characters with flesh move (especially in more exaggerated animation styles), not how bones do, and you can immediately tell it’s doing it wrong.
0:47 still love that animation
RESH IS LEGEND
Resh is a god
Yea..
Awesome Resh.
I know it’s not just me that feels the originals always have better timing and are snappier. Every footstep feels more certain and deliberate where the interpolated animation feels baggy and indeterminate. All the life kinda gets smoothed out and you’re left with syrupy, wobbly, plastic.
perfect for hentai
I did like it at 1:30 and 2:13 though! Seems a certain type of style looks better when smooth. I didn't mind he angel either, but both versions looked cool in that one
60fps is best used during slower movement, and not rapid like some of these
right? when it’s smoothed out it just looks like a imovie transition sped up lmao
@@soltrice not exactly, it would mess up weight and timing
Imagine if Take On Me was 60 FPS
Holy shit
somebody needs to do this to Take On Me
Oman
Wait- like the vine ?💀
@@MarMar-ut6vn No the music Video for the song "Take On Me"
Why does the 60 FPS version have like a jelly effect.
Edit : thanks for all the likes , never expected this
It is trying to make frames blend together but the rougher the animation the more obvious the blend effect is going to look. Thats why some things look like jelly.
yeah thats what a i thought too
looked like it's a little blurry
looks like twixtor lol
its likely due to minor inconsistencies in the drawings that arent noticable in a lower framerate due to them being mostly sketches
you absolute moronaicn poaeioc
0:40 The movement of a running woman's back and legs (from the 60fps version of this animation) is kinda wonky.
1:07 this makes me unconfortable
1:11 that cured my unconfortability
Lol
Uncomfortable*
1:07 is look likes a flash game quality
You are right. I also felt uneasy with the 1:07 one. The feeling was uneasy and the movement was unnatural
Can this AI interpolate the gaps between jobs during an interview
One thing that's interesting to me is how even though they're still moving the same amount per second, the amount of frames effects how fast or slow the animation feels. I mean this is something I've learned in my animation class, but even still this is an interesting example of that
This probably has something to do with the 12 principles of animation, though I'm not sure exactly how it ties in. Framerate definitely effects how weighty or weightless something feels. This AI is essentially taking in shots animated on twos and threes and spitting out shots animated on ones. Sometimes it works, sometimes it doesn't.
I hate that Noodle's fans keep invading these types of videos, posting comments like "wow, disrespectful to the creators who put effort into this." and stuff like that. These videos are pure goddamn experiments.
I know..right..
Original: yeah im kinda slow
60fps: drawing go bouncy bouncy
2:07 is perfect for the AI
2:01 My Friend Said She Drew That. Guess She’s A Tracer. :l
Oof, I've been there with one of my former friends. 😔 I'd honestly advice you not to even confront her, just distance her out of your life slowly, that kind of person is all sorts of trouble. She made my school life hell until she left.
@@bunnie187
dude she should be confronted
@@bunnie187 wtf are you being serious?
@@bunnie187 bruh it’s not that deep 💀 All you have to do is confront them and say it with your chest tf
Looks like the people in this thread don't know that tracing and saying you drew it is literally stealing and that 90% of the people who do it are actually awful friends and awful people in general, and that if you confront those people they get real hostile real fast.
1:12 looks perfect
Looks like a video game’s frame rate
Moral of the story: everything looks smoother at 60 FPS
Eeh... No
It looks smoother but 60 should be only for games not animation, you don't feel the weight on these, when the girl was running you didn't really feel the weight of her feet hitting the ground same goes for the girl with the big metal arm.
i'll passed on blurry in-between frames
Looks too rubbery
True it does make everything smooth butttttttt original will always be better its the memories of memories it is those childhood memories the origina is way better then that 60 it just can’t compare it’s like original is Like a thicccc bitch with four cs 60 it’s just a thicc bitch just only two i’m saying it’s not bad but preferably I’m a take the 4 cs if that do not make sense to you you’re uneducated swine love you muah 💋
Definitely a tool with powerful potential in the case of giving animators their "cream of the crop" interpolated inbetweens.
But just going straight into 60 with no oversight to timing ends up giving the majority a heavily "tweened" look (for obvious reasons, it is essentially tweening without vector data)
Would personally go 15 -> 30, clean up favorites then do 30 -> 60, but that's so many free frames without ever having to guide a vector path :O
I would go manualy to around 30 fps, then use it to make it up to 60 fps.
This is good tool, but needs quite some materials to work with...
But also, some types of animations( like some fightinng scenerios with lot of shaking) work bether with lower fps, which makes it looks sharper, so sometimes higher fps is not necesary bether.
1:03 the 60 fps is so strange
Lol ya
It looks like a 3d model oh my god
Not enough frames on the original, thats why. An AI can only be "so" good
I think it's because the 60 FPS one feels too "light", and like it doesn't have much weight... Which is different to actual deer
That's the only one I don't really like. It seems to creating a rubber band effect with the legs which throws me off.
There is a whole video from a creator called "noodle" explaining why this looks like sh**. I won't tell you every reason but I'm gonna tell y'all a thing... Watch the video again, and look for blurs/white spots in the 60fps. Especially at last one's fingers.
So I guess I’m literally the only one who likes the new version better? It’s just so smooth..
You’re not alone, I prefer it too.
We are considerably less but we do exist!
I agree
Yeah I prefer it too
Some of them look really good and some look awful.
0:32 I legit thaught the right one was a filter at first
IKR IT’S SO WELL DONE
thats the only one I really like, theres no glitches,
It looks freakishly natural.
I don’t like it, if you slow it down the cats feet disappear instead of move.
0:08 really shows how timeless well-drawn and consistent animation is. Forty-seven years old and the AI process throws into even sharper relief how dimensionally well-drawn the proportions are and how well the motion arcs were executed.
The traditional animators at Disney were masters at their craft. James Baxter and the dude who imagined thief and the cobbler are/were one of the best at fluid, consistent, and realistic animation. True art right there. they put their heart and soul into every single frame they did and made it look easy while doing it.
@@Kimmie6772 Miramax deserves very nasty things after what they did to The Thief and The Cobbler.
@@RETROMAN-UA-cam-Channel well to be fair to Miramax, the man wasn't very cooperative when it came to showing progress and reaching deadlines and had an obscene budget. But then again idk if these deadlines were considered unreasonable or not.
@@Kimmie6772 Yeah, that makes sense. It's still a huge shame most of those hand-drawn 3D camera movement shots went to waste. That stuff is the best animation I've ever seen!
The cat at 0:32 in 60 fps LOOKS SO REALISTIC. IT FEELS LIKE A REAL CAT
The legs got really blurry how is that realistic
*facepalm*
Oh yeah, i see it now
0:34
looks like a filter
I does
The only thing this video taught me is that 60 FPS only looks good in video games.
people who think a higher frame rate makes things better clearly haven't tried animating before 😂
My thoughts exactly
Idk, some of these looked better with 60FPS, it just depends
And even then its touch and go. Sometimes things can be too fast/smooth
it kinda doesn't look good with handmade animation
imo it only gonna work well with mocap animation or movies
it did looked good though with that "Crimson Alpine
" clip
but ye, shame on you for not posting source of animations
Crimson alpine looked completely unchanged by the AI
the AI just adds frames and makes it more fluid
on some animations it is hard to spot without knowing but most of the time it really does change it
IMPO: It hurts a lot of the animations, instead of helping them.
the AI can't fix a jenky base animation. if the result looks bad, it just shows that the base wasn't that good to begin with. (not to say those are bad animations, just not fit for this use tho) I think it works good enough for many of them.
and yes, not listing the source is kinda sad :/
1:20 that 60 fps version looks incredibly cool
Not really, imo the smoky intent of the artist completely vanished and turned into a smudged mess
I feel I'm the only person that thinks 60 fps feels artificial. A little *too* smooth
absolutely, it feels like cheating
So more realistic and fluid = artificial? The 60 FPS animations presented here may have a lot of artifacts that might not make them look as good as the 15-30 FPS originals, but that isn't a fault of 60 FPS itself, but the AI trying to interpolate images between frames.
@@xxfalconarasxx5659 it goes past what is "realistic". "More realistic" is only good untill it goes further than what looks natural
@@koda5915 what the fuck is "cheating" in animation?
Feels soulless for now
1:27 looks like a 3D render, lel
Yeah
most of them do
My old phone: Original
My new one: 60 fps
Get your old phone back then
Ahrixx 60fps is way better lol
@@zyuukii I was joking about how some of the animations in 60 fps looked worse :p