I made 60fps Flipbooks using A.I.
Вставка
- Опубліковано 21 кві 2022
- 📦 Get my Flipbook Kit and merch at andymation.com
📱 Share YOUR flipbooks in the Andymation App! It's FREE
iOS: andymat.io/n_app_iOS
Android: andymat.io/n_app_Android
My Gear:
Mechanical Pencils I Use: amzn.to/36PjdwK
Copic Pens: amzn.to/2Hd4fYG
Basic Copic Marker Set: amzn.to/390JYRP
Social:
Instagram: / andymation
Facebook: / theandymation
TikTok: / officialandymation
2nd Channel: / @andymation2
About Me:
Welcome to my channel! In addition to making flipbooks, I am a stop-motion animator and worked on the Oscar-nominated movies ParaNorman, The Boxtrolls, Kubo and the Two Strings, and Missing Link. I fell in love with animation as a kid and have been doing it ever since.
#flipbook #andymation
Disclaimer: The above product links are affiliate links, and I may receive a small commission, which will help support this channel. This in no way affects your price. Thank you! - Фільми й анімація
![Smoother animation ≠ Better animation [AI ENHANCED]](http://i.ytimg.com/vi/_KRb_qV9P4g/mqdefault.jpg)
The AI interpolation was definitely never made for animation, at least not yet. The purpose of AI interpolation was for real life movements from humans, animals and so on. For that purpose, it amazingly works well. Let's hope that in the future AI can properly smooth out the animations without making it look weird.
Agreed. With a simple animation it's much more noticeable.
i kinda dont't want that, it will make animators get paid even less, also less jobs for artists
@@karlldraws I don't think the worry is about replacing artists. Like... they won't get paid less because they'd have another tool to assist them in the process. Which is what this AI interpolation is, a tool. AI could never have the creativity, human imagination, or artistic intent to make a hand made animation look any better. Interpolation like this is just using the wrong tool for the wrong thing, which is what I think Adamillo is referring to. And just hoping for something that can make a billion hour process go by a little faster. However, in-between animator is a job title, so I see where you're coming from too. But I still don't think AI can get to a point where it's better than the artists themselves because AI can't create the way a human can. So I wouldn't worry about anyone losing their jobs.
@@CatychoVT There are already neural networks that can generate an image from a text prompt. You tell it to draw a cat with a napoleon costume holding cheese and smiling, and it does that with incredible accuracy, to the point where it looks completely natural. The thing is that a program wouldn't need to be on the creative end of the process to make an animation. You tell it what the story is, give it a few references, and voila, the job is done. So Karll has a good point. Animators and artists will sadly become less relevant. Good scriptwriters are still in great demand though.
@@CatychoVT but also inbetween animators won't really have a job
The only thing I've ever liked about the 60fps is dust or watery effects since it makes those particular random effects more realistic seeming without looking to weird or overly wobbley. I bet this tech could be used for some really cool effects to add onto an animation that's 12 or 24 fps with more duplicate frames to keep the snappiness.
It makes all animation look like strange watery flesh tendrils, and sometimes you want strange watery flesh tendrils
Yeah I definitely thought the water actually looked really cool in the ai version. It almost looked more like a 3d render or something
I really liked the 60fps green water one, it was just really wobbly and watery...
same. the interpolation gives nice smoothness
similar to the use of cgi in traditional animation, for example in The Prince Of Egypt
The first thing we learned at the Hollywood animator's union is that with inbetweens, it's not line to line, it's drawing to drawing, meaning every frame has to be a solid drawing. Inbetweening is actually hard. It's the guts of an animated scene. Walt Disney himself admitted he wouldn't be able to hold a job as an inbetweener in his own studio.
drawing the keyframes: yippee!! this is so fun :)
inbetweening: god is dead and the music in my ears is turning pale
Praise the development of AI. Imagine drawing each frame over and over again with slightly difference and for each second, instead of drawing 12, you multiply it by 5.
There's a reason why Endless Eight in Melancholy of Haruhi suzumiya didn't succeed. that's because it's boring. Now, artists wants to do that irl? Yeah, AI art is bad.... if you're originally bad at art.
I agree, the balloon is the best, because balloons are floaty and squishy by nature. You were spot on when you said it messes up the timing of the movement, too, it makes some things start WAY earlier and makes everything very wobbly looking
Also the very simple shape of the balloon helped keep things consistent.
The green goopy monster was pretty good too I think, it just overall matched the characteristics of the green goop so like the fluid motion of the AI made it seem natural.
Personally I didn't like it, it felt TOO fluid to me. It felt off with how fast it was.
Thats funny, thats the second one I dislike the most, it really messed up the timing of the falling goo
@@lesigh3410 the fluid like motion could be interpreted as slime or “goop”
@@SoulTaken i know that's the case i'm saying it was too fluid for me, it felt unnatural
Repent to Jesus Christ
“The heavens declare the glory of God; the skies proclaim the work of his hands.”
Psalms 19:1 NIV
h
Definitely looks a lot weirder when slowed down, but it's pretty impressive how much it blends in with full speed.
I think it depends on a per-animation basis as to whether it looks better or not. Shouldn't be used for everything, but I absolutely get the appeal, especially for live action
Repent to Jesus Christ
“The heavens declare the glory of God; the skies proclaim the work of his hands.”
Psalms 19:1 NIV
h
@@repentoryouwilllikewiseper8741 h
Read my name
Goes to show how little our eyes truly pick up 🤣
@@repentoryouwilllikewiseper8741 L + ratio + fatherless + you fell off
The problem with animations being interpolated is how often it ruins very intentional timing and movement. There's often a "buildup and release" that ai smooths out too much and motions feel less weighty. Noodle has a great video going into more detail. This was an interesting experiment Andy! I agree with you, the original is so much more alive and snappy
Because these people don't know how to use interpolation!
AI isn't something you just slap it on and be surprised when it's not perfect
@@TragicGFuelSo true
That's definitely the Achilles heel of motion interpolation. It'll be interesting to see if the technology overcomes this issue as it becomes better at detecting that sort of dynamic timing, now with generative AI becoming much more aware of broader context than it was just a few years ago. Instead of just creating a hybrid of arbitrary static frames, it'll really have to rationalize what certain objects are and how they should move/accelerate/decelerate in order to look natural, much like inbetweeners have done in the past.
I disagree. There was no buildup because the the frames for the in betweens has no buildup. The in betweens are just that, in betweens. It's still up to the artist how much in between two frames will have.
I am a bit of stereoscopic 3D (cross eye) fan, and I noticed that when optically overlapping the side by side images, the AI generated side would provide alternate versions of the original flip book, rendering a 3D version of your animation! Very cool.😊
Omg yes!!!! I see that!! So cool
7:11 It's also interesting the "logic" behind the added frames. For instance, it makes somewhat sense for the umbrella to make some motion in preparation for its opening.
Maybe it looks at the frames both before and after and tries to figure out what the difference is? I could be wrong though
Ok
@@xmysef4920 that's correct. But I was referring to the fact that those gaps are filled with "complex" movements, they're not just in-between motion frames. For instance, instead of gradually present the opening of the umbrella, the AI concluded that it made more sense to have an extra animation which didn't not originally exist.
The original did the same just less agressive with the opening
@@uishaggy8552 I just rewatched it. You're right. I slowed it down and noticed that the right one is 1 frame ahead, maybe that was what confused me.
I think the AI interpolation method works great for when you want an unsettling horror/uncanny valley vibe.
In such a case, the jello-ness is a feature, not a bug
My thoughts tbh. I've seen a few animations with the same effect and it was done on purpose so I wouldn't completely write off this technology. It can be pretty useful for some particular projects.
It looks like cool and smooth wiggly woggly animation style to me.
The works which have been appearing with AI-based digital rotoscoping lately (Joel Haver probably one of the most known in UA-cam) use this brilliantly. The "glitches" add more to the final result.
Repent and follow Jesus my friend! Repenting doesn't mean confessing your sins to others, but to stop doing them altogether. Belief in Messiah alone is not enough to get you into heaven - Matthew 7:21-23, John 3:3, John 3:36 (ESV is the best translation for John 3:36). Contemplate how the Roman empire fulfilled the role of the beast from the sea in Revelation 13. Revelation 17 confirms that it is in fact Rome. From this we can conclude that A) Jesus is the Son of God and can predict the future or make it happen, B) The world leaders/nations/governments etc have been conspiring together for the last 3000+ years to accomplish the religion of the Israelites C) History as we know it is fake. You don't really need to speculate though because you can start a relationship with God and have proof. Call on the name of Jesus and pray for Him to intervene in your life. - Revelation 3:20
Revelation 6 1st Seal: White horse = Roman Empire conquering nations under Trajan 98-117 AD & Gospel spreading rapidly. 2nd Seal: Red horse, bloody civil wars with 32 different Emperors, most killed by the sword. 185-284 AD 3rd Seal: Black horse, economic despair from high taxes to pay for wars, farmers stopped growing. 200-250 AD 4th Seal: Pale horse, 1/4th of Romans died from famine, pestilence; at one point 5,000 dying per day. 250-300 AD 5th Seal: Diocletian persecuted Smyrna church era saints for ten years, blood crying out for vengeance. 303-312 AD 6th Seal: Political upheaval in the declining Roman Empire while the leaders battled each other. 313-395 AD
Revelation 7 Sealing of 144,000, the saints, before trumpet war judgments, which led to the fall of the Roman Empire.
Revelation 8 1st Trumpet: Alaric and the Goths attacked from the north, the path of hail, and set it on fire. 400-410 AD 2nd Trumpet: Genseric and the Vandals attacked the seas and coastlands, the blood of sailors in water. 425-470 AD 3rd Trumpet: Attila and the Huns scourged the Danube, Rhine & Po rivers area, dead bodies made water bitter. 451 AD 4th Trumpet: Odoacer and the Heruli caused the last Western Emperor (sun), Senate (moon) to lose power. 476 AD With the Western Roman Emperor (restrainer of 2 Thes. 2) removed; the son of perdition Popes took power.
Revelation 9 Two woe judgments against the central 1/3rd and eastern 1/3rd of the Roman Empire. 612-1453 AD 5th Trumpet: Locust & scorpions point to Arabia, the rise of the Muslim army. Islam hides Gospel from Arabs. 612-762 AD 6th Trumpet: Turks released to attack Constantinople with large cannons (fire, smoke, brimstone). 1062-1453 AD
Revelation 10 The little book is the printed Bible, which was needed after the Dark Ages when Scriptures were banned by Popes.
Revelation 11 7th Trumpet: Martin Luther measured Roman Church; found that it’s an apostate church, not part of true temple. The two witnesses are the Scriptures and saints who proclaim the pure Gospel and testify against the antichrist Popes. Papal Church pronounced Christendom dead in 1514 AD. Silence for 3.5 years. Then Luther posted his 95 Thesis, which sparked the Protestant Reformation and brought the witnesses back to life. Millions of Catholics were saved.
Revelation 12 Satan used the Roman Empire to try to wipe out the early Church, Satan was cast down as the Empire collapsed.
Revelation 13 The antichrist beast Popes reigned in power 1,260 years, 538-1798, is the little horn of Daniel 7, son of perdition. The false prophet Jesuit Superior General rose to power from land (earth) of Vatican and has created many deceptions.
Revelation 14 Points to great harvest during the Protestant Reformation & wrath on Catholic countries who obey antichrist Pope.
Revelation 15 Overcoming saints victorious over the beast. Prelude to 7 vials and judgment on those who support Papal Rome.
Revelation 16 1st Vial: The foul sore of atheism was poured out on Catholic France, leaving them with no hope, led to revolution. 2nd Vial: The French Revolution started in 1793, killed 250,000, as France had obeyed the Pope and killed saints. 3rd Vial: The French Revolution spread to rural areas of France, where Protestants had been killed in river areas. 4th Vial: The bloody Napoleonic wars shed the blood of countries who had revered and obeyed the antichrist Pope. 5th Vial: Judgment on the seat of the beast. Papal States invaded in 1798, Pope imprisoned, removed from power. 6th Vial: The Turks vast domain dried up, they were only left with Turkey. They lost control of Palestine in 1917 AD, Israel became a nation again in 1948
i think while the 60 fps version is interesting to look at, i find the originals to have far more emotion to them
bruh 🤓
@@VARUN-bv6vu what
@@VARUN-bv6vuwhat
What@@VARUN-bv6vu
@@VARUN-bv6vuwhat
That rick Roll was personal 1:45
Considering this was only designed to ever be used on real footage, this turned out surprisingly nice for a flipbook animation.
Ok
Fancy meeting you here B)
@@ChordsBoy bruh this happens way too much. I keep randomly meeting people i know in youtube comments.
@@VoxelMusic Huh, that's weird lol
Wdym by real footage
I liked watching them like a stereoscopic image, "cross eyed" style. The merge of the two at the same time was trippy.
Thanks for mentioning it, it was amazing seeing it this way =O
@@MarceloKuchiki kinda exaggerated the best and worst of the 60fps
Wooow right just tried it out. Didn't think it would merge
thanks for mentioning it! i think it works by creating the illusion of an image in the middle
@@dane1382 it works because the left eye focuses on the left image and the right eye on the right image. The double vision gets mixed in the middle. I do this at the sound board at church all the time, I like seeing all the potentiometers blend together. It's also how those magic eye pictures in the papers or the big posters worked.
The 60ps was really smooth I didn’t felt like real life honestly but the original was still good and your drawings are good so keep up
I really like the 60fps upscale when you can see the book/hand, it makes the animation seem almost alive because it's smooth and doesn't line up with the page turning, like an uncanny valley thing but not creepy, just cool.
Noodle has an *awesome* video about this that explains specifically why some animation isn't meant to be interpolated, and why we still generally prefer the original in cases like this.
literally my first thought
Pin this comment please.
Yeah, he sums it up pretty well when he says that A.I cannot possibly understand the intentions of the animator, the animation in 60 fps looks smooth, but also janky and blurrier. In fact, These tools weren't actually made to interpolate animation in the first place, it was made to interpolate real life footage.
I'd love for this interpolation to be done correctly in the future, in cooperation with the artist's intent, the crisp animation is worth the wait.
Yeah
@@arpita1shrivas Sometimes it can be done with but most people just think if you put some anime in 60fps its going to look better which doesn't make sense because most of the time the anime isn't ment to look super smooth
I feel parts are improved and others aren't. I think that the fps increasing ai should only be used on things 30fps or higher. Great video, Andy.
Ai is for another purpose
You can see Low Quality Videos in 60 fps!
Well the point of motion smoothing isn't for animation in the first place, it's meant for real life
the original purpose is for live action video footage.
WOWW YOU DON'T READ MY PROFILE PICTURE 😶😶❌❌
I havent made a flip book in decades...almost forgot about them. I used to love drawing flip books in grade school...gonna grab a few little sketchbooks and relive that thanks to this random youtube recommend.
When I animate I do sometimes add smoothing, but not to the entire thing. Parts with more subtle/ small motion, usually, because it’s incredibly difficult to draw every frame for smth that’s supposed to ease slowly + smoothly to a stop, for example. For sharp movements or quicker parts I don’t usually smooth at all. Or if I do, I’ll then only take a few of the extra frames and cut out the rest. The result is the best of both worlds imo- using it to support my initial intentions instead of take away from them.
I think that's how anime does things. If I recall, there are generally 2 types of 2d animation.
Early Disney-like, where the framerate is smooth and consistent, or like anime where shortcuts and made and some parts gets more budget which is "Sakuga" as they call it.
Studio Ghibli movies stood out because it's animated LIKE disney and stuff.
huh, i didn’t know that! I did have an idea abt the shortcuts in anime (esp w how hard it gets memed at times) but the studio Ghibli thing is news. The different-budget thing too, but I guess that makes sense lol… neat! :D
While the 60fps is super hypnotic, the 12fps still has a certain snappiness and crispness that's very satisfying.
What do you mean with hypnotic?
@@Tobias-et1xt the steadiness is really satisfying to watch
60 fps makes it look robotic
60fps never looks good in animation to me personally
About as hypnotic as a trainwreck... "I just can't look away!"
I think in general it definitely made things feel a little too smooth, like there was no real weight to a lot of it. The hits bounced more in the AI one which made everything seem kind of rubbery. I will admit though, the smoke at the end of the kamehameha from the girl felt very smooth in the AI one.
Not really tho, it had this weird “jumpy” feel to it, it sorta looks like the smoke keeps moving and stopping at weird intervals
The only way for the AI to correctly interpolate the frames is for you to train the AI on animations with initially 60 frames per second. Then you remove the extra frames and see if the AI can interpolate the missing frames. If it does well, then apply the trained AI to other similar animations with similar missing frames.
I liked the smoothness with the goop, but the splooshes moved sometimes
around 6:44 really shows the problems. if you pause and compare the images it is so off from the original it's like someone remade it
What I've learned is that frame interpolation works best on real footage. On animations it tends to be really hit or miss. Sometimes the stars align and it just works, but most of the time the animations just don't hold up at higher frame rates, especially when starting from such a low frame rate.
idk, I liked both 12fps and 60fps. they both showed qualities that presented their own characters.
i like how the ai tried to create tweens for the textures. it adds a new flow of movement to the peice, making things feel more organic.
i find that it could be a useful but controlled tool in the animation industry. im not saying it will replace animators, im saying that features like this could be directly added to softwares like toon boom or even tvPaint to give animators the option to work on difficult animation projects as big as 60 fps.
I assume the ai simply identifies the difference between frames presented. Then it creates an "in between frame" that displays an assumed position of the animated object. obviously its not perfect rn but its similar to how humans animate.
Actually this is not much different to creating tween movents in TvPaint. you define the start position and frame of an object... then you define the end position and frame of the same object. then you hit create tween and like that, it has created in bewteen frames that mark the position of an object during a movement.
you could have got a nicer animation if you increased the ai generated fps in intervals instead of generating str8 to 60. (eg. 12 -24, -24-36, 36-48, 48-60). going straight to 60fps probably made the ai reference frames it hasnt created yet, as it has to invent 4 frames between given frames, leaving you with out of place frames.
Expanding the frame rate gradually however, lets the ai generate 1 in between frame based off clearer frames. this allows the ai to refence the difference between existing material, instead of it referencing material it has yet to create.
the 12 fps mainly has that crisp feeling because its easier for us to identify the difference between each frame due to the frames being presented for longer. also theirs no in between motions for the textures and blemishes, therefore creating a rugged visual.
as an animation student, i am yet hopefull but terrified for the future of ai animation.
3:55 Woah, it looks almost 3D, like the drawing is in front of the paper rather than on it. That's actually incredibly cool in its own way.
Ikr
I think these AI post production looks weird but cool. It's something that most educated animators would avoid, and that what makes it a unique style. I am pretty sure there will be a music artist really want to use this AI to make oddly satisfying yet highly unique visual output on their music videos.
@@cupofjoen hahahaha I was just thinking about that 🙃 cheerz mate 🍻😁
wouldn’t that only be possible if the drawing is completely proportional- and drawn from your own pov (ok, idk if something close to your eyes can be considered proportional even if it’s real)
Yo lo veo igual al original
Si ves los dos, te das cuenta que es lo mismo XD
Solo con una ligera diferencia, que es: las cosas tienen un pequeño tambaleo, (jiggle)
5:11 the interpolation kinda felt like a strangely vivid lucid dream. Which does kind of get me thinking... I don't think the interpolation is better than the original, but I think maybe using the strangeness and weirdness of the interpolation to someone's advantage could make some potentially interesting things. I low-key want interpolation to evolve into it's own style, not one that is used as a replacement, but a style that is not trying to be better.
I don't think it's better, nor a replacement. It doesn't really take into account the original intention from the animator but I think studying it further collectively could be interesting. Does it mean we'll eventually accept it? Probably not, but it feels almost like a waste to not investigate you know? Maybe as more of a social experiment more than anything
I am also mesmerized by it. Its like a weird effect. like mushrooms.... or so i hear
"or so i hear" spoke like someone who has taken shrooms. But yeah, it really does give that somehow highquality yet wobbly feeling to everything
I did like the effect on the last animation. It loses some of the original animation frames (the artists intention), but certainly if planned out could be used for tweening/between frames and save a LOT of time for those, for the artist to concentrate on keyframes.
Agree 100%. It's like a different technique. I liked the crazy wobbly effects
Like Joel Haver, who uses glitchy effects from AI as part of the aesthetic of his animations.
I think the dripping slime was the best after motion smoothing. You can tell that a bunch of the fake frames have a misshapen quality to them, which actually kinda lends itself to the amorphous properties a more fluid slime would have. Even when said slime took the shape of the face toward the end, it seemed more natural for the smoothing to be there when it came to animating something that doesn't really settle on a fixed shape.
I appreciate both forms equally. I love the snap and feel of the originals but I also really like the wobbly nature of the AI interpolation. It adds a new feeling which, at least to me, is visually appealing.
@@dont5014 ok
True, at least in my opinion
I would love to see you go and delete all the original frames in the A.I. version and export it as a 48fps video and the watch it side by side to the original. It would then be a 100% original vs 100% fake.
this is a really cool idea!
Wow, I NEED THIS
I think that would take a whole lot of time if he were to individually check every frame. A 10 second animation would mean 600 frames in total. That is unless he finds a way to do this automatically.
@@TheReal4th Import both videos as a collection of frames, compare them, delete matching matrixes from "fake" one and export - is the solution I see
@@jurbinwerdin730 i think u could just delete every n-th frame ... simple as that
Therapist: Front-facing flipbook guy isn't real, he can't hurt you
Front-facing flipbook guy: 4:05
I'd love to see a revisited version of this, there has been a TON of advancements in this field, especially using Motion vectors which should make it better for animation
I liked the 60fps fireball as idk the strange movements really add to the randomness of the fire in my eyes, but some really weren't good, stuff like the green dripping goop made the splashes merge within one another in a strange way and the white spots on the rainbow-laser moved in strange jumps
Yeah, the fireball looks amazing
I love when people say "60fps bad nooo1!1!1!!" Just because someone popular said, like come on, we haven't used it properly yet
@@awesomesause. It's not so much that 60FPS is bad, it's more about the artifacts that the AI creates, which muddles up the original intent of the animator's. You even see in this video that some things are really strange in the AI's interpolation, like the distorted background in the graveyard, or the green slime just not having much "oomph" to it.
The AI was never designed with animation in mind; it was trained for live-action and that's something it does very well. One day, I'm sure there will be an AI tool that's capable of properly interpolating animation in a way that truly follows the principles of animation and matches the artist's vision, but that day sadly isn't here yet.
@@awesomesause. The artistic intent of animator's matters and it's a total disrespect to animators by claiming '60 fps' as better which totally ignores most of the Animation's fundamentals.
AI at its current state would be ever replicate and expand on the intentions of animators; its not algorithm that can fill in the expressiveness of those original frames based on few parameters and condition. The AI only see and act according to the data of the frame not according to what the collective data represent.
@@obscure8125 you said the same thing and stretched it into a paragraph.
Andy , you were my inspiration to create my UA-cam channel on flipbooks. I liked animations ever since I was a kid, but didn't know to make them. You were the one who taught me to make these flipbooks. Thanks a bunch.
Thanks!! That’s so cool to hear
@Check my about page link your mother
I'm 2nd
3rd hahaha
4th I wonder if the 5th will continue this chain
Now I didn't know it was possible for a man to be such a creative artist
I actually liked it a lot, from an unbiased perspective, the smoothing was less jarring and was really fun to watch still. I could see if this technology improves it could be really useful for artists. Very cool experiment Andymation!
I wonder how well it would do if the cells weren't colored in. Especially in the graveyard scene the "smoothing out" of random differences in marker color was very distracting. I also wonder if a similar tool that PRINTED OUT interpolated cells for hand coloring would be useful.
Finally, what about just doubling the frame speed with AI?
P.S. I used to do this as a kid. You're making me want to pick this up as a hobby.
Dude, if you think you got the time and could have some fun, just go for it.
@@dont5014 ok I won't now shut up
1:49 the best rickroll ever😂😂
Edit: tysm for the 50 likes
Result is Rickroll!!
“A herd of turtles stampeding through peanut butter” is a phrase I’m going to have to use more often
This makes me want to create a flip book. I’ve spent too much time on my screen throughout my life thanks for inspiring me
In its current state this technology definitely isn't much desirable for me, too, but to think that sometimes it actually manages to create something looking like it probably was always there if you don't know the original... In our lifetime this thing will become a huge part of the animation and VFX industry.
It already is
@@lapatatadelplato6520 only real issue is old footage has a wildly variable frame rate because it relies on someone physically cranking a film camera which is why in a lot of old war footage sometimes it is really fast because “holy crap something just blew up” and startled the cameraman causing a faster crank. They’ve done some reworking of old film in a documentary I can’t remember the name of but they also colorised the images along with giving it a coherent frame rate. However, those were all done by people and not machine learning
The problem with interpolation is everyone takes an all or nothing approach. They either say it’s bad and should never be used or is great and should always be used. But it should be used in conjunction with hard work. Use it to smooth out and add extra frames where it can and clean up the awkward looking frames by hand.
(it’s already use as a tool to help animator. and should not be think as more than that, a tool that helps animator)
This is true with all AI. People act like GPT3 is a replacement for a writer, but it’s just another tool a writer can use in a workflow when it’s useful.
sounds like using grammarly lol. these things are _tools_ at the end of the day, not total replacements.
There are things made for that
But yeah
I feel like that's just how most opinion online is like, they either absolutely love it, or absolutely hate it. No middle ground at all.
I loved the girl blasting the cloud away with her rainbow laser, really cute animation :)
I love the original for all but the balloon and PARTS of the thumb biter. I just love Andymation, and your art cannot be faked.
As someone who 2d animated professionally, I can say it's obvious that making everything an even in-out will make animation look bad. That is not the ai's fault, and it's so disingenuous to say "interpolation bad" when that's not the point of the ai. This ai does wonders for things like lego stop motion if you edit away uneeded frames btw. Kinda tired of people bashing the tech when it's obvious there needs to be additional work to the program that lets the artist tell the ai what is a smooth in vs smooth out. It will get there in time.
This whole trend of bashing on interpolation ai, It's like saying the first "robot voices" could never replace human voices because it's monotone. Now look at the voice ai that not only has vocal tone shifts and inflections, but there is even ai that can replicate your voice with convincing results, with enough data to reference from.
Give it time, and soon animators will have the freedom of drawing keyframes and extremes, and then having ai do the tedious work of smooth ins, smooth outs, and even in-outs. It opens doors for so many smaller artists and I am super excited to see what doors this ai opens to unique projects and voices in the animation world.
Yep, I definitely felt like Andy was using this for the wrong purpose and was kinda bashing it for not doing great while its soul purpose was to refine real-life shots.
Right now interpolation can be really great if you use it right. I think using interpolation for flip books isn't the right thing for it, but there's definitely other things that it's good for. Just because something isn't good for one thing doesn't mean it's hot garbage dog water and you should immediately bash on it.
Andy only hearts the comments that fully agree with his opinion on interpolation
@@Stickamajig I think you misunderstood my statement. The ai I am hoping for in the future would "fill in the gaps" between images drawn by a person. Keyframes and extremes would be the human drawn part. Key frames and extremes include those fun smear frames you mentioned, as well as unique poses besides the "basics" you might imagine.
(Also by true definition storyboards have no animation, they are thumbnails, aka loose doodles that represent a scene. The name originates from stickynotes stuck to a board, a story board, that could easily be changed and rearranged. Unfortunately in today's industry, storyboarders are expected to create animatics, with clean keyframes, rough animation, pans, voice work, etc. ...Storyboards should not be used as a base for what I am talking about.)
Basically the interpolation ai I want where you can determine smooth ins and outs, would be no different from current "tween animation" in 2d puppet type animation, where you can morph shapes and colors. It has it's uses, like in backgrounds, nuanced motion, or texturing.
I love frame by frame 2d animation the most, personally. And as stated I have 2d frame by frame animated professionally before, but trust me there is no "pride" in the stupid amount of time it takes to rough out an animation or clean up an animation. Replaying 2 second animation scribbles 500 times to check for errors or tweaks, cleaning up lineart so it doesn't look wobbly, etc, is the bane of my existence lol. Knowing I drew, redrew, and redrew again every frame makes me disheartened sometimes. Knowing I spent a lot of effort on art that shows up for .25 seconds is deflating. If instead I could focus on the good smears, extremes, keyframes that I drew, that would be much more personally rewarding.
People forget that puppetry IS animation. 2d animation aims to imitate puppetry. It's just that 2d frame by frame tends to capture the nuisances of implied space/emotion in poses and facial expression/abstracted perspective that 2d puppet tween animation or even sometimes 3d animation can miss out on. That's why interpolation ai is so exciting! Finally I can roughly "tween" with authentic 2d animated forms, or apply smooth lineart to a "tween", or atleast, that is the hope for the future.
And no hate to 3d or 2d tween puppet animation. In the right hands, the tools can be used to create amazing things! Just look at Spiderverse, Rapunzel's Tangled Adventure, or the fight scenes in Rise of the TMNT. 2d animation + tween + 3d asset creates wonderful pieces of animation.
@@ttt.6457 Exactly! Try to fly a submarine and of course it will fail, it was made for water, not for air. Same goes for all-evens interpolation made for live action being used on a flip book.
I think what you've described already exists. I don't remember the name, but it has the AI imbedded in the animation software. The thing used here is made for real life videos, which might be why it works well for lego stop motion.
The one thing I would say interpolation is good for is fluid and gas animations. The green slime definitely looks better in 60fps
strangely enough I thought that looked the worst
@@ichigo_nyanko yeah it didn't look like liquid at all
@@beezzinha it looked more like liquid than 12 fps
you really don’t get this do you?
@@SkitLegoIdeaTheory what am I not getting?
Somehow in the middle I was reminded of the old rayman 2d animations when I watched the 60fps versions. Especially the slime one. Anyways great work and I do believe that each has their own charm.
It's makes the animation smoother. Smart
I honestly like the motion smoothing with the green liquid scene. The jiggly effect gives an interesting effect to the liquid.
same, it's the only one where i really noticed it, and it looked cool
@@titaniumtoad2448 the most early reply i ever encountered
@@alpha26butshrek54 yoo 58 seconds ago
@@pavletrnic1433 2 minutes ago!
@@Unpug 4 hours ago!
Just my two cents: I personally enjoy watching them both equally. The graveyard flipbook did turn out a little weird due to all of the movement in the background (It thought that the background was supposed to move), but the others turned out really nice in my opinion! While I do believe the original intention may be muddied, or even flat out lost with the smoothing, the original art is still there and in tact. It still has that hand-drawn flair and personality to it, and that's what I like most about flipbook animations. And one final note regarding the weirdness when slowing down frame by frame: the average viewer is not going to slow it down frame by frame, but rather enjoy it for how they're watching it; even if that means not interpolating it out to 60 FPS. But this is all down to personal opinion, and to the artist's discretion, but I don't believe this modification makes it any less of a work of art.
Animations already have some weird frames to make movement seem more natural
It's called smear, you could search it on UA-cam, there is a cool video explaining how it works and what is it's usefulness
@@David-bz3wh Yup but the AI does not count those frames as different from the others, so it just kinda adds stuff without knowing the proper reason to add them
@@godofgae8137 yeah. That's on the artist. The AI algorithm won't know that.
Yeap, for this style of "unstable" animation, the AI interpolation doesn't look horrible alot of the time unlike "regular" animation
My two cents: interpolation can eat a big ol' fat chode. People see it and think that's what high frame rate looks like naturally.
Recording natively in 60fps for live action yields a much different product.
I would, however, love to see NATIVE 60fps animations. If someone has taken the time to carefully and patiently craft even a short example, I have yet to find it. Very esoteric concept it seems.
Honestly my favorite had to be the balloon,green moster and the return of grumpy cloud 2.
The cloud2 one honestly reminds me of older anime’s I guess that’s why.
1:57 this scene was intense- I remember you but I couldn't find your channel for so long- I love this
I found the first flipbook to be unnaturally smooth through the ai and it bothered me pretty bad. The last and biggest flipbook felt choppier than the original. In both cases the original is much, much better.
Really depends on the animation and the person doing running it through AI. I have seen my fair share of horribly made AI videos where they just run it through the program, how ever, I have to admit, with proper care, I've seen it produce amazing effects.
When somebody says something is choppier than flip books, that means something.
@@burger84. Yeah because the ai wasn't designed with flipbooks in mind.
One of the reasons why it doesn't work is andymation. I'm not saying he's bad, but his inconsistency in the colouring makes things really hard for the AI. Not to mention, his flipbook recording is 12 fps, while the app mainly focuses on footage with 24+ fps. You're most likely going to get better results with actual live-action footage or professionally animated footage such as Adventure time.
I consider that 60 fps looks better. That "much" sounds exaggerated and selfish.
WOWW YOU DON'T READ MY PROFILE PICTURE
Hmmm, I’m not sure how to feel about this. I agree with the intent of the animator being lost when using the motion smoothing, and when slowed down, the 60fps shows some very odd frames. Most of those frames however, weren’t strange looking when running the animation normally, leading me to believe that this incredible technology CAN become a tool for animators with the patience for it.
honestly I doubt AI will ever be used in such intent, since it was never made for this. Possibly if we design an ai that may actually work for this sort of video media it may become a tool but I find it very unlikely because running someones animation through a dumb ai isnt doing much for the creator, its really taking away their credit too if it ends up looking good in the end because an AI might have helped with that. Animation will never be the same, done by an AI and it will never be able to combat how someone actually wants something to look like is what I think.
The technology is already used by some animators (the acani engine being a good example). The "intent of the animator being lost" thing only applies when a finished animation is just lazily fed to an AI by someone who doesn't know what they're doing. If the animator themselves are using interpolation strategically, the result can be great.
The reason for the strange frames is the AI cannot understand the elasticity of objects. For instance, if you make an animation of a person kicking a piece of wood, you may understand that the person's shoe when contacting the wood may deform a little bit, but the block of wood should not deform much at all. If you give this same animation to an AI, most likely the AI will make both the person's foot and the block of wood deform instead. This would make the block of wood move around as if it was jello, or perhaps a block which is is wrapped around in a piece of cloth. All the AI knows is there's 2 frames that it has and it needs to make a frame that goes in between them. The easiest way to do this is to take the average of both frames and merge them together, but that does not always make the correct results.
@@vanillamilkshakes7418 I agree. Most animation are not drawn to take advantage of this technology. Draw one with the intent of taking advantage of this tech then I think it would look better.
What we're currently doing is like adding ice cream on top of a pizza, if the ice cream is the animation and pizza is the AI. Of course it wont work, ice cream is not made to be put on pizza. Change how the animation is drawn and we can change that ice cream into pepperoni.
@@amigac0debasic13 whats funny is this was probably said about digital art when it first became a thing
While I agree that motion interpolation was not designed for animation, I wonder if it might serve a purpose.
I watched a Ghibli movie in the theatre. Beautiful, as always. One thing I paid attention to was panning scenes. Foreground details were probably in 12 fps, but the panning itself looked very smooth, and was certainly in the full 24 fps.
But when I watched the same movie on a Blu-ray at home, with no motion interpolation, the panning seemed to stutter more than in the theatre. My guess is that in the theatre, there is a certain flickering between the frames that we don't consciously notice, but fill out subconsciously in our minds. But modern flat screen TVs have the image on at all times, as opposed to old CRT TVs, so there's just a sudden shift from one frame to the next. It seemed better with motion interpolation set to its lowest setting. Not enough to interfere with the lower fps motion much, but enough to detect the smooth panning.
One of the more jarring aspects of the smoothing is how it doesn’t know what to do with the differences in the textures between frames. That’s especially noticeable on the graveyard scene where the whole page is shaded and there is subtle changes in that evenness. I also thought the cloud really benefited from the extra smoothness. Clouds are amorphous anyway and wobbling makes sense there, and the smoothing really helps like it flows like a cloud.
the 60 fps one made them smoother, but i personally prefer the original ones because they look, more nice in a sort of way!
Smooth but very flawed
Idk I liked the smoothed anime one because how it looked more like an animation
@@samuelflipaclip7415 and an animation didn’t look like an animation before AI interpolation? Huh?
@@samuelflipaclip7415 for me it’s the opposite
@@calimber it’s kind like the cuphead show art style thing right?
You are a purist with a gift to make those. The Ai will likely always make you feel it is less. And it is, but it almost creates a unique style of its own that is quite cool.
I adore the sequence showing how hard it is to get your computer to do math
Andy!! Way to go, being on UA-cam! You have come along way, from Vernal, Utah to where you are now. You have always been so creative and have really pushed yourself to be the star you are now. Well done!! - Ross MacLee
Ross! Thanks man! 👊
@@andymationdon’t worry I’ll fulfill the fist bump also don’t give up !👊 😀
It did a surpriseingly good job in a few places such as the umbrella opening however it created alot of weird artifacts other places.
Personally, I feel this type of an artstyle of mixing the jaggy flip book animation and overly smoothed AI goes surprisingly well together.
I agree. I very much like the look
@@TrillMurray Me too. Though I caught a weird frame. (:
The fact that he created his own Rick roll using such a thing surprises me.
But seriously tho….
Lol
Thanks, now I won’t get Rickrolled
I posted this on my dad’s account… I’m in huge trouble
@@ting-jiafan745 remove it then
@@OrangsGZ notification forgot
The 60 FPS versions remind me of some of the student animated films I've seen where they clearly had to learn to animate by hand but also had computer input probably to make up for frames or something to avoid getting a "Stop motion" feel to their animations but tried to make them still look like they were pencil and paper drawings.
One of the main thing in animation that makes it look so good is having inconsistent framerate between elements like background and character or clothes, fx, etc which the computer is never going to grasp without serious rethink of the way it works
Maybe needs more context, fot the ai to draw images that are accurate and less jittery, probably needs more work.
I personally really enjoyed how the AI handled things like rain, smoke, and fire. They have a more random and natural kind of motion between them that I think is harder to make convincing in a manual flipbook, but when your drawings serve as goals for the AI to reach through smooth transitions, it works very well. It doesn't work for things like hard collisions, cuts to different viewing angles, or any kind of sudden transition. The purpose of those moments is that they aren't smooth, but the AI onlu knows how to smooth, so of course it can't do anything convincingly naturally/artistically.
Despite the weird movements, I like how you can make a animation so smooth so fast that you would see on a show
WOWW YOU DON'T READ MY PROFILE PICTURE 😶😶❌❌
@@dont5014 ...okay
I don’t get what you’re trying to say. Animated shows aren’t done with 60fps like, at all.
They’re usually done with 24fps rarely being done with even 12 or 48fps.
I think this works best as a momentary special effect, you could keep the intention of the animator by using it that way. My favorite aprt was the rainbow waves, the tweening added some interesting oddness there
I think the way it added a kind of camera shift to the skeleton and ghost video when it cuts to the close up was pretty cool in concept.
I feel like stuff where there is simple falling on a blank background, like with the slime stuff worked well... until the impact. It probably works best when everything stays on frame at a time too. If someone used it to boost framerate for certain parts that it works well on and don't really benefit from special timing, it can kinda work slightly
I think i depends how you use it. For the ballon it is cool that it makes it smooth. It gives us the right felling on how light it is and gives us a more real and natural motion.
*Balloon
@@BlairGlitchProject y’know, you could just… edit your comment
@@victoriouswinner7745 that's not their comment, theyre correcting them;_;
@@xheom whoops, my bad.
Original is much better than A.I 100%
I think the perfect solution is mixing: create like a four or maybe 6 fake frames with A.I. and then use default linear or cubic interpolation between frames. Then adjust the parameters to achieve better look... So you can change your style from low-frame to high-frame, I think something between 16-27 is perfect solution: it makes animation smoother and also let the viewer brain to draw "missing" frames. The more frames viewer brain draw, the better memories viewer have...
At 0:10 I almost died because the sound was TOO realistic 😭😭😭
I genuinely liked the frame interpreted ones. At normal speed the imperfections just look a little more wobbly and lively.
“Slower than a herd of turtles stampeding through peanuts butter”
I’m going to use that phrase every day from now on
Slower than molasses moving uphill in January?
@@insouciantFox why specifically january lol
@@freyasobsession my guess is because its most likely going to be frozen...unless you live on the equator
slower than 3 snails pushing 2 snails.
If you're a fan of phrases, you might like this one. "I'm so hungry I could eat the butt off a low flying duck"
I quite like the effect, but it most certainly works best in moderation when you choose where you use it, I like it for effects especially, the fire on the meteor looked great! the green goo one didn't follow the original intent sure but instead kinda crated its own effect, and not a bad one considering the monster it makes, the "off-ness" just works. as far as actual frame interpolation I find a good example of the inner workings with how the pencil moving forward was done alright but with a weird grow and shrink, however with the rainbow beam it looks great, and I think that's because of the line work, the pencil lines are perpendicular to the movement while the rainbow lines were parallel, were only gonna get better at this tech so I'm really excited to see where it goes, oh also if AI image generation so far has proven itself good at anything its psychedelic effects this gives you so much more control over that, a fun thing to do would be to put in a couple dozen or so images with a similar composition but entirely different tones and run it through going 12fps to 60fps then run the new footage back at 12fps again and behold the weirdness
I Crossed my eyes to watch the side by side in "3D"...it was glorious
5:13
seems like the AI had a hard time with the randomness of the ink saturation in the images and that is what gave it the Jello effect it as it tried to move the patterns with in the "solid" blocks of colors (it would be interesting to see how this worked with paper cut animations or just with more work put into getting color saturation more consistent)
i think it really all comes down to the artist and how they want they want to interpret their work. to me, 60fps animations don’t bother me but i see how it can bother others. i thought all your examples were actually pretty clean with 60fps. wouldn’t call interpolating frames an IMPROVEMENT but it definitely doesn’t remove anything for me.
Well said
Looks amazing, I can't believe it works that well on drawings. I could almost swear this is a prank video and you drew everything at 60 fps.
AI moment smoothing is awesome in my opinion. Sure, it may be a little off in a few frames, but the idea behind the animation is preserved. Leaving behind a beautifully enhanced 60 fps animation. I love the fact that it's even able to add in new frames which seems to add more life to the animation.
Flip books need to have a consistent frame rate which probably helps the ai but usually for animation on a show or movie the frame rate isn’t consistent which the ai doesn’t know how to interpret and completely ruins the timing and flow.
It’s like mixing ketchup with oyster sauce. It’s not meant to be. The only way to make it look right is to make the 60 frames ya self
Some were good, some were off, however most I found weren't much different than the original besides a bit of jello like movement.
I think it would be interesting to see animation that was specifically made to be interpolated. Like part of the artist's intent was to have the bizarre wobbly nature of the automated smoothing.
Agreed. As-is, I think it'd work really well for a ghost-like/ethereal character or to intentionally convey an uncanny feeling, like something's off and you can't put your finger on why.
Alternatively, it could also just serve as a time-saving starting point for the animator to refine - Basically just acting as a rough pass so that the artist can focus on the most important details or things the AI struggled with.
It could be cool in like a dream sequence, with most frames created by AI, and more stuff that would be more likely to trip up the AI (so that you get more weirdness)
pretty sure Noodle did a video on something like this
@@Fighter_Builder So true! Such a great idea!
i think the motion smoothing was really cool on like... specifically the rainbow beam, where it did a p good job of running the strokes of white back through it for the speed effect but that's kinda it. it didn't help with anything else. so I think its really good for extended continuous motion things but not for more dynamic movements
Yall are tripping the 60fps looks way better.
Those small indiscrepancies actually make it somewhat unique style, and very fun and pleasing to watch.
I am starting to think some of you guys in the comments are AI, because of how much you like stiffness and rigidness. "oooh the striaight lines, the crispness".
I’d like to see a 12fps version just made from the AI tween frames. It would be interesting to see if that has a similar feel to the original or is AI just not great at animation yet.
This is such a good idea. PLEASE!
Love that idea!
Same
It would probably be cool, but we probably already know the answer
It would look like its covered in vaseline, i recommend watching noodles video on interpolation.
Honestly I love it, not for all use cases but if you wanted something stop motion but wanted a slightly more animated look and feel I think this is a great trick to achieve it
As someone not familiar with the process of animation at all. The motion smoothing version could definitely fool me if I didn’t know and didn’t watch at 25% speed
I actually really like the 60 fps from the AI it's kinda like it's own art style
It does make it look weird when you actually slow it down or pause it second by second. But watching it throughly, i dont really even notice the weirdness. The smoothness sweeps away the weirdness which I think makes it better than regular 12 fps. But Animators work really hard and their original works are the best because it is pure hard work effort and the intention is delivered to the audience.
Not really I don't think, especially at 6:39 it really struggles to convey the motion and energy - you can tell just by looking at it - but I agree But in some circumstances, if used intentionally by the artist it can look great
GOD JESUS TOLD US TO LOVE EACH OTHER!LET'S NOT DESTROY THIS WORLD!NO WAR
@@potshot5888 GOD JESUS TOLD US TO LOVE EACH OTHER!LET'S NOT DESTROY THIS WORLD!NO WAR
The problem is not Just intention, the movement literally changes by the wobblyness, since for example, when you look at rain drops, they don't bend in the air like that cloud animation shows in 60fps.
Exactly, the smoothness just draws my eyes to the 60 fps side. It's just so damn good! Lower fps has a vibe, I 100% enjoy good things even if they are low fps, but I'm all for team high fps if I can choose.
1:54
did you just-
yes, he did just-
Rick
Roll
unofficial rickroll
@@slimanicik Roll
what is interesting is to see the interpolation when the objects change shape.
E.g. the dino's red umbrella at 7:12. that was well done by the AI
there is a significant amount of difference the title looks more cartoony and the fps seems more glued together, only when you slowed it down it looked weird
Bro studied and experimented so hard he found THE answer. I love the editing of your video, never seen something like this before it's like a whole trip.
I think the AI did an amazing job. Here are some things to consider:
- The output video from the AI is meant to be played back at normal speeds, which is 60 fps, not in slow-motion
- 80% of the frames you see in the output video don't exist, the AI algorithm had to fill out that much non-existent frames
- We can be slightly biased as we are looking at it from an animation point of view, how the AI generated one loses the unique charm of 24 fps animation
I think it's all a matter of perspective. From an animation standpoint, yes, low fps animation does have its own unique charm, the low FPS makes it very "human" so to speak.
From a purely technological standpoint however, the amount of gap there is between frames, and the number of consecutive non-existent frames the AI had to generate, just the fact that you can even watch it at 60 fps still looking decent and not a completely garbled mess is mind blowing
are you gonna fuq the ai
@@bigfanofyoutubers I thought your Moms' name was Karen not ai
I noticed that, too -- slow playback revealed a lot of sins that weren't evident at 60fps. I'm sure AI will eventually be good enough to not make those mistakes at all, but dinging it for having a few bad frames in a giant stack seems a bit much. I also disliked the patchy inconsistent coloring in the latter animations. They work fine and are a great aesthetic in animation, but with the smoothing, it's like smushing together two very different art styles and felt discordant to me. Maybe if the AI got better at smoothing them as well it might work, but as it is, it didn't work for me.
Especially the fireball made me think „how would I have done the frames between?” And I don’t know! The original version just had jumbled mess as mater. So yeah the AI did exactly that, just a wild transformation. I think that was a 9/10 great work.
Good points, but you have a gura pf and therefore everything you said is irrelevant. You have been reported for spam.
I'll be completely honest, I find that watching the 60fps versions was a lot easier on my eyes than it was when watching the 12fps version. I did notice the loss of impact or snappiness but I still preferred the AI smoothed version, if only because of the eye strain.
Love your animations and approach of this video. I see lots of ppl afraid/allergic to AI without testing. In this case of animation more frames may dissolve some "drama" that is important.
probably because artists would rather actually do the art than to have an ai do it for them
@@FemboyKaiSaku damn you're that insecure ? :O
@@cypclope8578 isnt it moree insecure to have ai do art for you because youre not good enough lol
the way you cleaned upp the flip book so you could see every page clearer is so nice, i dont really like the interpolated one but the original cleaned up is really really satisfying i love it
5:46 That was pretty cool to look at
its impressive how well it actually worked
Fascinating research. Can’t believe you graduated from school within one minute.