🧠HITTING SUBSCRIBE WILL GRANT YOU ALL BLENDER KNOWLEDGE INSTANTLY🧠 I'm in a race with @Smeaf to get to 100K subs first. Currently I'm losing, but you can change that! You can become that one single subscriber that changes the future of this race. I'll even make it easier for you; just click here - ua-cam.com/users/KaizenTutorialsYT
I have actually done this before for a client when I was running low on time. It worked very well, and they did not seem to notice. Very cool technique. Great tutorial!
@Esphaeras Praestans nah if they are on a schedule or there are no alternatives. I've seen twixtor get used 10 years ago for big commercials and you could see it a lot because twixtor back then wasn't using AI but some algorithms and it had a lot of artifacts. If people need something they will use the best way to get it and sometimes you need to accept sacrifices if it hits limitations.
Fun fact:- This only works on slow animations. if you use this in fast animations and a lot of fast and precise movements (action) you will lose a frame and details. I had tried this with fast moving hairs and it messes up
@@maciejzee474 Or Kronos for Nuke :) But you can do this in a lot of softwares with various methods by using motion vectors (Generated or rendered in Cycles or any engine). AI is not mandatory to do it.
Wish this came out before my exams started, due to which I had to submit my endless engines challenge too early which resulted in me needing to render in 12 hours which resulted in low render quality with my potato pc, Hard luck Ig lol
@@Ab_obla And AI is not even mandatory, usually this works by generating motion vectors (Or using a motion vector pass rendered with your sequence which work even better) and use them to interpolate new images. A lot of software have tech like this. OFlow, Kronos in Nuke, Twixtor in After Effects are a few examples.
That would have been so useful 2 months ago for my exam in 3D Animation. It took me roughly 30 hours of render time on my laptop. I'll definitely use it for the second semester though.
@@KaizenTutorials Just finished my render for the exam. I didn't use the tools since the render was done in 30-45 minutes for 300 frames ua-cam.com/video/8kQ-bRHz-Jw/v-deo.html
Good trick. As long as the movement is not too abrupt, either camera or scene, flowframes can give very good results. By the way, I don't see the need to convert the image sequence to video, especially when your sequence is PNGs. Flowframes can work on them and in fact, afaik when you give it a video, what it does first is to convert it back to an image sequence. This saves you that step, some time and unnecessary compression. PS: In principle it supports EXR sequences, but it has given me errors if they are 32bpc (hence the comment about PNG).
Talking about EXR is there a reason it looks much better than EXR even when both are at 16 bit which my monitor shouldn't even be able to show? I can get lots of banding in PNG while EXR is smooth, just curious
I found that using Flowframes for other animations was really useful, such as importing in specific animations to then upscale the framerate to look proper along with keeping audio in sync. Makes things such as importing in TF2 taunts and dances to sync up and look smooth quite handy, :)
Thank you for this video. Tried it today and it had a great additional benefit. It introduced very nice anti-aliasing to a clip that had a lot of flicker prior to running through the algorithm.
i was about to animate a simple rotating scene but i didn't realise that my scene rotating too fast & i rendered whole 300 frames, so i was frustrated what to do bcuz i couldn't afford to re-render back then & someone suggested me this software & i used images to decrease speed by 2x & it was smooth
I wonder how rendering out at a lower resolution then using AI to upscale before then putting it through Flowframe would turn out? Thanks for sharing this awesome piece of knowledge, I generally use a render farm so that my machine isn’t tied up but this may help change that ❤
It wouldn't make a difference to the interpolation process itself, but upscaling beforehand might make you hit a point of diminishing returns. It really depends a lot on the model used to upscale your render and how good it is with your style of render. Most upscaling solutions are not that great in many scenarios, so I'm not sure it's worth doing it most of the times. Consider that if you render at higher resolution you can get away with denoising at lower samples as well
It works but... at equal render time using an higher resolution with a lower sample rate seem to give better result. Probably because the denoiser get textures information/details for free from the albedo pass. So it has all the texture details to work with even if it missing light sample information.
If flowframes could use a second video with the number of final frames where objects are rendered in solid colors (like cryptomatte) and use the position info for interpolation the result could be much more accurate being able to skip even more full render frames . Yes, I would add having to make the second video, but a solid color video would be quite fast.
what is unbelievable is the fact that this is only the beginning and if the sources for NVIDIA's DLSS 3.0 get into this industry it's going to revolutionize rendering forever
thats what's happening already. AMD FSR and Nvidia DLSS. Nvidia even says it in the name: "Deep Learning Super Sampling" Also some TVs do that too, so the normal TV-Programm is more smooth. Mostly in 120Hz+ devices
Something that I haven’t seen a lot of people talk about in this topic of rendering is stable diffusion upscaling or any other upscaler I hope that in the future thwre will be an upscaler that is trained on denoised or not denoised with the „noise pattern of a low sample render“ and then combine that with flow frame which would just decrease render times to a minimum and if dream 3D already works in blender now I think having a final upscale option after the frame is rendered isn’t to far fetched
Hi Kaizen, really cool video as usual ! is it possible to give a 2 line breakdown of how you made the animation ? did you use botaniq ? and ANTS for mountains ? thank you so much !
Sure can! I used the Graswald free addon after creating a basic landscape with a plane and a displacement modifier. I scattered the free Graswald assets using their addon GScatter, super easy to do and you can also animate them using the addon! The mountain is actually a model from Sketchfab. Then it was just a matter of setting up the scene, copying thr mountains around and messing with their scale. Adding a camera and voila!
A couple of months back, after everything was locked and rendered a client suddenly demanded a 50fps version of the animation. So instead of wasting time in re-rendering, I used FlowFrames...the result was quite acceptable.
I use flowframes a lot but it often struggles with occlusion, i.e. when something gets hidden behind something else for a few frames. It's still the best interpolator out there imho though and only costs a few beans at his Patreon.
Works well for slow animation, quick motion not so well. I tried it for jewelry animation, few frames got weird artifacts. Had to try it with other non jewelry animations
It doesn't work great for every type of animation no. It does a decent job at very fast speeds, it does well at medium speed and it does amazing at slower speeds. Funny enough you said it gave some artifacts, in my case it removed some firefly artifacts from the original Blender render haha!
Damn yeah the basics all depend on your hardware I guess. I do have semi-optimized settings for cycles rendering as well. You can watch the vid I link in the end to get those 🙏🏻
Flowframes?! That's a name I haven't heard in years! I used to use this to make my janky animation look better by doubling my frames & just speed ramping the video back down to the original time.
I used this on all my video for a wile to get 4k 60fps. Though I use RIFE directly without the Flowframe UI. In my case it also save a lot of simulation time. Cloth physics were pretty long to simulate at 60 fps.
Tested this and it worked excellently to bring something from 24 FPS to 120 FPS. I can imagine how nice this would be to bring video game footage or a twitch stream to a higher FPS. Though my 2080 Super was already on its way out so I am getting python errors towards the end unfortunately. But even then, still able to input at about 3-5 FPS, and was able to output at 20-25 FPS! Edit: Was able to override it and run it on a 1070 as well. Though apparently my error was due to some frames randomly having transparency by accident apparently. Running it through ffmpeg to set them to rgb24 PNGs fixed it.
You should give a go at rendering at a lower res and upscaling it using AI. I've been using it a bunch for images and not sure whether there's an option for video, but probably worth a shot
I did some testing, AE's timewarp effect works way better with more complex scenes where lots of foliage + shadows are moving (Probably because it just overlays two frames and calculates the distance a pixel traveled and then recreates one in the center). Flow frames works best with cleaner images and is able to interpolate more frames in between. But yeah for my complex forest scene with lots of movement (especially the shadows) Flowframes started getting warp wiggles in the whole image :/ I'll upload the video showing the scene that makes flowframes fall apart.
Yeah please do, would love to see the difference! You can't comment links cus YT will delete the comment, but if you just comment on here I can see it.
You: It took, roughly 50 seconds... (Super advanced epic scene) Me rendering a simple low poly backrooms animation: OMG THAT'S SO FAST LETS GO I CAN RENDER AN IMAGE IN UNDER 2 MINUTES!!111!!!11 Also amazing video!
Awesome! I have looked into ai frame interpolation before, but there are no options for Mac. I hope something will come to Mac soon! Super helpful tutorial!
@@KaizenTutorials Yes, me too. MacOS and Linux have less compatibility, and so I am thinking of switching to the windows operating system. Love your tutorials man! Have an awesome day!
It will be even more faster if you render those frames in half of the actual resolutions than upscale it using any AI upscaling tool.. Than use flow frames to make it more smother 🙂
They should implement those things right into blender at least the upscaling thing. It would also be much more accurate with all the layers blender renders.
Pro-tip. DO NOT interpolate frames at 2560px !!! Thats infinitely harder on the model. 512 is bad enough, 2560? defeats the whole point. Render it at 512, then interpolate, then super-res
@@KaizenTutorials not saying the results arent good. Just that the compute is so much higher and it takes longer. i guess im just inpatient lol. also im using a 2060 so thats probably where i get my ocd
I thought i was the only person who did this LMAO, i used to use flowframes just for turning anime to 60FPS cause why not LOL but last year i started using it for animations cause man my RTX 3060 just takes too long LMAO
Less good. The faster the motion and the lower the quality input (low FPS, low resolution etc) the worse it gets! It works best for slow and medium speed motion.
It is surprisingly good. But it can indeed make a couple of broken frames. There is a trick. Like render at 15fps then double to 30 with AI. Then look and delete all the bad frames after that re-render on top at 30fps with overwrite disabled. This way Blender is going to fill the missing frame with their actual render. This can still save a lot of render time because there will be really few frames that need to be replaced.
Great tutorial, I'm gonna using it for my next animation. One more question tho, do you have any experience with Topaz AI which does basically the same thing, and if you do, how would you compare it to flowframe in terms of quality/ artifacts?
Thanks! I haven’t used topaz myself, but I know people who have and they say it’s very similar. It might be better at fast moving scenes though! But i’m not sure it’s worth the money without more comparison.
It definitely does not work as well as this. Once you introduce a lot of motion and motion blur this can get really messy. Perfect for steady, clear shots though.
I'm going to have to say no, I tried to use it for action scenes and it absolutely could not interpolate between frames. What we see here is a cherry picked an example of something that works perfectly with flow frames. And in my experience examples like this are the only thing it's actually good for.
Yeah it doesn't work as well for fast motion. Still it works pretty great for medium and slow motion scenes. You could also combine techniques, by rendering your fast elements on a separate render layer in Blender you could let the AI interpolate all the slower background elements and then overlay just the faster elements, fully done in Blender. That way you will still save a bunch of time. The reason I made this scene is because it's a heavy scene (slow to rendeR) and has a lot of animated objects. Not fast moving, but still. It also has Depth of Field changes, which it also interpolates just fine.
@@KaizenTutorialshi I do have a problem when I click interpolate after a few seconds it comes up with an error method saying: Neither flowframes python runtime not system installation could be found
one of the reason it takes long is rtx 3070 ti has 8bg vs 3060 or 3080 that has 12gb ! I saw in a video that rtx 3060 was fast than 3070 because its ram capacity, even rtx 3070 has more cuda !
Yep, the 8gb is limited. Although if you don't peak the VRAM it doesn't really matter how much you have and doesn't necessarily increase the speed I believe. B
Yes very useful technique. I also do it with topaz video which is payed but sometimes slightly better. But if i would have known flow frames before buying Topaz i wouldn’t have bought it.
Hard to get a good feel of what the interpolation is doing as your UA-cam video is at 60fps playing back a 30fps video, so you're getting frame duplication. I wonder how this A.I. interpolation program compares to NLEs such as DaVinci Resolve's interpolation tools. I know I would have a broader range of codecs and containers such EXRs if I was using DVR. Any chance we could download your 15fps render to experiment with, please?
That's true! I never thought about that. But yeah they do actually look very similar if I play them side by side on my monitor here at their actual FPS. Check the comparison out here imgur.com/a/7Ffdxta Davinci and AE's interpolation tools function well and would probably give similar results in this scene. But in more intense scenes, especially with faster motion, Flowframes is king. It does take EXR input but doesn't export it. I think there might be workaround, but I don't know those.
Hello, I was wondering what software you use for Compositing and color grading. I use Davinci and It does not have an export option for '12 FPS' So I'm stuck on this. I have a bunch of EXR passes I wanted to use for Compositing.
Doing the Comp/color grade after the flowframes wont work either since i wont have enough information nor the exr passes to work with. I would love to know how u do urs? Idk how to use blender compositor and its way too slow for my system since this whole thing is about speeding up ur workflow and render time.
Hmm yeah that makes sense. I'm not sure if this is a suitable option for non blender-based workflows honestly. What you can do in davinci is to give your timeline a custom framerate (like 12) and render it out at 12fps. You should be able to do that and then use flowframes to interpolate to 24fps. However this way doesn't actually 'skip' frames, like I do in Blender so the result won't be the same. I'm not sure what the best fix is for this case...
@@KaizenTutorials found a fix for it. You can export from Davinci as PNG sequences in 24Fps(since its an image sequence fps wont matter anyways , except for a few nodes maybe I doubt Davinci's motion blur going to mess it up. For my case I used Vector pass for motion blur so it didnt matter at all). And finally put it back in blender and export as a video in 12 fps. The put it through Flowframes. A bit of a headache workflow. But hey, anything to get that render time in half.
This is a huge help. But, if you want to become an environment artist or, say, show an environment like this, then you have Blender + World Machine + Unreal Engine... make stuff in real-time. and save a ton of time. even with 4090, this will struggle for hours... unless you're on that DUAL 4090, by the way, good luck with your power bills.
Off topic: do you actually use the blender video sequencer for your final Renders? I have never gotten a good result,.. whenever i import the image sequence it loses contrast and looks washed out/ overexposed, somewhat like a double filtering,.. pointers are greatly appreciated, thx awesome video as always,..
I've exclusively used Blender's video editor to export image sequences for years. Never noticed any weirdness with it. It might be that you've got some settings going on in your export options, maybe a base gamma change, exposure change, look etc. Anyways for me it has worked perfectly!
@@KaizenTutorials thanks for your answer ,.. I just Switched to DaVinci resolve, since I ve never gotten an result i like, even after tweaking,.. probably one of those little clicks somewhere,,. I will sub you, so you win your race! Keep on keeping you re doing an awesome job!
I wouldnt go for 3x but instead i have another idea. You can go for upscale AI model like Topaz labs and go from 1080p to 4K Footage with amazing upscale quality and save a lot of time. Then take that footage to FF and interpolate it.
You can't if you want to use it in FlowFrames. You can if you just want to export it. However it's riskier since if Blender crashes you've lost everything and have to start over. With PNG you can just continue after your last finished frame.
🧠HITTING SUBSCRIBE WILL GRANT YOU ALL BLENDER KNOWLEDGE INSTANTLY🧠
I'm in a race with @Smeaf to get to 100K subs first. Currently I'm losing, but you can change that! You can become that one single subscriber that changes the future of this race.
I'll even make it easier for you; just click here - ua-cam.com/users/KaizenTutorialsYT
😶🌫
I have actually done this before for a client when I was running low on time. It worked very well, and they did not seem to notice. Very cool technique. Great tutorial!
Thanks for sharing, awesome. Love to hear this works in practice for client work as well.
Honestly the 2 frame skip version even most people wouldn’t notice lol only the artist doing it tends to lol
Now they do. lol
@Esphaeras Praestans nah if they are on a schedule or there are no alternatives. I've seen twixtor get used 10 years ago for big commercials and you could see it a lot because twixtor back then wasn't using AI but some algorithms and it had a lot of artifacts. If people need something they will use the best way to get it and sometimes you need to accept sacrifices if it hits limitations.
Fun fact:- This only works on slow animations. if you use this in fast animations and a lot of fast and precise movements (action) you will lose a frame and details. I had tried this with fast moving hairs and it messes up
makes sense
Yep, this works best for slow and medium movement/speed animations!
Yes.. It messes up quite frequently so not really a dependable method
it's ain;t new, there was a plugin for AE called Twixtor
@@maciejzee474 Or Kronos for Nuke :) But you can do this in a lot of softwares with various methods by using motion vectors (Generated or rendered in Cycles or any engine). AI is not mandatory to do it.
Awesome!!! Unironically really clever for slow paced shots like that! Gonna have to try this!!
Thanks! Yeah please do try it out. It can be a real timesaver for simpler shots (and even some with medium speed motion)!
Wish this came out before my exams started, due to which I had to submit my endless engines challenge too early which resulted in me needing to render in 12 hours which resulted in low render quality with my potato pc, Hard luck Ig lol
Damn, sorry to hear that! Could've saved a lot of time for sure.
Flowframes and other frame interpolation programs have been there for at least a few years
@@azteczek yes but I was too dumb to think of frame interpretation AI, i just searched for free upscaler AIs (for videos) and found no free ones lol.
@@Ab_obla And AI is not even mandatory, usually this works by generating motion vectors (Or using a motion vector pass rendered with your sequence which work even better) and use them to interpolate new images. A lot of software have tech like this. OFlow, Kronos in Nuke, Twixtor in After Effects are a few examples.
That would have been so useful 2 months ago for my exam in 3D Animation. It took me roughly 30 hours of render time on my laptop. I'll definitely use it for the second semester though.
Awh yeah, always a shame when that happens haha. But the next semester you'll be done in no time!
@@KaizenTutorials Just finished my render for the exam. I didn't use the tools since the render was done in 30-45 minutes for 300 frames
ua-cam.com/video/8kQ-bRHz-Jw/v-deo.html
I was using optical flow for smoothing frames but this is so much better, thanks Kaizen
No problem! Yeah this really beats optical flow, especially for more difficult and chaotic renders!
Good trick. As long as the movement is not too abrupt, either camera or scene, flowframes can give very good results. By the way, I don't see the need to convert the image sequence to video, especially when your sequence is PNGs. Flowframes can work on them and in fact, afaik when you give it a video, what it does first is to convert it back to an image sequence. This saves you that step, some time and unnecessary compression. PS: In principle it supports EXR sequences, but it has given me errors if they are 32bpc (hence the comment about PNG).
Good to know! Especially that it even takes in EXR.
Yes, it is a good idea to process the render images directly.
Talking about EXR is there a reason it looks much better than EXR even when both are at 16 bit which my monitor shouldn't even be able to show? I can get lots of banding in PNG while EXR is smooth, just curious
I found that using Flowframes for other animations was really useful, such as importing in specific animations to then upscale the framerate to look proper along with keeping audio in sync. Makes things such as importing in TF2 taunts and dances to sync up and look smooth quite handy, :)
Nice! Yeah it’s a very multi-purpose functional tool imo
Really cool tool will definitely need to give this a shot on some projects!
Absolutely! Would work perfect for your smooth motion projects!
Love your In Detail videos. Thats what I call a quality content. Thank you for all the work you have done!
Thank you very much, love to hear it!
Well as someone who has been thinking about buying the Topaz ai video kit this is amazing. Thank you ver much can't wait yo start playing with this!
Awesome, yeah it works just as well I think but 100% free!
OMG it really HELPED! Will use it for future projects!!!! This is the only way to speed up animations render for me!
If you want to expand on this you can do another test adding in up scaling ai. Some really good results with half res rendering
Might do that at some point. Currently though Polyfjord has an amazing tutorial on using AI upscaling!
Huge Thanks, my Brother!! Your tutorials are among the Best. Cheers
Thank you, appreciate it as always!
Thank you for this video. Tried it today and it had a great additional benefit. It introduced very nice anti-aliasing to a clip that had a lot of flicker prior to running through the algorithm.
Cool! Yeah in my case it got rid of some firefly artefacts aswell. Awesome side-benefit!
i was about to animate a simple rotating scene but i didn't realise that my scene rotating too fast & i rendered whole 300 frames, so i was frustrated what to do bcuz i couldn't afford to re-render back then & someone suggested me this software & i used images to decrease speed by 2x & it was smooth
Awesome! Yeah it can do a lot of things. Super useful!
I wonder how rendering out at a lower resolution then using AI to upscale before then putting it through Flowframe would turn out? Thanks for sharing this awesome piece of knowledge, I generally use a render farm so that my machine isn’t tied up but this may help change that ❤
It wouldn't make a difference to the interpolation process itself, but upscaling beforehand might make you hit a point of diminishing returns. It really depends a lot on the model used to upscale your render and how good it is with your style of render. Most upscaling solutions are not that great in many scenarios, so I'm not sure it's worth doing it most of the times. Consider that if you render at higher resolution you can get away with denoising at lower samples as well
Upscaling is great, but it can take quite some time aswell if it's to be done in a high quality way. However, yeah seems like a viable solution to me!
It works but... at equal render time using an higher resolution with a lower sample rate seem to give better result. Probably because the denoiser get textures information/details for free from the albedo pass. So it has all the texture details to work with even if it missing light sample information.
sensei never disappoints with his video! always something new!😎
Thank you as always my friend! 😎🙏
If flowframes could use a second video with the number of final frames where objects are rendered in solid colors (like cryptomatte) and use the position info for interpolation the result could be much more accurate being able to skip even more full render frames . Yes, I would add having to make the second video, but a solid color video would be quite fast.
That would be dope! I'm sure that's something that could be created in the near future.
Wow, this is so cool!! Thanks for making this video, super helpful. Can't wait to try it out myself.
Glad it was helpful! Have fun with it. It really blew my mind when I tried it! 💪
I liked that you explained how it worked and using AI as a utility in creation
Thanks, glad to hear you liked the video!
So you're saying my janky-ass animations are salvageable. Excellent show! thanks
Lol, yeah Flowframes to the rescue!
Hey thanks for the video and the 22 ads that I had to watch!
Thanks for supporting the channel. :-)
Why This video was recommended for me when i finished 8 hours of rendering a 10 seconds video?
Damn that’s rough! :-(
what is unbelievable is the fact that this is only the beginning and if the sources for NVIDIA's DLSS 3.0 get into this industry it's going to revolutionize rendering forever
True that! The future’s crazy!
Will definitely use this in my future workflow
Awesome!
I can see this becoming a big thing for gaming, imagine being able to "upscale" 30fps games to 60fps or higher.
Oh wow, I never even thought of that, but yeah being able to do this in realtime and maybe more accurately aswell would be a gamechanger!
thats what's happening already. AMD FSR and Nvidia DLSS. Nvidia even says it in the name: "Deep Learning Super Sampling"
Also some TVs do that too, so the normal TV-Programm is more smooth. Mostly in 120Hz+ devices
Dude this is amazing!!
Thanks man, appreciate it! I really hope this can collectively save us all days/weeks of rendering 💪
I think it’s something like what the MEMC on TVs do? I think this would be good for a slow moving visual I guess 🤔
Yep it's best for slow movement and medium speed movement.
@@KaizenTutorials Got you brother! Amazing thou!
Love the sense of humor btw
Thanks!
wow that's crazy! 7:25 I think that is still acceptable quality for Instagram or TikTok upload.
Yeah absolutely! So depending on your purpose you can switch up what you want to do with this and save a TON of time.
Weird, i've been doing this since flowframes was released. Glad to see someone made a video on it.
Nice! Yeah it's been out for quite a while now. But so many people don't know it. so I figured sharing would definitely be useful to some!
I can see the potential for hand drawn animation.
Oh yeah that would be dope! Not sure how it holds up with this tool though.
Something that I haven’t seen a lot of people talk about in this topic of rendering is stable diffusion upscaling or any other upscaler I hope that in the future thwre will be an upscaler that is trained on denoised or not denoised with the „noise pattern of a low sample render“ and then combine that with flow frame which would just decrease render times to a minimum and if dream 3D already works in blender now I think having a final upscale option after the frame is rendered isn’t to far fetched
Seems like it should be doable. I think in most regards the future of 3D is hard to imagine, because of how fast the world is moving!
What is crazy is to use Flowframes to save space of your personal videos. You will have a smoother vid with smaller file sizes.
Nice! The smaller filesize is because of some compression. It’s nice for the filesize, but it makes the image slightly lower quality!
Yes, most are saved phone vid captures. I really like that the camera shakes are softened and my shots look professional and stable.
Nice thats an added bonus yeah!
Man, this man is lifesaver
Happy to hear it!
Don't know who Smeaf is-LOTR?-, but I've subscribed=>your tutorials are crisp-clear and concise. Keep it up!
Thank you! Smeaf is indeed from LOTR hahaha. Appreciate the kind words!
Will bear this in mind
👍👍
@@KaizenTutorials ❤️
Thank you for the advice. I liked the way I explained
Glad you liked it, thanks!
Someone give him time saver award pls
You my friend, are a Messiah!
Haha thanks!
Thanks for sharing this.
My pleasure!
Hi Kaizen, really cool video as usual ! is it possible to give a 2 line breakdown of how you made the animation ? did you use botaniq ? and ANTS for mountains ? thank you so much !
Sure can! I used the Graswald free addon after creating a basic landscape with a plane and a displacement modifier. I scattered the free Graswald assets using their addon GScatter, super easy to do and you can also animate them using the addon! The mountain is actually a model from Sketchfab. Then it was just a matter of setting up the scene, copying thr mountains around and messing with their scale. Adding a camera and voila!
A couple of months back, after everything was locked and rendered a client suddenly demanded a 50fps version of the animation. So instead of wasting time in re-rendering, I used FlowFrames...the result was quite acceptable.
Awesome, that's a good usecase for sure.
A.I. = less sharp and less saturated, bit noisy, so maybe in editing soft boost these first 2 values and it will be around 95% same = good enough.
I agree!
Oh now! Now i ll have to go to the gym, take a shower and have lunch in only 1 hour and a half! Lol - Thanks for the tip man! That´s worth gold!!!!
Hahaha, guess you'll have to become faster at everything now! No problem, glad you like the vid.
@@KaizenTutorials I was trying to buy a 120fps camera and you saved me from wasting money.
Happy to help!
Reallt liked ur video just faced a slow rendring issue cause of volumetric atmosphere. 2X step with flowframes worked like a magic thanks!
Glad it helped!
I use flowframes a lot but it often struggles with occlusion, i.e. when something gets hidden behind something else for a few frames. It's still the best interpolator out there imho though and only costs a few beans at his Patreon.
Nice! Yeah there's several caviats. But it's free and works well enough! So you'll never hear me complaining
Works well for slow animation, quick motion not so well. I tried it for jewelry animation, few frames got weird artifacts. Had to try it with other non jewelry animations
It doesn't work great for every type of animation no. It does a decent job at very fast speeds, it does well at medium speed and it does amazing at slower speeds. Funny enough you said it gave some artifacts, in my case it removed some firefly artifacts from the original Blender render haha!
@@KaizenTutorials the actifacts were like smudged for the very fast areas and sometimes on the stones
@@arupdeb69 hmm ok, that’s a shame! Maybe trying a different AI model can help!
@@KaizenTutorials it sometimes happens even for slower animation that have stones, not all 3-4 frames in between. I just render those specific frames
Hmm yeah also it really depends how many frames you interpolate. In my experience 1 is best!
Kaizen strikes again! Love the memes btw lol 🙏🙃
Haha thanks, appreciate it!
Your animation took roughly fifty seconds per frame, meanwhile me taking ten minutes per frame with roughly the same amount of geometry
Damn yeah the basics all depend on your hardware I guess. I do have semi-optimized settings for cycles rendering as well. You can watch the vid I link in the end to get those 🙏🏻
@@KaizenTutorials I actually saw that! Took render times to about five minutes per frame!
Nice I tried this the other week with nice results! I'm glad others see it as a viable alternative.
Great to hear! Yeah it’s a great solution for faster renders 💪🏻
Flowframes?! That's a name I haven't heard in years! I used to use this to make my janky animation look better by doubling my frames & just speed ramping the video back down to the original time.
Awesome! Yeah no need to speedramp them down anymore these days. Even easier to use!
That's what she said 🤣
lol love that show and your vid. Helpful as always
Thank you! Appreciate it 🤗
I used this on all my video for a wile to get 4k 60fps. Though I use RIFE directly without the Flowframe UI. In my case it also save a lot of simulation time. Cloth physics were pretty long to simulate at 60 fps.
Nice one!
Tested this and it worked excellently to bring something from 24 FPS to 120 FPS. I can imagine how nice this would be to bring video game footage or a twitch stream to a higher FPS. Though my 2080 Super was already on its way out so I am getting python errors towards the end unfortunately. But even then, still able to input at about 3-5 FPS, and was able to output at 20-25 FPS!
Edit: Was able to override it and run it on a 1070 as well. Though apparently my error was due to some frames randomly having transparency by accident apparently. Running it through ffmpeg to set them to rgb24 PNGs fixed it.
Awesome! It's a really amazing piece of AI. Just need to find the best usecases for it!
6:36 I can. Black levels are totally different.
Maybe this is due to the .mp4 compressor, maybe not.
The only way to find id out is by testing.
👍🏻💪🏻 testing is always best!
you can also just render at a lower resolution and use an ai upscaler for an even bigger boost.
Very true!
Wow! So cool! Thanks a lot! 🙌🏻
Glad you liked it!
omg brooo you helped me soo much thank youoouououuo
You should give a go at rendering at a lower res and upscaling it using AI. I've been using it a bunch for images and not sure whether there's an option for video, but probably worth a shot
I have done that actually! Works pretty well. Polyfjord has a video on how to do it using open source, free software. Works great!
@@KaizenTutorials Sick! I'll have to check it out.
I did some testing, AE's timewarp effect works way better with more complex scenes where lots of foliage + shadows are moving (Probably because it just overlays two frames and calculates the distance a pixel traveled and then recreates one in the center).
Flow frames works best with cleaner images and is able to interpolate more frames in between. But yeah for my complex forest scene with lots of movement (especially the shadows) Flowframes started getting warp wiggles in the whole image :/
I'll upload the video showing the scene that makes flowframes fall apart.
Yeah please do, would love to see the difference! You can't comment links cus YT will delete the comment, but if you just comment on here I can see it.
Thanks for sharing. I'll try with AE and compare results.
You: It took, roughly 50 seconds... (Super advanced epic scene)
Me rendering a simple low poly backrooms animation: OMG THAT'S SO FAST LETS GO I CAN RENDER AN IMAGE IN UNDER 2 MINUTES!!111!!!11
Also amazing video!
Hahaha 😂 thanks! I feel your pain. Not too long ago I had a PC who rendered like that aswell.
@@KaizenTutorials lol
Awesome! I have looked into ai frame interpolation before, but there are no options for Mac. I hope something will come to Mac soon! Super helpful tutorial!
Thanks yeah that’s always a downside for mac and linux. Hope this changes in the future!
@@KaizenTutorials Yes, me too. MacOS and Linux have less compatibility, and so I am thinking of switching to the windows operating system. Love your tutorials man! Have an awesome day!
Thanks for the kind words and thanks you too! 🤗
emulate windows. Set it up on that, easy import
Thats actually a good idea!
You have made life so much easier. Thank you. I appreciate your guidance.
Thanks for the kind words!
It will be even more faster if you render those frames in half of the actual resolutions than upscale it using any AI upscaling tool.. Than use flow frames to make it more smother 🙂
Facts!
They should implement those things right into blender at least the upscaling thing. It would also be much more accurate with all the layers blender renders.
@@demp11 does blender support AI Upscaling? I don't think so.
@@riotechmod can you read I don't think so.
Can u make a video about compositing in cycles
It's absolutely on my list to do a video about it in the future! It might be a while, but I can guarantee I'll make it!
Mega interesting! Looks like power of A1 )))
You are right! Might have to change that 🙌🏻
Sir how did you made those hyper realistic skies ?
That is actually just a photo on a plane lol
I have Flowframes and never tried yet, guess it`s time
The time is now!
✅ got it right!
Nicely done!
thank you so much
this help me lot
No worries, glad to help!
Thank you for this! 👍
My pleasure!
Thanks for the share,that's how AI should be used.
Agreed and no problem!
I used this software about 1.5 year ago when i was making animation for my youtube video i changed framerate of my video from 30fps to 60fps
Awesome right! It's easy to do and free :-D
Pro-tip. DO NOT interpolate frames at 2560px !!! Thats infinitely harder on the model. 512 is bad enough, 2560? defeats the whole point. Render it at 512, then interpolate, then super-res
Hmm with my RTX 3070 it gives me good end results. But noted, thanks!
@@KaizenTutorials not saying the results arent good. Just that the compute is so much higher and it takes longer. i guess im just inpatient lol. also im using a 2060 so thats probably where i get my ocd
I thought i was the only person who did this LMAO, i used to use flowframes just for turning anime to 60FPS cause why not LOL but last year i started using it for animations cause man my RTX 3060 just takes too long LMAO
Haha yeah it's amazing to save so much time! My 3070 is decent, but this helps a lot!
Impressive, I wonder how it works on scenes with a lot of action and motion blur.
Less good. The faster the motion and the lower the quality input (low FPS, low resolution etc) the worse it gets! It works best for slow and medium speed motion.
It is surprisingly good. But it can indeed make a couple of broken frames. There is a trick. Like render at 15fps then double to 30 with AI. Then look and delete all the bad frames after that re-render on top at 30fps with overwrite disabled. This way Blender is going to fill the missing frame with their actual render. This can still save a lot of render time because there will be really few frames that need to be replaced.
@@leucome oh nice tip!
I wonder if nvidia's new DLSS 3 can help
It probably could!
Great tutorial, I'm gonna using it for my next animation. One more question tho, do you have any experience with Topaz AI which does basically the same thing, and if you do, how would you compare it to flowframe in terms of quality/ artifacts?
Thanks! I haven’t used topaz myself, but I know people who have and they say it’s very similar. It might be better at fast moving scenes though! But i’m not sure it’s worth the money without more comparison.
any good for stills? maybe AI upscaling will be implemented some day.
Uhm this is more for animation, there's AI upscaling tools which work fine and are free already! I believe Polyfjord has a video on that.
What about fast action scenes? Will it work well? Does this use the same tech as Nvidia's frame generation?
It definitely does not work as well as this. Once you introduce a lot of motion and motion blur this can get really messy. Perfect for steady, clear shots though.
I'm going to have to say no, I tried to use it for action scenes and it absolutely could not interpolate between frames. What we see here is a cherry picked an example of something that works perfectly with flow frames. And in my experience examples like this are the only thing it's actually good for.
@@aegisgfx Word. Almost propaganda haha
Yeah it doesn't work as well for fast motion. Still it works pretty great for medium and slow motion scenes. You could also combine techniques, by rendering your fast elements on a separate render layer in Blender you could let the AI interpolate all the slower background elements and then overlay just the faster elements, fully done in Blender. That way you will still save a bunch of time. The reason I made this scene is because it's a heavy scene (slow to rendeR) and has a lot of animated objects. Not fast moving, but still. It also has Depth of Field changes, which it also interpolates just fine.
Bravo many thanks
Thank you too!
magic!
Truly!
@@KaizenTutorialshi I do have a problem when I click interpolate after a few seconds it comes up with an error method saying:
Neither flowframes python runtime not system installation could be found
one of the reason it takes long is rtx 3070 ti has 8bg vs 3060 or 3080 that has 12gb ! I saw in a video that rtx 3060 was fast than 3070 because its ram capacity, even rtx 3070 has more cuda !
Yep, the 8gb is limited. Although if you don't peak the VRAM it doesn't really matter how much you have and doesn't necessarily increase the speed I believe. B
Yes very useful technique. I also do it with topaz video which is payed but sometimes slightly better. But if i would have known flow frames before buying Topaz i wouldn’t have bought it.
Thanks! Completely agree with this.
@@KaizenTutorials yeah if the program would also upscale like topaz. Topaz is in trouble.
Yeah there’s already some great free upscaling tools though!
this is great!!!
Thank you!
NVIDA should add DLSS3 to Blender, as it has motion vectors it would be better
Hmm that would be kinda sick yeah!
Hard to get a good feel of what the interpolation is doing as your UA-cam video is at 60fps playing back a 30fps video, so you're getting frame duplication. I wonder how this A.I. interpolation program compares to NLEs such as DaVinci Resolve's interpolation tools. I know I would have a broader range of codecs and containers such EXRs if I was using DVR. Any chance we could download your 15fps render to experiment with, please?
That's true! I never thought about that. But yeah they do actually look very similar if I play them side by side on my monitor here at their actual FPS. Check the comparison out here imgur.com/a/7Ffdxta
Davinci and AE's interpolation tools function well and would probably give similar results in this scene. But in more intense scenes, especially with faster motion, Flowframes is king. It does take EXR input but doesn't export it. I think there might be workaround, but I don't know those.
@@KaizenTutorials interesting. Thanks for the comparisons.
Davinci Resolve has this as well
Yeah and AE. But they’re all way less good than this.
5:50 you should use browse folder option and frames instead of making video
Yeah good one! I've done that since, it works nicely and stil leaves everything as frames.
Thank you for this amazing AI tool. Do you think a Dell Precision Core i 7 Laptop can render animations in cycles? (With CPU)
It can, but it’s not going to be very fast!
Hello, I was wondering what software you use for Compositing and color grading. I use Davinci and It does not have an export option for '12 FPS' So I'm stuck on this. I have a bunch of EXR passes I wanted to use for Compositing.
Doing the Comp/color grade after the flowframes wont work either since i wont have enough information nor the exr passes to work with. I would love to know how u do urs?
Idk how to use blender compositor and its way too slow for my system since this whole thing is about speeding up ur workflow and render time.
Hmm yeah that makes sense. I'm not sure if this is a suitable option for non blender-based workflows honestly. What you can do in davinci is to give your timeline a custom framerate (like 12) and render it out at 12fps. You should be able to do that and then use flowframes to interpolate to 24fps. However this way doesn't actually 'skip' frames, like I do in Blender so the result won't be the same. I'm not sure what the best fix is for this case...
@@KaizenTutorials found a fix for it. You can export from Davinci as PNG sequences in 24Fps(since its an image sequence fps wont matter anyways , except for a few nodes maybe I doubt Davinci's motion blur going to mess it up. For my case I used Vector pass for motion blur so it didnt matter at all). And finally put it back in blender and export as a video in 12 fps. The put it through Flowframes.
A bit of a headache workflow. But hey, anything to get that render time in half.
This is a huge help. But, if you want to become an environment artist or, say, show an environment like this, then you have Blender + World Machine + Unreal Engine... make stuff in real-time. and save a ton of time. even with 4090, this will struggle for hours... unless you're on that DUAL 4090, by the way, good luck with your power bills.
Thanks, haha! Yeah environments are notoriously hard on your PC, that's why I used it as an example.
Off topic: do you actually use the blender video sequencer for your final Renders? I have never gotten a good result,.. whenever i import the image sequence it loses contrast and looks washed out/ overexposed, somewhat like a double filtering,.. pointers are greatly appreciated, thx awesome video as always,..
I've exclusively used Blender's video editor to export image sequences for years. Never noticed any weirdness with it. It might be that you've got some settings going on in your export options, maybe a base gamma change, exposure change, look etc. Anyways for me it has worked perfectly!
@@KaizenTutorials thanks for your answer ,.. I just Switched to DaVinci resolve, since I ve never gotten an result i like, even after tweaking,.. probably one of those little clicks somewhere,,.
I will sub you, so you win your race! Keep on keeping you re doing an awesome job!
Probably yeah! Thanks, appreciate it. Hope I win. But if I don’t then I’m super happy for smeaf!
So now it's "A One," eh? Swell. Nobody knows what it means anyway.
Yeah this font’s capital I isnt the most legible, maybe I’ll change it to have a normal i
I wouldnt go for 3x but instead i have another idea. You can go for upscale AI model like Topaz labs and go from 1080p to 4K Footage with amazing upscale quality and save a lot of time. Then take that footage to FF and interpolate it.
That's another great idea! This was just 1 example, but yeah there's tons you can do with these workflows.
How about
EEVEE + Cycles stepped + EBsynth + Flowframes?
That could give some pretty dope results. honestly!
I just had a question. Can I use FFmpeg Video instead of PNG format for output properties?
You can't if you want to use it in FlowFrames. You can if you just want to export it. However it's riskier since if Blender crashes you've lost everything and have to start over. With PNG you can just continue after your last finished frame.