Better Than DAIN? NEW BEST Tool for Boosting Video's FPS with AI [RIFE/Flowframes]
Вставка
- Опубліковано 5 лют 2025
- Boost FPS for anime, stop motions, animations easily and fast with RIFE.
Increase video's FPS with this new AI! After quite some thoughts I think this is definitely slightly more advantageous than DAIN, which is really amazing!
RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation
RIFE APP FREE: nmkd.itch.io/f...
GitHub: github.com/hzw...
Paper: arxiv.org/abs/...
Project Page: rife-vfi.githu...
Colab: colab.research...
RIFE APP: nmkd.itch.io/f...
RIFE Installation Tutorial
• RIFE Video Frame Inter...
Today's Sponsor is Infinite Red
Infinite Red consulting handles your mobile, web, and AI needs
Check it out here: bit.ly/2UwddmM
This video is supported by the kind Patrons:
🙏Marc Schwyn, Mazen Alotaibi, Jason Nickel, Wampipti, Sascha Henrichs, Jake Disco
Support me on Patreon if you hope to see more:
/ bycloud
[Discord] / discord
[Twitter] / bycloudai
[Patreon] / bycloud
[Music] Steaminwaffles - Wait
[Profile Art] / bynicalcynical
Video credits:
Dog fight
• A Dog Fight Animation ...
Pumpkin
www.reddit.com...
Among us fight
• AMONG US FIGHT ANIMATI...
Green vs red
• Green vs Red vs Blue
K/DA - Villain
• K/DA - VILLAIN ft. Mad...
Check out the full K/DA - Villian 60FPS here: ua-cam.com/video/YZy6l2dBbR4/v-deo.html
Longer RIFE vs DAIN comparison compilation: ua-cam.com/video/2BwC_utLhH8/v-deo.html
RIFE APP with Windows exe is available for free: nmkd.itch.io/flowframes
Hi 🌍💯🔭
Anime
0:19 Cowboy Bepop
0:43 One Punch Man
1:28 Akira
2:23 Konosuba
3:19 Attack on Titan
4:08 One Punch Man
4:27 Jojo's Bizarre Adventure
4:34 Jujutsu Kaisen
1:00 to 1: 18 show name pls?
@@athul_c1375 It's not a show. It's a music video called K/DA - VILLAIN by Riot Games.
1:38 amogus
The movement looks sluggish sometimes
Ok, but Why
Should note the creator is planning on making a model to interpolate anime, fingers crossed it comes out soon!
Gay
gay
Awesome.
@@123495734 how is that gay? It depends on the anime. Anime stands for animation, that's what Japanese people call cartoons. Japanese people watch anime... Japanese cartoons are basically anime and anime is Japanese cartoons. So are you making fun of another nation's word for cartoons oranother nation's cartoons? There are many many different types of anime.
@@Stealthful_ gay
I have used this for a couple of days.The main two advs are fast speed and low gpu memory usage.
Are the results as good as DAIN ?
@@ifanmorgan8070 It faster than Dain but Dain has better result
@@faizyunus6618 Thanks. I think for my purposes (home movies) the RIFE is good enough. I honestly could not see a difference between them
@@ifanmorgan8070 For movies Rife is good enough but for anime DAIN is better 😁
Hey I need help, I’m trying to use rife but when I interpolate videos it only gives me the frames as Images not as a mp4. Is this how it suppose to work?
That's what I've seen with a lot of people just plugging interpolation into anime, they don't recognize that the low framerate is just going to make it so that it will hold the drawn poses for longer than the interpolation frames, because since the original footage holds onto a single pose for 2 or more frames, then the animation will still look jittery if the ai only creates an in between every other frame. to get a better result someone would have to first export an animation on 1s, then change the timing of the frames after the AI does it's job.
Finally some one who understands interpolation AI. It must be used with very intentionally and not as a crutch to save cost. It can hard carry slow mo action scenes and cloth physics but 24 FPS impact frames still should be done by a key animator.
Just look at CGI, barely any studios understand why just cutting frames down to 24 FPS doesnt make CGI models look better. Because CGI is a perfect model that warps and transforms perfectly to a perspective grid. It cannot exaggerate or hold a pose unless it it intentionally done.
This is also why scenes which intentionally have 60 FPS look better when interpolated, because the amount of detail that the audience can perceive is far greater, giving them more time to process the whole scene in question.
You can choose to remove duplicate frames, you know.
True but that is already a solution, you can "de-duplicate" the frames which I think mainly just fixes up the frames on twos, it is but of the software though not the AI Model itself.
Since it isn't exactly perfect as of yet, I think this has a lot of use for creative efforts rather than remastering efforts.
I've done a bit of animation work here and there, frame-by-frame rotoscoping being the most nightmare-ish type I've done, and the idea of possibly being able to skip out on drawing a lot of the frames in the less active scenes and yet keep the framerate consistent across the whole animation is pretty dang appealing.
I once did rotoscoping with morphing shapes rather than raster drawings, and that allowed me to skip frames, but the workload ended up being about the same as rather than drawing each shape, every keyframe that I animated had to have the pre-existing shapes morphed manually into the shapes of the next keyframe, sometimes the object moved too fast or at an inconsistent velocity thus requiring a lot of correction, and new objects that popped up had to have a whole new shape drawn in and manually morphed, every shape doubled the workload required for the next keyframes. Sure I could animate at like 12 per second and interpolate it as high as I wanted, but the in-between frames got really ugly going past 24 fps.
FOR ALL GPUUUU
DAMNNNN YEEESSSSSSSSSS
I had been using Hybrid, but this tool seems better and faster.
@@2BsWraith i wish i have good pc
@@pops7249 If you cant run RIFE then try hybrid, i believe it's easier on the system and compatible with intel and AMD cards as well.
@@2BsWraith can you send the link for it?
@@2BsWraith That's all i need to hear :D
For the given time,it is more than okay with higher resolution.I will check this one for sure.Thank you for the video.
you deserve more subscribers, brother
The only problem with Flowframes is you can't specify your output frames yourself, you need to choose the ones proposed on the list
I've noticed that with all of the tools I've used so far (dain, cain, and rife), they still sometimes have trouble with things like text on top of a moving object. Sometimes it treats the text as being a part of the object and warps it as the object moves.
Noted, thank you for your info sir
DAIN eat much vram and slow, but i'm stil impressed.
if you value time use RIFE
watching high-fps anime on the high-hz displays...
LETS GO
THIS! I NEED BUTTERY SMOOTH ANIMATION AND MOVIES/SHOWS
@@Unreal989 how to ruin animation 101
well thank you for this quick overview. it worked for a smooth camera motion from a Blender animation. finally i got this slow mo working
1:40 When the imposter is interpolated to 60fps 😳
Sus
among us is gay. overrated. never played it. never will.
@@intelgen7860 bruh you can't say a game is gay when you haven't played it. Just abouit discounts your opinion on it instantly
@@wilbofreeshan6340 Not really. I've seen enough to know it's transgender.
@@intelgen7860 Why do you keep calling it things like gay and transgender? Have your opinions on the game sure, but I'd be careful on the way you phrase it.
Wish I'd found this before starting a DAIN job. 7 hours for a 3248×2736, 67-frame, 15 to 60 FPS interpolation of an object rotating in stop motion. Granted I only have a 1050Ti, but whatever. Still preferable to doing the extra 300% of picture-taking work with my particular setup.
I still think DAIN is the absolute King, only huge drawback is the processing time. My brain is kind of seeing an elite "soap opera effect" when looking at RIFE processed videos
I wonder whats the newest algorithm right now.
I don’t think the technology will ever be perfect but it has potential as a tool to speed up animation work, the ai creates the base image and then an animator goes in to patch up the artifacts that the ai produces rather than doing it frame by frame. I don’t see it replacing parts of post production, rather speeding it up.
What a time to be alive
Underrated video, thanks mate!
Thanks a lot
Already test it, works good!
The issue with for example AOT is that the framerate of the background does not match with the framerate of the foreground.
This is usually a no go in frame interpolation. To get an actual clean result you need to split those two and do it seperatly. Also you need to do some artifact corrections frame by frame.
To interpolate the composition and expect things to be 99% clean without needs for correction is just... cringe.
I dont know if there will be a work around in future for such things, but Dain/Rife is imo not ment to be used on a endconsumer level, where you put 30 mins of film in it, click a button and fin, but within animation/film studios, where they are prototyping the scenes themselves.
give it 5 year and an ambitious studio whos willing to incorporate this tech in their design process, and anime will change forever.
anime should never go 60fps
@@entsu88 true.
@@entsu88 But it wouldn't harm for anime to be 24fps (since they animate at two's)
@@mrlightwriter Do you know anything about anime? Anime is not constantly animated in 2, sometimes it is in 1, 3 or even 4 and that's because the animator purposely decided to do so. More frames is not better animation
@@guancho9142 Yes, I know the difference between the different types of animations in anime. I was generalizing. In a longer answer, it wouldn't harm having the possibility of increasing the fps of animes (for the ones who want to see more fluid animation). Of course, animation in 1, 2, 3 or 4s is related to artistic choices and/or time and money contraints, and it should continue to be produced that way.
gonna boost the brain of this person cause alot of the artistic vision is lost when you boost legit everyvideo like some videos are rendered in 23 fps for a reason
I wonder if in the future, hand drawn animation (which drawn in 24FPS or less) that is AI interpolated to 60FPS would be standard in anime industry.
It won't, because it looks bad
@@Mqstodon i said "in the future", the ai technology would be much better by then... And perhaps there will be specialized ai for hand drawn animation
Oh yes, fuck timing, fuck intent, fuck the talent of an artist. Pls i WanT mORE fps 🤡
@Ekklipse What noodle video? Are you unironically using snowflake?
Also, it's fine for to be an experiment but animation being produced this way is bad for so many reasons.
@@guancho9142 Stop lying
It sounds like the creators of RIFE needs to use more frames to deal with quick motion. They already have the core so theoretically it shouldn't be difficult to do.
Well yeah this exact what I saw with DAIN. For scenes with high action and fast frames you are getting artifacts and for scenes with low action it looks smoother but is unnecessary because you dont really need more frames here.... . So basically it is a lost-lost situation... .
what a time to be alive!
Hi, 2 years later, is RIFE the best available option for frame interpolation?
still is gold standard
Quick question, where do you learn/find the papers you talk about?
was about to buy any nvidia card w/ cuda v5+ cores, man, you saved me from unnecessary spendings
hope an alternative of SVP can pop up really soon.
handbrake
Good thing is you can just use both, depending on whether you want to spend the time or not.
2:36 Often this is a problem but RIFE does it at the best I've ever seen.
RIFE is better than Hydrid ? 🤔 I have been using Hybrid to upscale movies to 60fps
Learn so much~ thanks😃
Me transforming and watching maybe all of jujutsu kaisen episode with 60fps: *"well hello there"*
Any update on higher achievements on Dain or Rife (now known as Flowframes)? - Paul
Is there any frame interpolation app for m1 mac gpu?
I wonder could this be used in video games to bost fps similar to how the RTX AI works
tried this in windows 10, had either crash, every second frame black, out of memory error, nothing worked , just amazing
i must say that i prefer DAIN with thier own Blur settings like the area and threshold config for better smooth movements of the background, even when RIFE has a much faster processing of all the rendering it still doesnt look as expected since there arent very much options in RIFE compared to DAIN
So if using this for 3d animation rendering (as a time saver), would it be better to leave motion blur off?
'Just a few more papers down the line' lol yeah 2 minute papers. GANG GANG.
thanks for this special video
Question about frame rate capability. What is the lowest you can go? For example, if I wanted to convert 15 to 24, can it do it? I don't need anything above 24. What I'm trying to do, is smooth out camera moves.
You can double it to 30 fps and then use openshot editor to export it at 24 fps.
Let's teach IA to convert 3D anime models into 2D to fill the gaps in the interpolation frame job.
One day it will exist an AI so good in interpolate frames, that you wouldn't even need a video, put a photo, it can be a guy running, a face or a building being demolished, doesn't metter... It will understand and create a random coherent movement using just a single frame.
There already is an Algo presented by NVIDIA not more than a month ago that does this.
Inspired me to start my own channel
Wonder if you could use this to enhance fps of games in realtime given a velocity map and exact coordinates of objects in each native frame.
No you can't that's not how it works...
Hey, Nice Video. thx for the Information. I got 2 Questions.
1. shell i wait for an update for this programm, so it will work for anime aswell?
2. Do you think an Intel 630 grafic card is enough for this master piece, or do I have to get a new PC/ Graphic Card? :D
Hace a nice day
I dont have nvidea device and i have a low cpu low end pc ..i tried this flowframes and it doesnt even render and causes too much error warnings
Or you can just use SVP, which was around for 10+ years, and do *all that* in *real-time* (or as a part of video encode, via an extra filter chain), on *any* resolution or output frame rate, utilizing pure CPU power (and add OpenCL on top of that, if it's supported by your GPU).
The end result (if you choose more complex algos) is more than pleasing.
Yeah, I tried to feed SVP a 3d animation stored in my computer and I was stuck. If I can't even load a file (no, I'm not computer illiterate), then the program is dead in the water.
@@mrlightwriter AviSynth scripts and command line, mate. =)
If you thought that there is a magic "Drag-n-drop here to make a 60fps video" button in SVP - I have bad news for you. For the exact same reason 3D modelling apps don't have a "Create a realistic dog model" or "Make me a futuristic scenery" buttons.
In short - "Zero IQ" apps _(drag, drop, press one button)_ are very handy, but severely limited, in both script/effect variance and possible ways to alter the source _(not to mention the output quality)._
For example, in the early days, I thought that the StaxRip app was bad and unusable, because I couldn't figure out a way to *properly* _(the way _*_I wanted_*_ - because there still was a "single button" option which I _*_did not_*_ want to use)_ convert a video using it. Guess how my perception of "usefulness" changed when I revisited that app a bit later on. =)
SVP and other similar stuff, and most apps in general, per se, *still works* _(worked when Win7 was still around, works now on both Win10 20H2 and 21H1)_ - you just have to put a bit more effort to it.
If you won't see the quality change, going from a "one button" apps to the professional ones - there's no reason to use an app like that at all. A common built-in _(in most TV's nowadays)_ "fluid motion" option would suffice your need then. It'll be a buggy output, glitchy in every way possible ... yet provide a 60fps output.
@@Vitaliuz Within Flowframes Video Interpolator UI, I tried RIFE CUDA and RIFE NCNN, with combinations of versions 1.5, 1.6, 1.7, 1.8, 2.0 and 2.4, but to no avail.
You referred AviSynth scripts and command line. Could you point me to some directions?
@@mrlightwriter Ever got SVP to work? If not I could try helping.
I cant figure out how to use this thing. it just kept downloading model file unet.pkl over and over again for hours.
In 3D motion graphic CGI, should you render the frames with or without motion blur if you want to boost the FPS? Which would yield better results? I haven't found any answers regarding motion blur on/off with DAIN/RIFE/CAIN.
You never really want motion blur, because it's really just an artifact masking technique. More clear frames will be a better artifact masking technique. So if you have a 30fps video, putting it at 4x and watching it in 1x or 2x speed will be more visually appealing, because you get at least 2-4 frames between every frame when viewing, which smooths out the video. If you just add blur to the frames, all motion will be blurry, especially when slowed down. The only time you would want blurring is if you have video with constant erratic movement that makes path prediction difficult to the point it has tons of artifacts.
seems animators should use this in the creation of their work rather than an after thought could help the in-between key frames process
Oh yes, because more frames is better, right? The inbetween of a machine are also much valuable. What an insult to animators
@@guancho9142 just take the insult or get with the times. There is a reason more and more movies are coming out with higher refresh rate. Leave the shackles behind
@@timonix2 1. These movies are FILMED in high FPS and not interpolated
2. The appeal of animation, especially 2d and stop motion, is its craftmanship. This is a fuck you to those animators who have carefully decided the timing of each scene
@@timonix2 Also I only know of a couple of movies who have come out in higher FPS and the reception was not exactly amazing
@@guancho9142 If a program can help animators get the job done faster, that's more time they can spend on the next scene. That's also potentially more time with their families. Any aid is better than crunch time.
i dont know, im render video 30fps to ke 60fps with subtitle but subtitle Little Flashing !!!
i hv question how to render with subtitle no flashing ?
its cool but nothing can beat that 3D depth awareness in DAIN
Is this a live application? Like instant use of motion interpolation like tv? Will it work with browser streams?
Is it good for fast Anime edits?
60 fps for animation without doing it at 60 fps would be so much help for our animators
24/ 30 fps is an art style. would hate to see "60fps" get slapped on everything for trend points...
Why not revise the interpolation algorithm into a plugin compatible with a variety of animation workflow platforms to be able to interpolate various animation sequences more efficiently?
The real value of this algorithm lies in what can be done with it right this very moment.
please help me . Its keep saying Download failed during thr interpolation
Don't know anything this guy said but I love it.
Do you think anything like this could apply for gaming in the future? I get that it's just for video interpolation and it needs a file to convert to 60fps but Maybe for things like game capture software that could smooth out the 30 fps games of last gen since sony and xbox only made like 15 next gen consoles.
Also great video. It was recommended on a digital foundry video about why destiny 2 can't run at 60 fps on ps4 pro using examples of frame interpolation. I was also looking for anyways to perhaps mod spiderman ps4 or miles morales to 60fps. Obviously no luck there but I was hoping frame interpolation could probably be an option.
Frame interpolation can already be done in real time, but it's a lot less refined looking. Something like this would not be good for smoothing out console frames, because it takes as much or more power than the game itself.....so you'd be needing more than twice the graphics power to turn 30fps into 60fps....which means you might as well use that power to get more gaming fps instead. On top of that, since games are interactive and rely on input, if you ran a 30fps game at 60fps visually, you'd still have the input lag of 30fps, not to mention since it's interactive, frame trajectory prediction wouldn't work without a second frame as a reference. How these work is they look at the differences between a first and second frame, then interpolate a third frame in the middle. With no second frame to interpolate, there is no prediction, so not only would you have a 30fps input lag, you'd also have a 3fps delay on top of that, or about 100ms visual delay between actions, which would make the game even less playable than 30fps without interpolation.
@@peoplez129 "but Maybe for things like game capture software that could smooth out the 30 fps games"
He never talked about interpolating frames in real-time gameplay, he was talking about game recordings.
Something similar to DLSS but for frame interpolation could be cool. Imo the problem is that games are not just seen like videos, but also felt, so if the motion is wrong it would be a lot more jarring
So, how do I use it on Colab again?
Im not the smartest lol
RIFE artifact (side effect) list
0:40 (square) boundary ghost
2:38 (foot) cross motion broken (fast motion broken)
2:51 (ball) small object / fast motion problem
Trying to use the (flowframes) experimental interpolation, but 8gb vram isn't enough for 1080p, and it only supports Nvidia. What's the quality difference between normal interpolation and above?
Love. all. your. videos.
Amv editors bout to go crazy
Can you combine all AI graphics into one system. Continuous graphics enhance into very very detail.
1:42 that is SUPER SUSSY!
yeah but there's literally an option on dain to turn off the depth for 3D media if you want
4:50 Is that a panda? ºwº
I want to see that comparison, where can I find it? :D
No, that's a cow, from the 1800s. It's black and white because there were no color back then.
can i ask if rife can convert 60fps of 4k reso video ?? i have rtx 3070 laptop ??
Is there anything similar that works on Apple Mac?
what about GPU requirements? Dain is super demanding when it comes to vRAM
When used dain it took my cpu to 100% usage and i got a "warning cpu usage" while in the app it shows the device to use is the gpu! whats wrong with dain?
Wait, so if I got it right, this is not interpolating in real time? Do I have to "upscale" to 60 fps before I watch a video file? Or does it work in real time?
Real time means the processing time is similar to the original length of the video,with a power gpu of course.
a vulkan error occurred during interpolation
How to fix this ?
I downloaded dain before only to be disappointed by the amount of VRAM it required.. I only have a 1060 6gb :( but now I can FINALLY USE SOMETHING YAY!
Using the flowframes I do get Error "Your GPU run out of VRAM!!.." after trying to use like 1.8GB of GPU ram ...no idea why but I do get this tried different settings limiting the max video input size but still the same pff
you need more VRAM then
@@2kDVI That's not the issue, trust me
does i get it right if i have an error of ssl/tls chanel in Flowframes - that mean i can not try to dain or rife?
So does this allow me to produce a new file that's smoother, or is it just for viewing in realtime?
For the AOT example, they should work on depth then mixing frames for a much more original and fixed frame, so if it cannot find a object, it can either motion blur or mix it, or mix the original with the frame
There's a reason people don't like interpolation on these type of things. Anime just doesn't work with the way frames are held for more than one frame, its practically turning the once normal animation into a weird, janky, frame by frame that looks terrible compared to the hand animated project.
I fully agree the way they animate on twos for the characters but the background moves on ones is very bad for interpolation.
cuda wont work it keeps sayin ran outta vram even tho no other program is using my 3060
Is there a way to use flowframes on iPhone ?
Where will be the output file of colab
What about SVP?
I kept getting this error.
RuntimeError: unexpected EOF, expected 1826598 more bytes. The file might be corrupted.
The rife Google colab has an error please help
Can we use face frontalization
You are wrong RIFE can process what your computer can handle. I have used AI to upscale videos to 8K then I have used RIFE for interpolating to 144 fps.
do you know if the FR can go higher than 60fps?
Tutorial on how to use rife?
Let's say that I render 15 fps and I render a 30fps depth map image sequence, can use it to get a better result out of rife?
I would say that I like that artifacts on anime... I don't know, it makes a good looking art style to me
does DAIN or RIFE work on a mac m1 or m2?
Is there any PC game implementation for this?
There are so many PC cutscenes that I've wanted to see in 60fps for so long
Just record it and process it. There's probably a lot of good YT 2 MP4 converters if you need that too
@@zyxwv in the 4 months since I posted this, I also found out some editing software does it themselves, and a pretty damn good job too
I've used it quite a bit in some of my videos this year and it looks like true 60FPS