Old Footage to 4K + 60fps (Full Tutorial) 😮 [After Effects + DainApp + Gigapixel]
Вставка
- Опубліковано 8 лип 2024
- In this tutorial, Tom explains how you can easily use AI to convert old, black and white footage to 4K 60fps magic! No coding involved!
Get Photomotion ® 👉 integn.it/photomotion
For partnership and business enquiries: partnerships@integnity.com
*Links mentioned*
Supported GPUs: developer.nvidia.com/cuda-gpus
BFI footage archive: bfi.org.uk/archive-collections
Internet Archive: archive.org
DAIN-APP Patreon: / dainapp
Photomotion: integn.it/photomotion
DeOldify: github.com/jantic/DeOldify
Gigapixel: topazlabs.com/ref/487/
*TIME STAMPS*
0:00 Intro
3:49 Preparing & Stabilising Footage
11:31 Converting Footage to 60FPS
15:38 Colorise with DeOldify
18:39 Upscaling to 4K with Gigapixel
*FOLLOW US*
Instagram: / integnity
Facebook: / integnity
Twitter: / integnity
Helpdesk: help.integnity.com
Live Chat: chat.integnity.com
*WHO IS INTEGNITY?*
On this channel we talk about all things After Effects, motion graphics and photo animation. We create tutorials for beginners as well as advanced After Effects users.
** WHAT IS PHOTOMOTION **
There are a number of ways you can create 3D portraits in After Effects - some of them are more difficult than others. That's why we have created Photomotion - the biggest and most comprehensive photo animation toolkit for After Effects - to help you save time and increase the quality of your content.
New Photomotion update includes:
🚀 Portrait Projection - animate any face with the most advanced portrait projection on the market → integn.it/photomotion_portrait
🚀 Glacier Projection - create truly engaging cinemagraphs directly inside Photomotion → integn.it/photomotion_glacier
🚀 Mirage Projection - make your skies, smoke and water move realistically → integn.it/photomotion_mirage
🚀 Horizon Projection - professional 3D projection for truly photorealistic results → integn.it/photomotion_horizon
🚀 Parallax Projection - create stunning animations by combining single parallax effect with the power of Photomotion → integn.it/photomotion_parallax
THANKS FOR WATCHING!
#aftereffects #artificialintelligence #gigapixel #dainapp #deeplearning - Фільми й анімація
![[2D to 3D] Realistic Photo Animation in After Effects [FULL TUTORIAL]](http://i.ytimg.com/vi/jBu-H9x9tlk/mqdefault.jpg)
![[2D to 3D] Realistic Photo Animation in After Effects [FULL TUTORIAL]](/img/tr.png)
![ОРБАН приехал к ПУТИНУ и "отчитался" о поездке в Киев 😁 [Пародия]](http://i.ytimg.com/vi/_0ukDovOWq8/mqdefault.jpg)
Big work! Thank u
ТОПСИ привет
YES! I found these 1890-1920 videos yesterday and I have been obsessed. I already work with after effects and premiere, so this should be intriguing.
Thank you so much!! I was so confused as I tried to navigate this myself... you saved my life! ;)
mind-blowing... brutal, shocked I am, especially with the recolorizing method
For years I'm only familiar with frame interpolation. Only after watching your video I now acknowledge that near-perfectly denoising, stabilizing, colorizing and even upscaling is possible. Thank you very much Integnity!
😊
You sir, deserve a medal! Would love to see some VHS results.
Now show us what you can do with something tough, like late 1980s VHS recorded in ep mode.
Hell, I had an old (25 years roughly) 60 Minutes footage in 640x360 so 2x is 720p HD but what an absolute failure it was.
Step 1: Build a time machine.
Step 2: Travel back in time to the date desired footage was recorded.
Step 3: Knock camcorder off person’s shoulder.
Step 4: Hand him 4K camera.
Done.
Thats what I was wondering. If I can use old 1980s VHS footage and upscale it. But it seems like there is just too much noise in the footage for the AI to figure out what is going on.
Do these steps work on old grainy VHS footage or only very old reel footage? Reel footage obviously had much better quality than old VHS.
@@poshko41 p
@@andrewnyberg5726 I've gotten pretty good results upscaling VHS footage. I used Topaz video enhancer instead of Gigapixel, however
Thank you very much! Even though the steps taken here has many other ways of doing, this video perfectly showed me the ropes on how to do this. As for the otner ways, the way each step described in here is so smooth that you can do the things here with different software easily because this guy describes what the steps are for perfectly. For example I used Vegas for similar effects and came to a similar output just because he described what the step was for, again, perfectly.
edit: also one tip, if you have an older pc, just apply the effects one by one, I mean, apply effect then render then apply whatever on top of the render. I was having crashes trying to do them all at once but one by one is faster and crash free for me.
RIFE SAVED MY LIFE. i was going nuts for 3hrs with dain and IT TOOK 5 MINS
This looks interesting, definitely going to give DAIN a go. I've always converted the colourised, colour corrected version from Deoldify to 4K with ffmpeg.
I like the look of the results you've got
Use SVP to interpolate from 30 to 60fps. It saves time because it doesn't involve AI but the results are similar to DAIN.
thank you, i've been working on an old video document and trying to make a better quality of it.
Really amazing work😱😱😱
Good staging for the vlog.. loved
Wildly good video!
One of the best video in my life
I subbed just because your video tutorial layout is the best.
You can convert fps by SVP or AMF with some limitations, and gigapixel also works with CPU but slower. So you don't have to buy a Nvidia card, but it's still a better choice.
Wow, really thank you!!!
thanks for the subtitles, very interesting
really great thank you!
I can't imagine how much hard work you have done for us while making this video or is it just me who finds them difficult
its a lot of work for just a denoiser, its not possible to make it better than the source
Great job
you can use nmkd's flowframes which works on rife instead of dain for similar performance with much faster result
Loved it :D
Its a shame they didnt get to see color. Im glad i wasnt born in black and white
Lol
R/whooosh
@@sixty9inety Everyone got the joke dude
@@WGRF Everyone except Ultra-Charged Gaming
@@sixty9inety u wooshed urself smh
What the... this has been all a mindblowing train of things including the Photomotion shoutout at the middle. Didn’t know about this one.
Hope this hasn’t been beaten to death, but are you planning on doing also a FCPX/Motion similar plugin? I think it would shatter some floors over there too.
thank you so much for magnificent tutorial , and we are looking for AI tutorial videos for other things
thanks buddy
Any homemade UA-cam movie is great. That is something, lad!
thanks man
How does increasing the frame rate as the last step work out, if you have tried it? would it not massively decrease the amount of time it would take to upscale and colourise as they are only doing the 15 frames, then increase to 60 last.
DAIN uses a lot of VRAM, I mean A LOT! So to interpolate 1080p video you would need a GPU with at least 18-19 GB of VRAM. Or for 4K you would need 50+.
The team is working on it to get this down but with half precision.
So when doing the entire restoration thing best thing to do is to interpolate first. Cus the original footage is always low red. 240 or 360p.. and thats even doable with a 2GB GPU
Dawg you need more subs
Your the best man 🌹🌹🌹👍👍👍👍👍
Bro u are just awesome
One thing I do miss is cuda now I have an ATI card. But you can use Ati's fluid motion with something called bluesky that will actually do the interpolation in real time from 24, 25 or 30 fps to 60 fps. I would say there's very little difference between that and dain in terms of artifacts. Unfortunately I've not come across any editing software that uses this so recording the screen while mpc is playing is the only way I have found that works.
Crazy 👏👏👏
This is absolutely amezing, i was waiting & hoping for years for this to be possible , now finally that wait is over after 16 and 21 years,why 16 and 21 years you ask?
Well that’s because back in 2000, i realized that the gameboycolor could turn old old GB games into color by applying a colorpallet to it, nintendo costumized their colorpallets for their games, so from that point i knew it should be possible to turn B&W footage into color, based on the shades of gray and scene recognition,
Because everytime i saw a B&W footage, i could imagine everything in color,by recognizing wich color each object supposed to have ,for instance light gray can be associated with light blue while dark gray can be associated with dark brown,red or dark green etc,,,
While in 2016 we had algorithmia ,but anno 2021 we have deoldify👍👍🙏🙏🙏👍👍
the gameboy color didn't actually color the older games though
The color is superfluous here.
So all those 90s movies w the Feds upscaling crappy satellite images was real 😥
@IP2Cx Historian actually, nah. The techniques didn't exist back then. But Blade Runner was set on 2019, so that one might be xD
@@LtdJorge You don't know what existed then. The government has technology that you will never see.
Speaking of VHS footage like several people have mentioned on here, am I fighting a losing battle with trying to improve a video from early 2000 if it's one of those type with a lot of pixelation and undefined edges? Does it depend what it was recorded on in the first place? Like if it was taped on movie grade 65mm film or cheap, analog VHS video tape? Is it doomed to failure if the only copy you have is a file that has a lot of pixelations and choppiness on it. Without owning the original, is it probably not going to workIf you could help with any suggestions, I would greatly appreciate it
Your tutorial might be confusing for novices. The DAIN step where you remove DUPES. It's way easier to just use a Frame-Timecode calculator like omni. To calculate your initial frames. And then when in DAIN just for the first step you can right away choose mode 2 and hit SETP1 BUTTON. Output to a desired folder. Then take those frames and just create a temp video with any image sequence capable program that can interpret a custom FPS (which is calculated using your method). No need to output the "prepared footage" as PNG..
Good point Martin. We haven't tested it yet but I see no reason why that shouldn't work if your editing tool supports custom fps, which most of them do..
Integnity Thats not my point. I’m a frequent supported on the DAIN discord and we had a lot of confused people asking questions after watching your tutorial. Don’t get me wrong it’s an awesome vid. Just that small part where the steps can be mixed up cus you didnt explain that the dupes already get removed in the frames extraction (step1)
@@martinsawicki2716 TBH, that's exactly where I was scratching my head. Thanks for pointing that out. I'm stuck in that step...
Many programs of today don't support custom FPS. Everything is standardized to couple of presets. While old programs are fully customazible. Sometimes these things are just proof how we go one step forward with technology and ten back and so it goes to the point it becomes one standard without any options. And if you would need something more serious you either will need to toss out millions of "pro" equipment or write a new render code in python or something each little crap you do...
@@weirdsailorman4070 Really don't know what you are talking about. Programs that can be set to custom frame rates: Adobe After Effects and Premiere Pro and a free option is ffmpeg
Save! assisted from Brazil
wow!
This is great information. I like this flow. Thank you.
This video is a service to humanity. Thank you
when you do the 2nd stage of Remove duplicate frames you haven't shown what you actually pressed For the project to start removing duplicate frames.. Pressing the step 2 button doesn't start it, what am I missing thanks
Can you make a tutorial how to execute this tutorial? Gzz
How do you download the vintage footage from the BFI website?
Perfect!
Great video. You are definitely on to something. AI is the future in upgrading old footage to 4K. Show us a video with the new 2021 16” MacBook Pro with new M1Max chip or how to do it with the MacBook Pro.
I am looking for the same answer to your question above. Have you found anything?
I have an issue, as said in the video, I used the prefix "4K" when i processed the fotograms in Gigapixel. Now when I try to import the 4K fotograms to After Effects, it doesn't let me import them as an image sequence, can someone help me please? :)
Couldn't get this to work despite having more than required hardware.
Will stick to frame interpolation in Premiere, works well enough for me.
please upload more tutorials of Photomotion
You can find plenty available on our helpdesk 👉 help.integnity.com
Ooh I wanna try to do this on some old videos on my new channel. This is something I could learn this year :)
after you switch to mode 2, how do you start that process on the app?
Can you do a tutorial on how you animate the screen recording?
These screen recording zooms are done with our custom tool we developed for AE - will be releasing it to the public later this year.
Wait a verified youtuber lol
Very interesting tutorial and a great demonstration! It also got me thinking, if it's possible to convert 15fps video to 60fps, would it be possible to convert let's say a 60fps video to 340fps one for ultra slow motion with the Dain-app? What are the limitations and would there be artifacts if you tried to slow it down?
Good point. Definitely possible, will do some testing and subsequent video about it
It is possible. I made several slow-mo from 15 to 120 fps. It doesnt look as good as 60 x4 or x8 would be. But it does work. You need a fast graphics card tho or use low res video. I'm doing a lot with DAIN but I had to buy two TITAN RTX's
@@martinsawicki2716 This is really exciting. My graphics card is not that good so I can't try that yet but I'm thinking of upgrading my pc. If I do, I'll try that out myself. Thank you very much for the response Martin!
Is there a way to do this on a Windows computer without cuda in a virtual machine?
What computer can you recommend pls?
if you don't have Cuda GPU you can use an app called flowframes
Why do the interpolation first and then coloring and not the other way around?
3 days of this, and I was not able to execute neither one part of it.
12:15 I do always get a path error message even though I did name the folders as you showed us in the video
Check my explanation above. No need for the PNG output in Premiere. Just make a temporary video at calculated fps. And then use that in the 2nd DAIN process
Good vide for experts. For novices, after 2 minutes there are too many switching back and forth and then you get lost in the vortex of software names and settings.
That is why some people make the big bucks, and/or fame, while the rest of us are doomed to picking up dog shit in hopes it has a tasty kibble we can eat.
I want to do these but my specs are quite low for these to work
Hi loving the video..May I ask how you downloaded the BFI videos..I can't see anway to do so. Thank you .
yeah same here went to the site and I have no idea how to download footages
how do yall only have 4k subs?
WOW
I have question: Topaz AI Video include all these feature in one go (30 - 60fps, upframe to 4K). Should we use this instead of many other softwares like DAIN-APP? Which option has the best result in video quality?
can ja juse the for uppsale a music video to? i have a projekt to record a music video but my camera can only record 1080p with good auto focus but he klients wats the quality to be 4k
can you use sony vegas for this? (instead of after effects)
Sure, AE is in this case only used for for post production so anything will do, even Vegas
Fun fact: Film is already HD since the beginning.you just rescan it.same your film negative stock.you just reprint it.VHS is different story.
Wouldn't changing the FPS actually after the upscale and the colorization be more efficient ? Or did I miss something you said ?
@Sable Thanks for these explanations, especially as I also own a 6Gb RTX 2060 !
I must admit I didn't account the huge amount of memory required.
How do I sync the original audio say 30 fps video to the new video say 60fps without being out of sync. Can you please help me suggest using Premier pro or any other softwares
Use a computer built later than 2007. Only ancient computers put the sound out of synch.
Oh you mean sync, it was a bug on dain " Einstein ",while it was alpha. So don't be so jumpy just calm down and be nice
The video is the same length in time as is the sound track. The sound will still be in synch if you upsample 30 fps to 60 fps.
Video Enhance AI tutorial please!
DO the Feynman Lectures in physics
6:11 -- Wait ... sorry, but you missed a step here, I think. When we select "Mode 2" ... we need to click on "Step 1" again, or "Step 2" or on something else?
FFMPEG can remove duplicate frames with Decimate. It works great. No need to buy anything.
To create frames (interpolation) you can use FlowFrames AI based software. Free. No need to buy anything.
Recoloring should be done between Decimation and Interpolation, because it will have to process the fewest amount of frames.
what do you use for scaling
@@indiosbravos I use Topaz Video Enhance AI. For something like this, I would do two runs, the first for upscaling, using Proteus Fine Tune, with only heavy antialiasing and heavy dehalo, with the rest of the settings zeroed out. This won't make your video very defined, but it will add a lot of video information to be sharpened in the next run. The next run would use Proteus Fine Tune again, but this time, no upscale, as it's already upscaled, using deblur and sharpen, both on the moderate end, with denoise and revert compression worked in with it.
Workflow should be as follows. Step 1, remove duplicate frames using FFMPEG decimate. Next, use whatever program to add color. After, use Topaz Video Enhance AI to upscale. Lastly, use FlowFrames to interpolate the missing frames. Where possible, use an image sequence instead of video output, so you're not losing video data from step to step. Personally, I'm not really sold on the recoloring used here, but I'm not sure how good the options are to begin with. What I've put here, will provide superior results to what's shown in the video.
@@audioelitist3677 Thanks' for the tips brother, question, I'm curious why don't you use topaz's interpolation feature?
@@indiosbravos It does have the ability, but I've never really used it. Interpolation is a good last step anyway, to reduce process time. The few frames you're working with, the easier it goes. As Flowframes does interpolation, independent of other function, I prefer it. It's a good last step. What I'd like to see is a program that only interpolates duplicate frames. That would be amazing. Maybe if I got clever enough with FFMPEG I could figure it out.
@@audioelitist3677 hey brother, I appreciate the help, I tried your method and the result is great! I'm glad I saw your post, I've been searching the net for answers and I'm glad I found your post.
Could anyone help please? I am trying the Dain App to remove duplicates - but it seems to be doing a lot of interpolation and other tasks too, even though it is set to Mode 2 .so is taking an hour or so for a 15 sec video on Cuda. The flowframes did deduplicate and interpolate in about 2mins . But I cant get the flowframes to deduplicate only
Great video! I want to ask you: do you know any alternative software to DAINAPP that works with AMD video cards? At the moment gpu is out of the question given the prices
Most of these apps require CUDA therefore needs Nvidia. You can try this, but we haven't tested it yet: github.com/nihui/dain-ncnn-vulkan
@@integnity Thanks Bro!
Hddvd-revived have been doing this for over a decade.
In 16:54. Can I use Google Drive?
VideoColorizerColab.ipynb worked only 1 time after some attempts but then I couldn't use it anymore, I wonder what I do wrong, I am trying only to colorize videos shorter than 3 min.
All I want to accomplish is to use Gigapixel or Video Enhance to convert a regular color movie DVD (1956 Forbidden Planet) to 4K for my own personal use (I bought the DVD). Can this be done? John
How do I do this with films like Guyver Dark Hero
hey man really great tutorial you have just 1 major issue I am facing is I have only intel iris graphics card and stuck with it can you help with this.
You need NVIDIA (a fast one) for DAIN interpolation, the rest can be done with other graphics
try google colab
HI! for GTX 980 when I strat the DAIN APP it says the card does not supported and cuda 5 only would works.... ! What does it mean ? U use almost the same card , right? Thanks
I would say just ditch the DAIN app part and just render the video on premier or media encoder with “optical flow” frame interpolation. It does the same thing and it’s way faster.
Cool NoLifeShaq shirt!!
AI gonna take over the movie industry
Use Pixbim video colorizer to make it easier as video colorization step needs programming knowledge which is not easy. Nice video, Thank you.
pixbim colorizer helps as executing deoldify results in errors.
Crop the image after the stabilization, everything is going to run faster.
Could you elaborate?
Interested in knowing this as well.
I'm not the original poster, but: if you crop the stabilized images, then they're literally smaller. So everything done on them afterwards, will take proportionately less time. That'll save you just a few percent of speed, on each process thereafter, but as these things can take a while, that few percent might add up to a LOT for large clips.
i tried using other softwares like waiffu2x but i need cuda
How do you do this with out Adobe Premiere. What program can make a mpg sequence for free? Unfortunately Davinci Resolve can't make .mpg sequences.
Do you mean .png sequence? If so, Resolve should be able to import/export that.
@@integnity Import yes, export no.
Just download Adobe Zii and you’ll have everything
ffmpeg
hi man! i have a nVIDIA GEFORCE RTX 2060 but not gpu, its not enough?
RTX2060 is fine, better than the one used in this video actually :)
I want to do this for music videos uploaded in 2005-2009 before 1080p is allowed, then remaster them
There are some videos remastered by UA-cam but some of it never looks really remastered
Why most of the times of some error or success message, it literally freezes the program? The fault I can't proceed with anything is because of this, what a joke...
Edit: If you wanna reduce your headache, I highly recommend to do the "all the 3 steps" option so it does not give any messages in a middle of a important process. :]
How long the whole process can take to convert a full 90 mins movie ?
It would be better to use Topaz Labs video enhance because it uses surrounding frames as data for better results. Or am i wrong?
Possibly - based on our testing the results were pretty much identical. The main reason to go with Gigapixel over Video Enhance was that VE was being quite slow to split videos into frames via ffmpeg
Integnity oh,ok ill try it out
My dad recorded an old footage with gray and black and i wanted to make it smooth and with color