We Remastered My First Video in 4K!
Вставка
- Опубліковано 1 тра 2024
- Thanks to MSI for sponsoring this video!
Buy an MSI Creator Z16P Laptop at msi.gm/creatorlinus
Learn more about the MSI Creator Z16P Laptop at msi.gm/CreatorZ16PLinus
What's the worst that could happen when trying to upscale compressed 240p footage? We're going to remaster our first video and find out!
Discuss on the forum: linustechtips.com/topic/14187...
Check out Topaz Video Enhance AI: lmg.gg/OtkN9
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
► SUPPORT US ON FLOATPLANE: www.floatplane.com/
FOLLOW US ELSEWHERE
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00-1:54 Intro
1:54-4:06 First run-through: Nightmare Fuel
4:06-5:40 Why it looked so BAD
5:40-8:13 Remastering my firetruck video using VEAI
8:13-9:18 How VEAI works
9:18-9:59 Watching the finished product
9:59-11:11 Comparing to the original
11:11-11:54 Conclusion and use cases
11:54-12:42 The MSI Creator Z16P - Наука та технологія
You probably would have had better results using the Proteus model. In my experience Artemis heavily smooths and makes things look 'painted'. The newer Proteus model is genuinely amazing though and offers much more control over denoising, sharpening, anti-aliasing, etc.
Footage as low as 720p. Dude, 720p is still high resolution for me. 😂
Right? This is classic LTT half-assed results. I use VEAI in combo with several other programs while reworking videos and you can take 480x270 macroblocked to hell video and have it come out damn near DVD quality or better. Depends on the source and how much effort you put in.
Honestly, his first video is more than high enough quality for extremely good upscale results.
But that takes effort, I guess.
Tbf these are the same people using ZFS on top of unraid (or were...) and constantly lose their data.
yep auto feature on proteus works so good. No need to adjust any settings that way... Although IMO removing the noise completely takes away the details in the video. linus' old video looks like it was smoothened way too much. They Should've atleast previewed the sample for a minute before they rendered the whole video.
Hi Harry o/
like your videos harry :)
The issue is not the resolution or the interlacing on that first video. It’s the compression. 240p with zero compression would probably do a lot better.
Yeah, I was thinking the same. Compression creates distortions like shown on the video, and enlarging the video by adding pixels also makes the distortions more visible. Would be interesting if they downsampled something that they have uncompressed to 320x240, and try the same method as here.
Isn't it all just adding up though?
First it has to deal with a serious lack of pixels, then it's interlaced so every frame only consists of half the image and then there are compression artefacts all over the place on top of the interlaced frames.
@@klasta69 Sort of, but the compression is essentially creating new information that confusing the AI. If we simply remove data, such as removing every second line or reducing 8 pixels to 2 pixels, we can do a reasonably good job of interpreting what those missing pixels might look like. Compression artifacts make that much much harder since the AI has a hard time telling the difference between what is real detail and what is "detail" created through compression.
as a user of Topaz for 3 years now that is totally true, a raw high bitrate 720p has more potential than a 1440p low bitrate video, it's all about bitrate
So it's not even 240p, its 240i
4:10
I've had such a fun time watching this video in 480p
Me watching in 240p 😐
@@amaanazwar9895 hi!
A true madman
@@amaanazwar9895 I’m watching in 144p and it still looks amazing
boutta say lol. i watched it in 720 😂
Please do more of this type of video! Would be really cool to see you guys look into the tech being used to remaster historical footage such as what was used in They Shall Not Grow Old
Ah, you mean the one that Peter Jackson did?
Young Linus looks like someone that would recommend me a Celeron for gaming.
hah! 😹
Maybe Celeron was hot stuff back in the day? /s
Did you just copy someone else’s comment? I mean why am I even surprised anymore.
Nah an AMD Athlon slot 1 Bro.
Atleast come up with a original comment instead of copying. Oh well, that's too bold of me to expect anything original from a bot account.
this ai has helped me with CGI render times. simply rendering at a lower resolution and then upscaling with the ai, saved me hundreds of hours of rendering.
very interesting method, love it. i bet it gives a sort of distinct "style" to your product too bc of the ai randomness.
i would have thought that would take longer lmaoo
@@SomeRandomPiggo not sure what settings ive used but it def only takes like 5-7 seconds per frame. im mostly upscaling 720p/1080p to 4k. (using a rtx 2080)
@@dylanlockemp3 not bad at all, some cycles frames can take as long as a few minutes for me lmao
@@SomeRandomPiggo do realize that for rendering a CGI scene you need to calculate lighting/shadows, the objects and their textures while with upscaling it's just pre-existing pixels
I feel like the real breakthrough will be when AI is able to incorporate external references. For example, upload the 320x240 video, but also the NCIX logo, a few good pictures (or 3d model) of the cooler and motherboard, and maybe even a photo of Linus. Then it can use that data to extrapolate more intelligently.
That would be scary.
That would be epic and very cool
So vcd will look 4k
Isn't that kinda what dlss does using motion vectors
That is a great point and a way to bring information into the system that is not present i the video!!
My issue with these algorithms is that they are never as good as your brain at interpreting what you are seeing, and the changes they make end up further obscuring some details from the original footage.
5:30 Never thought I'd see the day a Southpark Linus would be so good! 🤣
this is how i see all canadians
2klicksphilip made an in-depth video on his use of Topaz Gigapixel AI. He specifically goes over how to bypass the negative effects of interlacing when using the upscaler. His video is called "Upscaling my Videos using AI". He could probably masterfully upscale your first video. Definitely try to get in touch with him.
man that guy does everything
I think Him and Taran would get along very well
interlacing not only makes the AI do weird things, it also kills the compression quality.
Reminder for myself to check that later
@@talha.4983 Nah not really, he does csgo, upscaling and lens flare. And, he's (soon going to be) the first case-unboxing millionaire.
Proteus fine tune almost always gives me a better result, even when then defaulting to auto variables
0:35
Wow, that was a clever way to rickroll us...
Now Linus Tech Tips is Rick Rolling us, getting influenced by Mrwhosetheboss
Lmao
He's to dangerous to be left alive
A certified mrwhosetheboss classic
@@tmcg225 indeed!
and I see nothing wrong with that
Unusually if you were upscaling something, you would go scene by scene and pick the best method for what was being shown, and then re-edit them back together. Not just pick one mode and then hope for the best. It is cool tech though.
I use this software and it does not work like that as it renders one file at a time (you can queue files each with their own optimisation settings). If you were to manually split each scene then yes I agree.
@@Dimmers do you use it at work or just as a hobby?
@@Dimmers Yes, you would manually split it.
@@Jehty21 work
@@Dimmers what kind of work is that?
Because I struggle to see where this tech would be used.
YES! Very cool this finally got coverage on your channel! I wrote to Topaz (presumably before development began) asking them to make this software, and and I got to private test the alpha version of the AI. It was an online service only at that time, so no front end GUI running locally. Cool to see how far its come since then! Gigapixel at the time was ok, but slow and not temporally coherent, which was the main thing that prompted me to write to them after seeing the results of the older FMA 2003 upscale attempt
Also, I don't know every exact detail the coming D-VHS video will cover, but during your research and writing, would you take a quick look at LD-decode, even if you don't mention it in the video? Its a really interesting project, one that I haven't undertaken myself, but VERY intriguing IMO. Its for VHS too, not just laserdisc.
cheers :)
I just lost a bunch of paintings (along with my apartment) in a catastrophic flood in my town (Lismore, Australia). Some of them were for an exhibit I have coming up, and I was able to use a few programs of the Topaz software suite to upscale and sharpen some of the pictures I had which weren't on my phone (phone and camera got destroyed by the mud and water). It has absolutely saved me as I've been able to print the paintings I had, and work further with them making works which reference the flood itself.
1:05 in the video, there is a very slight sound of the Samsung notification chime. 😎👍
YUHH
I thought that was my old phone and I walked over to it to find that it was dead
0:57 MOTHER OF INDIE HORROR! WHAT IS THAT?
Love that this was done on a laptop. I am way more excited about this knowing it's done on average customer products not a monster computer, they do other projects on! Thank you for making this video!
With a starting price of $4k+ it's not an average customer product.
ya a labtop with a 3070 in it. thats not consumer friendly in the slightest considering how hard it currently is to even get that gpu anywhere near msrp atm.
@@zeroa69 dude laptops with rtx 3070 are £989. Not utterly expensive.
A handy tip for upscaling videos like that old one is to upscale it but then view it at the original size.
Proteus is really the way to go with VEAI, at least most of the time. It lets you fine tune all sorts of things, from how sharp the image should be and how much noise needs to be removed to the strength of compression artifact removal. Also a CRF of 0 is insane, you'd be fine with 14 or even higher.
yeah, a crf value of 0 means the video is completrly uncompressed. looks like they didn't understand/know much about what they were talking
Proteus Fine Tune is 100% the way to go. Use the suggested settings to get you started then play with every slider individually. It definitely takes time to get some really solid results, but it is possible!
Only CRF 0 if you're running it through multiple times, but then at that point, just use 16Bit Uncompressed Tiff for maximum quality 🙃
imagine a youtuber talking about color accuracy and stuff yet knowing nothing about video encoding >
@@NickByers-og9cx definitely! artemis seems like it's just proteus with set settings for each scenario. you just have to mess around with proteus to get good results. also sometimes it's impossible to get solid results with some footage, and the only thing you can do is remove compression artifacts and set the resolution upscale value at 100%
I usually run a crf of 16.
Linus a co-worker and I did a project like this on and off after work in 2019 with a few of topaz studios programs and a video split and merge program we found in a blender forum. It was still very time-consuming using his Ryzen 5 2600 with a 2070 super and my 9900k with a 2080Ti taking just shy of 1 month processing a batch of frames for 8-14hours hours every other night. This was so we could still use our machines to game and create. The stock footage was an old 240 or 360p video of an infamous Holiday Special involving space to watch together for a holiday party. We did this by breaking out every frame and testing what looked best upscaled, sharpened, and denoised with a few different environments from low light, high light, low, and high action areas over a week. We then had few other coworkers help judge what looked best for the settings we would then run. In the end it was upscaled to 4k per frame with our magic settings for different scenes then merged it back together. NEVER AGAIN lol
that's a hella smart technique you did !!
1 month?! that's crazy!
2:22
Linus (internally): don't say acid don't say acid
@5:20 you made me blow milk out my nose.
I wasn't even drinking milk!😂
Hah, definitely wasn't the right model for it, BUT Video Enhance AI is freaking awesome. I used it on VHS tapes and had decent results on some tapes w/ the DV/Analog methods
Also FW900 my forever unattainable holy grail T_T
Hey EposVox :)
I'm curious - Did you use a broadcast-tiet VCR when sourcing the footage?
Have you tried VapourSynth before? It's really popular in the anime community for restoring or improving anime. But I guess you can use it on anything.
anybody know how to convert black and white to colour ?
Yes and no. Ai has its limits. Also he mad e a mistake in doing 4k upscale
I use Topaz' AI upscaling for a lot of my 3D renders. It takes a lot of time to render 4K or even 6-8k video. It saves me so much time to upscale rather than wait DAYS for the render in a higher resolution. It's not perfect, but it's great for any online content that will otherwise be compressed.
now if only GPUs could do that in real time while you're playing a game. oh wait... that's DLSS
@@tim3172 don't soil this comment section with facts!
@@tim3172 I hope for a future where we can get results like Proteus on DLSS 7.0, if it's still called DLSS by then
I love topaz video ai. I've been using it to remaster old home videos recorded on video cameras back in the 90s. Once you've got the settings right the results are insanely good.
I've been doing it on a RTX 3070 and it's been awesome. I dug out some old 8mm films from my grandparents attic a few weeks ago and have a wolverine reflecta on standby ready to scan them and those will then be run through topaz to clean them up and scale them to 4k
Yeah, Topaz VE is amazing. I was filming some interviews for my company last fall, and it wasn't until the editing stage that I noticed that I accidentally shot all the footage at 640 by 480... Luckily, I was able to upscale everything with VE and I even wondered if I should shoot everything this way, saving space on my memory card and upscale only the footages I'll need later :)
It’s amazing how far Linus has come
He is the nerdy pew die pie from You tube...
@@velardechelo yes pew die pie from You tube
it's pizza time
@@iBlaze69 You tube from pew die pie
Yeah, he used to look so blurry.
5:04 just casually flexing with that mint condition fw900
oohhhgh i w,ant it
i guess that a review of that monitor is coming soon
Looking at Linus's first video I realised I have been watching him for almost half of my life. I did my only gaming rig when I started Uni, using his advice, and about 13 years, later, married, 2 kids, the whole shebang, still watching Linus. The crazy part, apart from my family, there isn't anyone in my life right now that I know for that long.
Have tried Topaz and genuinely considering buying it for my other channel. The results are incredible, especially if you're using the proper model for the type of video etc.
You guys could do a whole thing on these history documentaries that upscale and add color to REALLY old footage. Highly recommend the WW2 documentary called Apocalypse
do you know any software that adds colour to black and white videos ?
Old footage is just taken from the film print though not really upscaled
I've been using topaz's suite for about 6 months or so. I've mainly been recovering old UA-cam videos (muppets) and vacation footage I took on a really low quality digital camera back in the early 00's.
The key to getting decent output is realizing the limitations of the software and keeping your expectations in line. Except for special cases like animation, you can't really expect it to do a quality render at more than double the existing resolution. The film grain option is there to hide the problems. Were conditioned to like the film grain effect, and it hides things like the blurry carpet. For the carpet scene I probably would have split the original video apart and dealt with a different cuts what's different settings were possibly even different models.
Interlacing on a low res piece of footage just basically the kiss of death for it. The software can somewhat improve the interlacing it can improve the video watch ability, but it's not going to make it look great.
I've been working on the old Madonna music video "like a virgin" I have put way too many hours into that. I have it up to the point when you're watching it that you're not looking through the fog to try to figure out what's in the scene, but I'm hitting this uncanny valley limit where I make it better and the stuff that's in the fog doesn't look euclidean anymore.
AI up sampling is absolutely amazing, but it's only good if you don't scrutinize it. It's the same with still images. The overall effect of the picture is stunning, but if you up sample something load of 4K and then start zooming in you start noticing weird artifacts. If you don't look for them they're fine.
The craziest thing about this video is that sick shoulder roll at 2:55.
I'm new to this but love upscaled 4k remastered 60+fps stuff.
I'd like to know where I can get a dummies guide to convert old vhs stuff to 4k remastered 60fps?
Also how I would do it with a downloaded 4k movie...would the quality and/or conversion be easier if I got the hard copy 4k dvd movie and converted off that instead of the download?
Thanks
DVD is not 4K. It's 640x480 or 720x576. Using DVD will get you a better quality than using a downloaded file in the same resolution because DVD has higher bitrate.
Upscaling VHS to 4K makes no sense. There will be too many artifacts. Upscale to Full HD.
To do that you need to learn basics of video editing (deinterlacing, smoothing, sharpening, fps conversion, syncing audio with video etc.), get a super fast graphics card- like the newest GeForce, buy upscaling program, prepare lots of space on your SSD/HDD disk, get a decent VHS player, plug it into your computer's video grabber and wait a few days for it to process your tape.
@@ziomalisty very kind of you to reply with the information you have given. Have you done a video on it? I heard of a upscale program called "Topaz" that's meant to be good for upscaling and doing 60fps etc. There are alot of programs out there that Promise alot and dont deliver.
Cheers. And thanks again
@@deputyvanhalen6386 No, I don't have a video. Topaz is pretty well known so should be quite fine but this is just a program to upscale. Before you upscale you need to prepare your video. Most DVD and VHS movies are interlaced and have quite some noise. You need to use a video editor to remove noise and deinterlace your video. VirtualDub is free and might be a good starting point. AviSynth is also great.
@@ziomalisty thanks for the advice.
Thankfully DVD and VHS are already 60fps (50 for PAL) so you dont really have to "upscale" to 60fps
I've played with this software. The best results I've had was in incremental treatments. I have tested this on 2005 clamshell phone videos and it's pretty incredible.
For me a good option was first use the high compression setting and *keep* original resolution (it really helps). Then I go for blur or a more advanced setting and then once more while increasing resolution as well. At least 2 or 3 passes will bear great results.
But you need a very good machine...it will run on a gtx970 but you can't expect to do more than maybe 10-15min clips as it's gonna take a day per pass.
They also have a picture enhancing software and it's very very very good. And when it's not, it's still okayish but still good all in all. Can't wait to see that tech in 5 years.
one thing i do is go from 854x480 to 2160p, then apply a high quality downsample to 1080p.
You know, I think I would be fun to see an occasional remastered "retro" upload from time to time
linus retro tips?
Linus is always 4k in my mind
Looks like it's got a hard time distinguishing between textured surfaces and noise.
The ribbed grey surfaces at 10:39 are a good example, it just completely smoothed it out.
It also removed details from the red chassis, ex. the marking above the crane outrigger foot (or step ladder?).
This makes me wonder what it would look like with old gaming videos, since it's trained primarily to upscale real life footage
Alternatively (and possibly even better) what if it could be trained to specifically remove h.264 artifacts?
Don't know if it's the same algorithm or a competing one but I've seen upscaled 60fps anime and it looks horrible. It looks like they played the footage through vasaline.
didnt they use some kind of upscaling in the infamous gta trilogy ''remaster''? didnt work too well
@@hiurro That's because almost all animations are intended and drawn for specific frame rates. If you run something like that through the same algorithm that is trained on IRL footage which doesn't have an "FPS" then it'll obviously give dogshit results. It'll probably be a lot different in games though.
no need for it, there's already things like dpir, you can kinda easily remove simple artifacts like from h264
There are other softwares for this too.
Linus just summarized my experience as an image processing ML engineer in 12 minutes. Good job guys!
For interpolation the best thing imo is something called tvp, it’s ran by a single person but it produces results far better than chronos models
Interesting. Will have to look into it.
I have the Topaz upscaler for photos. The results, when you tweak it, saved a ton of images from a HDD crash where I had lower res thumbnails. Pretty good stuff.
I use it for digital DND tokens and upscaling certain assests in vtt builder when necessary. Also used it to upscale ultrawide or super ultra 1080p to 5140x1440. Magnificent results and topaz keeps getting better
You didn't talked about the remastered footage having "glitches" on the firetruck ladder around 10:19 ! How could anyone miss that 🤣.
That is awful when you notice it !
Yeah, I can see it zipping back and forth; looks like it's having trouble judging the speed of repeating objects.
it reminds me of old z-fighting textures lol
Yeah, this should've looked way better. Seems like they didn't take much time to research the topic properly. I expected them to actually reach out to someone who can train a model just for them based on their newer videos.
basically because they upscaled the artifacts as well
@@MyNameIsBucket that was caused by the 60 fps conversion though, not because of the upscaling
I can't believe I've been on your channel long enough to remember the firetruck video when it was first published. Jeesh, it's been a while
I was an early adopter of the Topaz AI suite, it's amazing how far they've come since the version from only a few years ago. in a few years i wouldn't be surprised if this was good enough to use in production
0:38 WAIT.. that exist? Hold on.. Pause the video and going to search for it NOW (sorry Linus, your first video in 4K can wait.. .)
From my experience when you upscale a video, or really anything at all, it’s better to go incrementally. If you start with a 480p video you’ll get better results upscaling from480->720->1080->4K then trying to go straight from 480->4K. I deal with converting analog and digital videos everyday in my work.
Do you have some samples to demonstrate? You could upload them right to UA-cam. It would be good to see someone who knows what they're doing instead of sponsored amateurs just saying a product is amazing.
You don't have to answer this but what do you do for your job that requires this?
@@EJD339 I’m an independent contractor who does live visuals for shows and festivals but I have a degree in electronic integrated arts where the bulk of my research relates to emerging and obsolete technology more specifically focusing on analog and digital computers. I work a lot with analog video synthesizers which mostly operate in ntsc(some pal) and have done tons of digitizing and upscaling of analog content and have tried tons of different hardware and software based upscalers. The bulk of my findings regardless of what type of upscaler you use is that working incrementally typically yields a better result in image clarity compared to just going straight from an sd image to 4K. Currently I’m developing digital software that replicates analog phenomena.
Strange. I'd thought more conversions would lead to a loss of quality?
@@Vel_Plays_2.0 Not necessarily. Especially if there's digital noise and artifacts in the original video. Upscaling those all at once causes a ton of messy results. But cleaning them up a bit and then upscaling again can make the process better. However, you can easily end up losing details that way, so it's pretty tricky.
Avisynth with NNEDI3 (Neural Network Edge Directed Interpolation 3) for upscaling and MVTools for linear interpolation (frame rate conversion) is still a better alternative.
hey man, ive been searching for a non-ai frame interpolation program for a while now. would you kindly link me some tutorials on the setup and usage of avisynth and MVTools? i don't want to use Neural-Network based apps like flowframes, nor do i want SVP thingamajigie either because they are shady. and multiple sources point to avisynth and mvtools to being my best option, and i am not the most tech-savvy guy either
No problem, it's possible to use non AI upscale too, there are several resizing kernels but the best one nowadays is Spline64Resize ().
The problem with Avisynth is that you gotta be able to code, but a great place to start would be Doom9 (the international encoding forum) and of course the Avisynth Wiki. AVSPmod mod is also a great IDE to check the preview of what you're coding. If you feel more like a GUI kind of guy, instead, you can use the automation tool I maintain called FFAStrans and create a simple workflow.
@@frankbucciantini388 wow, thanks a lot man! and FFAStrans looks really cool and something i could manage to use
testing a both kdenlive and davinci resolve's frame interpolation, i can say that kdenlive's way of doing it looks way better than resolve's.
Kden - setting framerate of project to 60, and just letting kden handle it when rendered. looks exactly how i want it, no perceptible artifacts!
davinci - retiming settings to optical flow on the project, it took a lot longer AND and nasty artifacts exclusive to ai-based frame interpolation like DAIN, RIFE, etc.
do note that this was on MY particular use case which was quake live footage 30 to 60 fps.
I would have appreciated seeing this in action with the original no UA-cam processed footage.
Also what I find funny about the “Never going to give you up” video is that was shot on film. Now a days a retransfer of the old film reel may have been even better.
Does anyone else find the bits in the recent few videos, where Linus does the South Park impression of a Canadian, absolutely nostalgic and hilarious? Haven't seen any mention of that in the comments. It is so spot on as well, good job.
It's kind of freaky to see how far Linus (and his team as a whole) have come over the years. Linus's entire personality has changed completely since the start of the channel.
Too bad he still doesn't understand computers. That LIEnus video was a real bombshell.
Lol I wonder what April 1st video gag they'll go with this year?
@@XenZenSen wdym he doesn't understand computers?
@@jorisramanauskas780 watch their april fools video from 2020
Is this the original comment that was copied by Nub?
Copied comment?
We use Topaz tools all the time at our print shop when clients send us photos from their phones (or even from their DSLRs). Pretty much everything that comes directly from a client, rather than in-house photography, is going through one or more Topaz tools before printing.
I've been using this myself and its totally worth it. The only problem is most people don't mind if the video quality isn't ultra sharp if they can still make out what they're watching.
I've been using VEAI for about a year or so, and it's hit & miss when it comes to upscaling. I mostly do music videos, but I've done a full movie in pretty great results. It's usually best to get rid or artefacts before you upscale, or they will be upscaled as well. Frame rate upscaling is still in its early phases. It will often add artefacts if you pay close attention. When it works well though, it's awesome.
Topaz is awesome! I have been using it for about a year. It has been getting many updates that are improving it each time. Sadly my GPU is kinda limited to take advantage with videos more than 720p Upscaling. But in future, it might do the trick.
Interlaced images are not just striped, each frame contains half of the next frame and even and odd lines are not aligned to help perceiving a smoother frame rate.
There's a UA-cam Channel called 2 Minute Papers that perfectly showcases quite the variety of video upscaling. I believe pattern recognition now does a whole lot better by recreating us from ultra-realistic 3D models and by treating the pixels like a mega-zoom lens for capturing the fine details like the James Webb Telescope whereas every small movement is an enhancement the more time passes.
Gigapixel AI (for still images) have same limitations but when it works results are incredible.
I love this software. I used it to upscale to a old movie that was only released on DVD (480p) to 1080p and the results were awesome. It's a movie that my family loves and I shared the results with them during a movie night. The overall consensus was a lot of praise from the family. I'd highly recommend a card with more vram if you can. I've seen the application use north of 12 gigs of vram when I really push it.
What software?
suprised he didnt comment on the ladder at 10:30
I've been using Topaz tools for a while and they are outstanding. Literally the best at upscaling.
From my own tests the Proteus model seems to give the best results, most of the time atleast. Depends on the resolution.
"Corporate needs you to find the difference between the two pictures "
Me watching this on my phone's 480p display:
"They're the same picture "
My bet is that in the future, remastering this video will wind up looking pretty darn good. I would think logically that instead of doing 1 frame at a time, it really needs to take the entire video as aggregate and process things into objects so that it identifies your lips and combines all clips with your lips and your eyes and your shirt, etc.
Topaz labs is pretty amazing. I upscaled a movie of my grandparents from the 1930's and it did an excellent job. My relatives were all impressed and amazed
Can anyone tell me how the frame rate conversion is better than optical flow ?
it jus is
8:25
I can imagine that techs such as this could likely be implemented as part of video compression algorithms in the future, if the algorithm can be optimised to run in real time, or if hardware improved to such extent that AI upscaling can be done in real time.
So rather than trying to upscale a low res video, it'll be more about being able to compress the video by reducing the image to lower resolution, and then upscaling the video while it's being viewed, presumably it could mean that it can retain higher quality image than with current compression technologies for smaller size.
Actually, how this will work is a Coder and decoder AI will be trained together. The Coder AI will make stream of Data and the decoder AI will then try to recreate the original using that data. This will allow the coder AI to know what data the decoder AI is able to guess at and the decoder AI will learn to guess at data from the Coder AI. They will also be limited in the amount of time they can spend per frame using a given minimum hardware. However, they can be trained to do a better job given better hardware and more time using the same data. Some trade off on a bit of extra data for better result for better hardware could also be made.
I am curious how well 1080 or 4k would be getting an 8K upscale.
It would be useful if you need to crop into your footage but want to ensure it is sharp.
Thanks for making this very informative video.
Linus doing the South Park Canadian flappy mouth thing made me laugh too hard, guy...
Any chance of a 2022 Scrapyard Wars thing? (of course it'll all be about GPUs...).
As a professional photographer, been using Denoise AI and Sharpen AI for *years.* Gigapixel is the real deal, or as close to it as you can get. Also, they offer a one-time license purchase, none of that subscription garbage. I'll happily pay for that.
[This comment was sponsored by Gigapixel]
@@SteveDice21 Not really, You have no idea how many unusable shots I've salvaged with Denoise and Sharpen AI, definitely a must have
While it's true that it's a one-time license purchase, after certain year, they will stop updating your software until you pay to renew the license.
@@AdamIverson That's okay with me, honestly. You still get lifetime use, and if at any point you'd like to get new features and functionality you can pay for that again.
@@captainvyom463 that's what I'm saying. I thought it was bullshit at first too, but it's not really the same until you use it on one of your own images. Once you see the effect it can have on your own shots, damn is it impressive. Nothing can ever be as good as getting it right in camera, but nobody is perfect and this helps bridge the gap a bit.
It's interesting how it really tripped over itself with the ladder at 10:30
Your first video is history and you deserve all of your success. Tsar of hardware youtubers.
I’ve always been curious of what horrors you would find if you used something like Topaz or DLSS on games from the 3rd, 4th, or 5th generation and upscaled it to 4K. It would be morbidly interesting to see what the AI would create and mutilate with such a specifically low resolution to work with.
I guess it would be horrible because the models are trained with more natural frames. If someone trained an AI with sharper and more pixelated images, could it look good?
When it comes to editing photos/videos, I always seem to prefer no smoothing function and instead use a relatively large film grain to mask abnormalities.
2:47 😮😮
(turn on subtitles)
LMG's English subtitles: "My mom is like over here!"
I use Media Player Classic + MadVR + SVP to do upscaling and frame interpolation in realtime, it can even do it while streaming youtube videos to the player
As a computer vision scientist I think it would be interesting for a lot of people if you did a video on how video super resolution/"enhancement" (including dlss for example) is actually done with machine learning. The basic concepts are actually not that complicated to explain (making a good implementation is ofcourse a whole other beast) and i imagine that this would be a good fit for the many in this audience.
Some time ago I did a "DLSS". a small network, U-net, more like an autoencoder. I trained it with almost 1 million different patches extracted from Witcher 3 images. In static images of games it had a good result (2x upscale), better than some other more general "standard" networks. but since it did not use temporal information, in image sequences there was a lot of shimmering. So I left it then, hoping to later make a version that would use temporary information, perhaps with some recurring layers in the first half of the network
Nice! I used topaz at the start of the pandemic to upscale family vhs tapes. I stored them on Plex so the family can watch them whenever they please.
yo that is a nice project
It was done for more than increasing apparent frame rate. It was also done to reduce flicker. A crt trying to draw 480 lines from top to bottom would look very flickery.
Great video! Very informative 👍
you know what I would like to see and possibly be a great idea for a video. Remake your first video almost shot for shot today. Would be fun to see Linus attempt to redo his first video, same script, maybe a newer cooler parts laid out meticulously on the bench, etc. Maybe even wear a reproduction NCIX polo shirt, or a LTT take on it. Also of course use that same NCIX intro (or LTT remake).
Wait. The Firetruck video was randomly being recommended to me not too long ago. I wonder if a popular creator engages with one of their old videos a lot it gets promoted
*_Same._*
Hey Verlis hope you are doing well.
@@justbubble9766 Persistent dislike botting bringing well down to neutral
@@Verlisify Dislikes don't even exist anymore
@@Verlisify Sorry to hear that sir
That Terrance and Phillips edit really got me!
You could of used DaVinci Resolve to deinterlace, the new version of resolve studio uses a new thing called Neural Engine which does a fantastic job of deinterlacing footage! I use it a lot as I make a lot of archive-heavy material with a lot of interlaced material and it nails it!
Love this program. Used it to upscale LOTR to 4K, and Star Trek Voyager to 4K as well.
Given Linus firetruck video was 35gb, how big was lotr after upscale? Like 5tb lol
Oh ghaaad. That fire truck video of yours reminds me of my dark college days
The 'painted' video reminds me of the first gen 3D buildings in Apple Maps, also tried sending me off a bridge a couple times as well. Good ol' days.
I want nothing more than Star Trek DS9 to finally get the upscaling that it deserves. I think this would actually make this feasible!
I'm pretty sure some fans have tried doing this with the software. I think it's called Project Defiant. Results are mixed, the early seasons don't look as good as the quality of the original DVD source wasn't great to begin with.
DS9 is my fave Trek of all. I approve of your comment. 🖖
There's a guy on the Topaz VEAI forum that details exactly how he went about doing it.
the source is quite dark. but as my favourite Trek show I really with they would
It would be a lot better to just scan the 35mm elements at 4K than trying to upscale the video masters.
Upscaling a video shot on film is far easier than upsampling a digital video (the former doesn't necessarily need an AI upscaler to do) . And AI upscaling is an amazing potential application (as seen on game mods too and done well like FF9's Moguri Mod, which used ESRGAN and is available for free as a Python CLI program to play around with) , but it does a long way to mature as well.
Video shot on film is not upscaled. It is just scanned in higher resolution. Cause film has kind of infinite resolution. I am highly against the term "remastering" for digital produced content.
I'm NOT sure I understand your point. To upscale FILM you need to scan it into a computer at which point it's digital video. Someone above made a similar point. I do agree AI upscaling has a long way to go, but like many things it's just a tool. There's ways to use it very effectively right now. You just need to focus on those areas it works well.
@@photonboy999 yeah but you dont upscale the digital footage. You just rescan it at a higher resolution, which REALLY results in higher detail (unless your focus was off or the lens was shit). Enhancing footage that was recorded digital will always only be guesswork or interpolation or maybe ai. Which is generating something that wasnt there before. Rescanning film in higher resolution is just making better usage of the incredible resolution of analog recordings.
I really hope that people are using a RetroTink, or Koryuu and OSSC combo, to easily preserve the native 60 fps, and upscale, for sources that have the yellow video cable (composite), or S-video output, for recording footage found on tape, to an HDMI device.
If it is done another way, then the interlaced fields are squished together, making a 60i film 30p, not 60p, thus losing the smooth look something recorded on tape.
You are able to tell if someone has not done this, if when tapped, the "Stats for Nerds" icon shows a video is at 30p, not 60p.
There are many, many video tapes shown online, that have not been digitally converted correctly. I recommend Technology Connections/Connextras videos, on this subject.
He does not use a RetroTink, nor OSSC product, but he explains why proper upscaling, and frame saving footage is essential, for the inteded look of the footage naturally captured by/on video tape.
ua-cam.com/video/ZC5Zr3NC2PY/v-deo.html
10:35 those jitters on the Ladder!!
4:55 Also when it come to interlacing, you don't see both fields at the same time. They don't get stitched together like you showed in the video, it's one field at a time.
He's taking about how the software stitches both fields into a progressive upscale.
@@sietherine I would double one field.
@@SuperCartoonist That will do the wrong thing if there is motion on-screen. If there is no motion on screen, it would also halve the resolution.
Though Linus kind of glossed over the whole time difference between fields.
VEAI has several different methods for dealing with interlaced videos. Some are for properly encoded interlaced sources, others are there to deal with an interlaced source that was improperly re-encoded to a progressive video. I've had very mixed results. It really just depends on how craptastically your source content was dealt with in the past.
@@jamesphillips2285 Some of the VEAI models for dealing with interlaced content will, in fact double the frame rate to deal with this time difference you're talking about.
with the FW900 at 5:03 it's giving me the idea that they're going to make a video on that monitor at some point.
Shame they cost thousands now and have issues like the Horizontal Output Transistors would burn out
"Never Gonna Give You Up" master is on film though, so I don't know for sure about this, but even higher resolutions may be possible in the future of these movies/videos on film.
Was not expecting the most realistic acid visuals I've ever seen
In theory you could run multiple AI upscaler passes and models that work better on different parts of a scene and rotoscope them together. Would be much more time consuming, but for a bigger budget project could probably reach a much higher quality than a single model applied to an entire scene.
10:35 crazy how the ladder is moving on the new one.