Microsoft Auto SR Tested: AI Upscaling For Every Game... But How Good Is It?

Поділитися
Вставка
  • Опубліковано 22 жов 2024

КОМЕНТАРІ • 671

  • @MisterBrodo
    @MisterBrodo 2 місяці тому +1245

    Never forget that in Digital Foundry's original video for Gears of War Ultimate Edition, Jon put on some weird accent that we never heard again

    • @thundertweet
      @thundertweet 2 місяці тому +117

      Had to go check…what was that!

    • @legendary82
      @legendary82 2 місяці тому +28

      I did not know this😂

    • @kevboard
      @kevboard 2 місяці тому +19

      wait... what? I gotta check that later 🤣

    • @Killmaster7
      @Killmaster7 2 місяці тому +96

      Liquid Jon

    • @deviouslaw
      @deviouslaw 2 місяці тому +110

      LOL! We need this as a viewer question on df direct.

  • @ryansheldon6046
    @ryansheldon6046 2 місяці тому +76

    “Ring the bell for allegedly instant notifications” - killed me lol

  • @aynrandom3004
    @aynrandom3004 2 місяці тому +329

    3:25 spitting bars dayum

    • @kraithaywire
      @kraithaywire 2 місяці тому +8

      LOL yeah hahahahaha

    • @nickpinkowski
      @nickpinkowski 2 місяці тому +2

      🔥🔥🔥

    • @pedromartins4847
      @pedromartins4847 2 місяці тому +9

      God damn Rich and his pudding

    • @lasaldude
      @lasaldude 2 місяці тому +6

      @@kraithaywire lol have you guys noticed that Google is having trouble with our spelling or slang and giving the option to 'translate to english' even though it is english. lol Both of you two have translate under your comment.

    • @alexsilva28
      @alexsilva28 2 місяці тому +5

      Drake has been real quiet since this dropped

  • @Crocopotamus
    @Crocopotamus 2 місяці тому +65

    This reminds me of those old Xzibit memes. "We heard you like upscaling. So we put an upscaler for your upscaler so you can upscale while you upscale."

  • @paultidd
    @paultidd Місяць тому +10

    if they can get this working on Xbox Series X before November 7th, they will decimate PS5 Pro sales. Microsoft can just be like, why pay $700 for an update that we will give you for free on the Xbox that you already own?

  • @DesocupadoXtremo
    @DesocupadoXtremo 2 місяці тому +24

    God those upscaling and framegeneration tech keep getting better, im looking forward to how it will be implemented in portable gaming, render a 720p 30fps game and present it at 1080p 60fps with minimal latency penaulty

    • @Belfoxy
      @Belfoxy 2 місяці тому +2

      Inject all of it directly into SteamOS please!

    • @DesocupadoXtremo
      @DesocupadoXtremo 2 місяці тому +2

      @@Belfoxy If Lossless Scaling get a Linux port we wouldn't need it

    • @bentucker2301
      @bentucker2301 2 місяці тому

      I'll take that u. You don't need it .

  • @itsuadman
    @itsuadman 2 місяці тому +139

    For what it is, it looks great. The more options there are, the better. I hope ms improves arm gaming performance either through software tweaks or the 2nd gen of these types of processors. The idea of the npu doing the work is an interesting one and i look forward to all the df coverage of it. Also, I've done no research but why is auto sr limited to 700-900p? Is the npu not up to the task or is there some other explanation?

    • @cube2fox
      @cube2fox 2 місяці тому +17

      Probably the NPU is not able to do more.
      The poor gaming performance for the Snapdragon Elite may be partly due to Microsoft's x86 to Arm emulation layer. However, it seems likely that the poor performance is mostly caused by Qualcomm's GPU driver, which doesn't contain two decades of game optimizations like Nvidia and AMD GPUs. Intel had similar issues with the driver for its then new GPUs.

  • @Decenium
    @Decenium 2 місяці тому +35

    man those hud elements remind me of AMD's Morphological Anti Aliasing from back in the day, that post processing stuff

    • @talibong9518
      @talibong9518 2 місяці тому +4

      This looks a lot better, morphological filtering just blurred everything, this actually upscales and filters 2d elements

  • @BlacklistBill
    @BlacklistBill 2 місяці тому +39

    "And the pudding in question is actual gaming". There aren't enough t-shirts in the world for Rich quotes.

  • @quietusplus1221
    @quietusplus1221 2 місяці тому +210

    This almost seems like we're soon back to dedicated cards for certain processing. In the past PhysX, today AI.

    • @Gravy1255
      @Gravy1255 2 місяці тому +13

      Well I'd imagine they stick with it on the CPU or add it to the GPU

    • @epobirs
      @epobirs 2 місяці тому +28

      NPUs are already major CPU features. Dedicated chips for esoteric functions are a very hard sell these days in the consumer sector. Even back when PhysX appeared it was never expected to be a big seller. My write-up of the CES that year where it was first publicly promoted was that this was plainly an acquisition target for a larger company that would subsume the functionality into their products.

    • @niter43
      @niter43 2 місяці тому +26

      GPUs already fit AI acceleration really well and recent generations include dedicated silicon for it (e.g. Tensor cores in RTX are NPU)
      Point of NPU as part of CPU is optimizing for power on laptops (not having to wake up dGPU, if laptop even has one to start with)

    • @cube2fox
      @cube2fox 2 місяці тому +1

      @niter43 So the things which Nvidia calls "tensor" cores are approximately the same thing as an NPU? Except that the NPU is part of the CPU silicon and the "tensor" cores are part of the GPU silicon? So could GPUs with enough of these cores add AutoSR support to a Windows system? Seems unlikely.
      I also think for major AI applications like LLMs, people don't even use Nvidia's "tensor" cores (or any NPUs) but rather their "CUDA" cores.
      Needless to say, AMD uses different names for all these things.

    • @niter43
      @niter43 2 місяці тому

      @@cube2fox there was just no (and probably still to this day) industry agreed term back when Nvidia introduced Tensor cores. Nvidia named them refering to TPU acronym, it was quite popular back then with Google calling their own new accelerator chips TPU. Just like industry didn't immediately came with "GPU" term.
      Nvidia's own LLM interference ("execution") engine uses Tensor cores. As seen in their "Chat with RTX" app or open source TensorRT-LLM library it's based on. Annoying to use, but seems to be the fastest engine for Nvidia hardware. llama.cpp/vLLM and others seem to use CUDA mostly for compatibility with older generations.

  • @GL-ms9ek
    @GL-ms9ek 2 місяці тому +47

    Within the limited scope AutoSR is shooting to cover, I'd say it does the job pretty well.

  • @Emosetzer
    @Emosetzer 2 місяці тому +176

    It’s time for the Frankenstein test. Let’s test an image fed through every upscaler at once! 8k gaming? 😂

    • @Nicholas_Steel
      @Nicholas_Steel 2 місяці тому +13

      We already have 8k gaming, Nvidia added the Ultra Performance mode to their DLSS when they launched their Geforce 3090... specifically to market being able to run DOOM (2016) at "8K" resolution & acceptable FPS.

    • @danpatrick7176
      @danpatrick7176 2 місяці тому +6

      8k soup

    • @VioletPrism
      @VioletPrism 2 місяці тому

      This is such a good idea

    • @alexsilva28
      @alexsilva28 2 місяці тому

      Too much gaming

    • @kenshinhimura6280
      @kenshinhimura6280 2 місяці тому +5

      ​@@Nicholas_SteelYou can't say you are playing in 8k if that thing is on. Not even 4k.
      Stop being delusional

  • @hosseinjafary1481
    @hosseinjafary1481 2 місяці тому +9

    A comparison between RSR and Auto SR would be great, Which both technology works in post process and claims that could run on all games.

  • @user-bg4wk6nh3b
    @user-bg4wk6nh3b 2 місяці тому +36

    Like them or not, these are wonderful tools.
    I’ve always been disappointed they debuted & largely remained on the high end devices when it’s the underpowered (or low power) devices where they make the most sense.
    I’m hoping some of these really powerful APUs we are seeing will be able to leverage the NPUs AMD is adding to their chips for a ML-upscaler & framegen.
    No idea if the architecture allows it, but they are all just matrix multiplication accelerators (as I understand) so it’s the right math at least.
    My only peeve is that every company is remaking the same tech over & over, some standards & coordination would be good for consumers.

    • @mojojojo6292
      @mojojojo6292 2 місяці тому

      They make sense at every level. They actually work even better at higher resolutions with higher end hardware. I'm enjoying 4k gaming on a 4070 thanks to up-scaling tech. Sure it's not quite as good as 4k native but it's still better than 1440p native for the most part. There's still plenty of older and less demanding games I can run at native too.

  • @f.m848
    @f.m848 2 місяці тому +51

    I hope they implement something like this in their consoles or at least their next console!

    • @Chunnibyoubaka
      @Chunnibyoubaka 2 місяці тому +18

      Nah they’re spending lots of money on this technology that’s mostly just for gaming in order for it to skip their next console

    • @lolzforlunch
      @lolzforlunch 2 місяці тому +6

      ​@@Chunnibyoubaka with the recent business decisions made by microsoft's xbox gaming div, i wouldnt be surprised

  • @Hybred
    @Hybred 2 місяці тому +73

    10:10 AutoSR was way sharper here, which makes me think the stability issue was from Control's TAA. What if you had 720p DLAA + AutoSR vs 2160p DLSS Ultra Performance? That would've been a more fair test, so we're comparing the image with the same anti-aliasing

    • @Dinjoralo.
      @Dinjoralo. 2 місяці тому +26

      You can't get DLSS on machines with AutoSR. DLSS requires an Nvidia GPU, AutoSR is currently only on laptops with Snapdragon processors from Qualcomm.

    • @Hybred
      @Hybred 2 місяці тому +13

      @@Dinjoralo. Then using FSR3 Native vs Ultra Performance, XeSS or TAAU would've been a better comparison. Surprised they didn't do this.

    • @raphaelchagas1676
      @raphaelchagas1676 2 місяці тому +2

      it does, but also looks it has more halos and artifacts. I'm loving these AI upscalers competition tho. The more the better.

    • @iurigrang
      @iurigrang 2 місяці тому

      @@HybredNone of these technologies have a usable ultra performance mode, outside of the XeSS versions in intel GPUs, which turns to the same problem they have with DLSS.
      The point, I think, is that the comparison is unfair. It’s not to say “microsoft did a bad job here”, it’s to say “tame your expectations, this is not going to fix anti-aliasing problems as the other upscalers do”.

    • @techsamurai11
      @techsamurai11 2 місяці тому

      @@Dinjoralo. Why does it only work on a single processor? That wasn't made clear - I thought AutoSR comes on all CoPilot devices. It actually needs hardware to do that?

  • @K3dev
    @K3dev 2 місяці тому +4

    If it is really post processing, a tech like this could be made into an hdmi dongle, to upscale anything, old consoles, switch etc., some hdmi dongle with an ARM processor.

  • @Fluffywings84
    @Fluffywings84 2 місяці тому +1

    Whoa there! Let's put windows into dark mode before you show those bright system dialogues. Love the content!

  • @royconner8045
    @royconner8045 2 місяці тому +37

    I admit I know nothing of this black magic, but I'd love to see it implemented into all Xbox consoles. Most Xbox One and Xbox 360 games run in the ranges of acceptable resolutions for this.

    • @loganhazelton
      @loganhazelton 2 місяці тому +5

      No neural processing unit in any current consoles, so I don’t think you can

    • @bluejay4812
      @bluejay4812 2 місяці тому +8

      That’ll likely be next gen

    • @PixelatedWolf2077
      @PixelatedWolf2077 2 місяці тому +4

      That'll probably come from mid-gen refresh/next gen

    • @douglasscott7551
      @douglasscott7551 2 місяці тому +6

      Or imagine an AI upscaler for old consoles, with component and hdmi input with no lag🤔

    • @jeffreypeters5578
      @jeffreypeters5578 2 місяці тому +1

      No but of Microsoft could allow fsr if AMD would implement it into an update for xboxs i mean its an x86 amd chip it could be done

  • @Gravy1255
    @Gravy1255 2 місяці тому +9

    Im interested in Auto SR for emulators. As DLSS/XESS is probably never going to be usable, for them due to all the vectors needed. FSR maybe is usable but Auto SR may be the obvious choicem

    • @SogonD.Zunatsu
      @SogonD.Zunatsu 2 місяці тому +3

      Lossless Scaling works on emulators

    • @LutraLovegood
      @LutraLovegood 2 місяці тому +1

      There's already RSR if you have an AMD card

    • @Gravy1255
      @Gravy1255 2 місяці тому

      @@SogonD.Zunatsu all I can find for lossless scaling in emulators is frame gen type stuff. Taking a 30 game to 60

    • @Gravy1255
      @Gravy1255 2 місяці тому

      Also Auto SR will be far better than RSR or any other non ai scaler as it runs through a neural net unlike. Which will increase fidelity and fine details more so.

    • @klementineQt
      @klementineQt 2 місяці тому +1

      @@Gravy1255 Lossless Scaling works on anything, you can do upscaling with various algorithms including FSR, frame generation, or both together. All you have to do is configure the settings, select scale, then focus the window the emulator is running on. Make sure the window size is accurate to resolution the emulator is currently rendering at, and then it'll upscale that window to fullscreen borderless at your native output resolution.
      You can also set it to autoscale games with certain configs based on executable or window names

  • @asmongoldsmouth9839
    @asmongoldsmouth9839 2 місяці тому +3

    *Adding Microsoft Auto SR to DLSS on Dragon's Dogma 2 should rendera bit better appearance while sparing some extra resources.* 👍

  • @guitaristkuro8898
    @guitaristkuro8898 2 місяці тому +1

    For Control you can use the modded version released by a Dev that includes upgraded DLSS and higher quality effects.

  • @Godmode_ON24
    @Godmode_ON24 2 місяці тому +67

    So, why can't this run on the GPU and be applied to browsers so we get upscaled videos (UA-cam, Twitch, etc)? I know Nvidia and AMD both have features to do that, but neither seem as good as AutoSR. Imagine upscaling 720p and 1080p videos to whatever resolution AutoSR upscales to and then using frame generation (like Lossless Scaling) to make them 120 fps.

    • @Cyrribrae
      @Cyrribrae 2 місяці тому +11

      I'm also wondering if there's any reason it couldn't work on video. Or.. On streamed games..

    • @KrakenGameReviews
      @KrakenGameReviews 2 місяці тому +19

      Why? Probably no reason. The power of modern GPUs likely runs rings around these NPUs.
      How? Someone needs to be able to implement it, probably translating to CUDA for Nvidia or something special, and ROCm for AMD maybe?

    • @simonedeiana2696
      @simonedeiana2696 2 місяці тому +14

      Microsoft Edge literally has this feature with supported hardware

    • @ZedDevStuff
      @ZedDevStuff 2 місяці тому +8

      ​@@simonedeiana2696 yeah, people just like hating on Edge so they never are aware of all the features It has

    • @destroyermcw626
      @destroyermcw626 2 місяці тому

      ​@@ZedDevStuffAnd I use Edge Since Xbox one X and now Series X and order some things of Amazon!!

  • @andrei007ps
    @andrei007ps 2 місяці тому +1

    Would have been interesting to compare Auto SR to NIS (Nvidia Image Scaler), these are both post proces upscalers.

  • @truknet
    @truknet 2 місяці тому +3

    The series x also has 97tops of int8 ml inference. Just enough to run Copilot and Auto SR! Interesting......🤔

    • @विचित्रलड़का
      @विचित्रलड़का 2 місяці тому +2

      It would probably come with an update when ps5 pro release. But it will be fully supported in all games when next gen release. This always happens.

  • @ReAnimation1999
    @ReAnimation1999 2 місяці тому +26

    I hope that Auto SR will be released on xbox.

    • @RedPillAlways
      @RedPillAlways 2 місяці тому +10

      Microsoft don't even like Xbox

    • @stratoshd9043
      @stratoshd9043 2 місяці тому +2

      Xbone is dead brother

    • @FrasiersBurner
      @FrasiersBurner 2 місяці тому +13

      @@stratoshd9043yes, you’re right, the Xbox One line of hardware is no longer manufactured.

    • @Prisoner_ksc2-303
      @Prisoner_ksc2-303 2 місяці тому +4

      Xbox and ps5 don't have SoC with neural processing parts. Best they can get is FSR...

    • @168original7
      @168original7 2 місяці тому +3

      ​@@RedPillAlways💀 but true, they were trying to dissolve it in the xbox one days but just decided to burn it this gen with gasoline
      When I heard the marketing leader critise microsoft due to no funds for advertising and shareholders getting spooked I knew it was over. It had been getting slowly bleed by microsoft executives into a service.

  • @opinali
    @opinali 2 місяці тому +12

    This looks interesting, useful for devices/games that need it. But some of the failures are surprising, for example the horrible noise around Jesse's shoulders at 8:52, or the complete failure to reconstruct thin power lines in CP2077 e.g. at 10:32. I wouldn't be surprised if Radeon's in-driver upscaler (RSR, based on FSR 1.0) wouldn't be very close, given that ML upscaling is apparently very limited without temporal data and other inputs.

  • @forresthunter1483
    @forresthunter1483 2 місяці тому +31

    Since this is post-processing, does this mean it'll work on pre-rendered things? I'm thinking specifically about FMVs of poor quality and prerendered back grounds.

    • @cube2fox
      @cube2fox 2 місяці тому +13

      It probably works on everything whatsoever if it's really post processing. Similar to the upscaling a TV can do. But the machine learning model is very likely trained for upscaling 3D games, so I assume it won't work as well on, say, UA-cam videos.

    • @bedsdt
      @bedsdt 2 місяці тому +1

      You can try the Lossless Scaling, it works on every window

  • @discodan2265
    @discodan2265 2 місяці тому

    Rich your Microsoft Store banner @2:11 is legit authenticated hairworks, no glitches bruz ;D Fellow baldy here ☺

  • @reNINTENDO
    @reNINTENDO 2 місяці тому

    Honestly... that looks really good. Like, for 720p upscaled to a clearer image, it's a very notable improvement. Appreciate the extra leg work of ensuring a clean image first to give the post process a fair shot.

  • @guitarmeggedonit5232
    @guitarmeggedonit5232 2 місяці тому +1

    If this type of Auto SR is in use for the Switch 2 for Switch 1 games, that would be amazing!

  • @LurkingLarper
    @LurkingLarper 2 місяці тому +8

    System wide upscaling technology that you can switch on/off in any game you want sounds like a really good idea. Something like this implemented in handheld like Steamdeck would make it a killer feature indeed.

    • @techsamurai11
      @techsamurai11 2 місяці тому

      Apparently, it's currently limited to Qualcomm Snapdragon processors.

    • @klementineQt
      @klementineQt 2 місяці тому +1

      Steam Deck already has an implementation of FSR that can be used for any game and has had it for over 2 years. AMD has a similar feature in the Windows driver called Radeon Super Resolution, which is basically universal FSR (not to be confused with Virtual Super Resolution, which renders at higher resolutions and downscales to your output). Lossless Scaling also offers many different upscalers (including FSR) as well as universal frame generation for $7.
      I use Lossless Scaling almost daily to play games locked at 60fps at 120. It's not ideal for everything, but it works perfectly for something like Dark Souls, and I'm even using it for Once Human so I can play at higher settings (and since my framerate is a bit unstable anyhow even on lower settings with higher framerate, locked or not). The only thing I wouldn't use it in is a competitive FPS, but for most everything else, it's an amazing experience in my opinion

    • @LurkingLarper
      @LurkingLarper 2 місяці тому

      @@klementineQt On the Steam Deck FSR is used only as a 'scaling filter' with no other options than sharpness to tweak it with. Didn't even notice it since it was labelled like that until digging through once more. I also don't know if it's FSR 1, 2 or 3.1 implementation. It would seriously need some more work put into it like input/output resolution and the addition of AMD Fluid Motion Frames if possible.
      At this moment it's a mislabeled option buried under wrong category (it's upscaling tech, not a filter) and you cannot really tweak it, nor do you know even what implementation it runs on.

    • @zavier6362
      @zavier6362 2 місяці тому

      ​@@LurkingLarperIt's not labelled wrong because it is a filter. That's what FSR(1) is. There's no adjustable flags because your input res is always what your game outputs and the output is your native res. The only thing you can adjust is the strength of the filter which it does have.

    • @LurkingLarper
      @LurkingLarper 2 місяці тому

      @@zavier6362 I've never seen DLSS or FSR put under filters in any game or system before. It's always it's separate setting since it's upscaling. Filters are used in emulation or retro gaming scene.
      With upscaling you can always configure the input/output resolution which is also known as the quality of the upscaling ranging from ultra to quality etc. I don't see why these commonly used terms and settings need to be used in different ways under Steam Deck specifically. It just makes it messier and also the feature is lacking manual adjustment.
      Also what does this part even mean: "There's no adjustable flags because your input res is always what your game outputs and the output is your native res." There should be adjustable flags, that's the whole point of upscaling.

  • @TheNerd
    @TheNerd 2 місяці тому +7

    I guess one of the devs Microsoft found out about Reshade and thought "huh, that's a pretty good idea" ;-)

    • @sean8102
      @sean8102 2 місяці тому

      Forgive me if I'm missing the connection, but dose Reshade offer upscaling options? I have never used it that much. I want to say it has some version of FSR.

  • @mausmalone
    @mausmalone 2 місяці тому +2

    I think it would be interesting (assuming you can get them to run) to try out Auto SR on games that are too old for the other upscalers. Maybe some Unreal Engine 3 games? Some stuff from 2010-2015 ish maybe?

  • @agentoranj5858
    @agentoranj5858 2 місяці тому +4

    Has anyone invented something like DLSDR for older games? The thing about older games is that they're not very demanding on modern PC hardware and their engines often aren't designed for high framerates because consoles aren't either. Pushing fidelity is the logical way to make use of my excess computer power in these games but I want to do it a little more efficiently than with pure render scaling.

    • @MLWJ1993
      @MLWJ1993 2 місяці тому +2

      DLDSR is handy for games that don't support SGSSAA. Otherwise SGSSAA produces slightly more stable results (or you can do 8x SGSSAA for super overkill internal resolution if your GPU can handle it).

  • @333hronos
    @333hronos 2 місяці тому +1

    It would be interesting to see comparison with the LS1 upscaler in Lossless Scaling

    • @333hronos
      @333hronos 2 місяці тому

      LS1 is also a machine learning upscaler

  • @Brogboolius_Maximus
    @Brogboolius_Maximus 2 місяці тому +52

    That looks surprisingly good, and when you showed the 4-way performance comparison there, I couldn't believe it.
    This will be a godsend for all lower-powered mobile devices in our AI-powered future.

    • @rowaystarco
      @rowaystarco 2 місяці тому +6

      I launched Witcher 3 on my Surface Pro (11) and I was surprised about the clarity when I launched it. Was running at 50-60 FPS inside the city and the image looked really quite good on the 13 inch screen. The downside is that the UI elements looked quite blurry, but that's not that annoying really.

    • @mlpfimguy
      @mlpfimguy 2 місяці тому

      It’s impressive, but I do notice the footage is a bit choppier with the tool

  • @ryon1256
    @ryon1256 2 місяці тому +1

    I love it. Sharp image.

  • @happysw
    @happysw 2 місяці тому +3

    I’m so curious with stuff like this how much the NPU or whatever it’s called is actually needed or how much more efficient it is than running it just on a CPU. Like, could they reasonably support it on non Copilot+ machines / machines without a dedicated neural processor or nah?

    • @loganhazelton
      @loganhazelton 2 місяці тому +1

      I don’t believe so, neural processing units are pretty specialized to perform low precision arithmetic and feature novel architectures. I assume it’d be like using a CPU to render graphics

    • @cube2fox
      @cube2fox 2 місяці тому +1

      Even with a relatively beefy NPU (Microsoft requires at least 40 TOPS) Auto SR only supports upscaling from 900p. Which suggests it isn't a particularly light task. So I guess something like an NPU is really necessary.

  • @TerriBlanchard-nh7xy
    @TerriBlanchard-nh7xy 2 місяці тому +26

    Your videos are a breath of fresh air, always enjoy watching

  • @XouXin
    @XouXin Місяць тому

    Looks very similar to the XBR algorithm in some ways. XBR prioritizes round shapes, straight lines, and smooth gradients.

  • @MsMarco6
    @MsMarco6 2 місяці тому +2

    I wonder if this could be used for Video like RTX super resolution. It is a post process effect and seeing as many players already use DX11 it may be possible to implement.
    I don't see why an upscaler like this couldn't work & if it did it could be a gamechanger. Whilst it lacks the compression artefact reduction of RTX SR it certainly seems to be leagues ahead in terms of sharpness & clarity and it's real-time unlike Topaz, so for high bitrate 1080p content something like this could be incredible.

  • @AlmostLikeHuman
    @AlmostLikeHuman 2 місяці тому

    The almost fixed 12ms per frame makes me curious if and by how much the latency can be improved by future hardware. Cool tech, overall!

  • @Anna_Rae
    @Anna_Rae 2 місяці тому

    Seems pretty cool tbh. I would love if the range of resolutions it worked on was increased.
    In my own use case, I play PC games on a 4K 55 inch LG C1. 4K is getting quite demanding for my 3080 on new games (especially the 10gb of vram). So maybe doing a 1440p dlss balanced mode, with AutoSR scaling that to 4K could be nice.
    Verh promising tech. I think it's fascinating that the cost here is a little bit of latency rather than performance.

  • @triceracopp
    @triceracopp 2 місяці тому +8

    What about a FSR comparison?

    • @Nat-yf6ff
      @Nat-yf6ff 2 місяці тому

      It's not a machine learning technique

    • @SterkeYerke5555
      @SterkeYerke5555 2 місяці тому +4

      I would like to see an RSR comparison: both are post processing filters that can be applied to any game. Once those new Ryzens are out, owners of those devices will probably have a choice between either AutoSR via Windows or RSR on a driver level, fitting a similar use case.

    • @danarseptiyanto4066
      @danarseptiyanto4066 2 місяці тому +2

      ​@@Nat-yf6ffWhy would that be a problem? Both are solution for the same problem, the fact that they have different approach only make it more interesting to compare really

    • @CaptainKenway
      @CaptainKenway 2 місяці тому

      @@danarseptiyanto4066 Not really. FSR is still implemented on a per-game basis and has access to more data than Auto SR does. Rich even explained in the video why it's not a fair comparison, but I suppose it's asking too much for people to actually watch the video before rushing to the comments section to bless everyone with their awesome hot take.

    • @MrSkollll
      @MrSkollll 2 місяці тому

      @@CaptainKenway There is Radeon™ Super Resolution (RSR) which is universal driver implementation of FSR 1, that is also strictly post-process with no input from game's rendering pipeline. As for comparriosion i dunno how well Lossless Scaling program works on ARM CPU but it also has implemented FSR 1 and NVIDIA's NID and has it's own post-process upscaling method

  • @florisbackx1744
    @florisbackx1744 2 місяці тому

    I really like the approach of cleaning up the signal vs forced boosting to a fixed resolution. I think the quality of the image is very good especially considering the fact it has to work with so much less information vs DLSS. DLSS and FSR sometimes has the bad habit of adding shimmer and overly sharp artificial looking image, Auto SR seems to do the exact oppositie, it cleans it up and smooths it.

  • @WhoWatchesVideos
    @WhoWatchesVideos 2 місяці тому

    My big hope for NPUs showing up in commodity hardware was exactly this - low-compromise, vendor-agnostic AI upscaling. I can only hope that what seems to be a generic NPU-accelerated upscaler gets integrated directly into games and given the temporal treatment. Of course, that all relies on this shaking out to be vendor-agnostic once x86 NPUs have rolling out.

  • @MasterCog999
    @MasterCog999 2 місяці тому +1

    This tech reminds me of Radeon Super Resolution in how it can be applied to any software, though more restrictive due to the input resolution limitation. I wonder if RSR has improved since launch. I know it's still not as clean a resolve as FSR but I wonder if AMD has improved it since it's introduction.

  • @KrakenGameReviews
    @KrakenGameReviews 2 місяці тому +25

    This "locked" 720p internal resolution makes me quite suspect of this being utilised for Microsoft's rumoured 4k handheld. If you had a powerful enough NPU I imagine you could reduce that 12ms latency somewhat, allowing them to push a 720p console with the same featureset as the home console, ray tracing and nice post-processing, and upscaling back to 4k.

    • @ZeitGeist_TV
      @ZeitGeist_TV 2 місяці тому +4

      No one ever said their handheld would be or target 4K at all though.

    • @crestofhonor2349
      @crestofhonor2349 2 місяці тому +1

      No handheld can game well at 4K in the slightest

    • @TheL1arL1ar
      @TheL1arL1ar 2 місяці тому +1

      After having 3 vita’s, and then went to switch…and now steam deck, I have yet to see how a Microsoft handheld can compete at this point.

    • @ZeitGeist_TV
      @ZeitGeist_TV 2 місяці тому

      @@TheL1arL1ar It works just be a means to have Game Pass and thus C.O.D in a portable form factor.

    • @TheL1arL1ar
      @TheL1arL1ar 2 місяці тому

      @@ZeitGeist_TV I have a gaming laptop with gamepass..and cod I haven’t played since black ops 2. It’s better to purchase off steam since you are getting the complete pc version, and not a console port.

  • @zyxyuv1650
    @zyxyuv1650 2 місяці тому +1

    Almost every video I watch on UA-cam, I notice 8-bit color banding artifacts. For example @ 15:16 when you're saying Thanks for watching, there's 8-bit color banding stripes on the black computer case to your left. I see around 13 separate stripes. Starting from the upper right, the second stripe tends towards more magenta and each stripe is made of single bit channel variances I.e. from 1F1F24 to 1F1F23 to 1E1E22. So when is somebody at Google/Microsoft going to use AI to upsample UA-cam's color space to HDR 10-bits? UA-cam rolled out "Ambient Mode" and it's a nightmare to look at because the entire "ambience" is made up of color banding artifacts. "Ambient Mode" feature flopped. Maybe cause the 8-bit looks horrendous.

  • @Decenium
    @Decenium 2 місяці тому +41

    auto SR looks pretty damn amazing

    • @techsamurai11
      @techsamurai11 2 місяці тому

      I'd love to see how it compares to Sony's Reality Creation on their TVs.

    • @jerchongkong5387
      @jerchongkong5387 2 місяці тому

      It looks good but still has that typical "blurry, wormy" effect of upscalers, they can do a better job with the budget they have.

    • @GRocvidz
      @GRocvidz 2 місяці тому

      Wtf is it supposed to be? All the comparisons look the same to me.

    • @SamoyedSagas
      @SamoyedSagas 2 місяці тому

      It looks like total shit lmao

  • @XDLugia
    @XDLugia 2 місяці тому

    New Richard videos are always appreciated.

  • @SpentAmbitionDrain
    @SpentAmbitionDrain 2 місяці тому +7

    We seem to be getting to an interesting spot. There will come a time when resolution will be a meaningless property of performance with this level of "works everywhere" upscaling.

  • @XzessTool
    @XzessTool 2 місяці тому +6

    You should try this in VR enviroment where that extra detail is going to make a huge difference.

  • @jsVfPe3
    @jsVfPe3 2 місяці тому

    I like it. I'd take this over FSR2's temporal artifacts I think. I'll stick with DLSS on my 48" 4K OLED but the AutoSR clips look fine on the 16" laptop screen I watched this on.

  • @neilb1540
    @neilb1540 2 місяці тому

    Mr. Lead better, you are a very Intelligent man. Much respect to you and thank you for all that you do. Great video 👏🏼.

  • @Madmya
    @Madmya 2 місяці тому

    I really hope we can get this working with retro gaming... that would be amazing.

  • @Punisher9419
    @Punisher9419 2 місяці тому

    More of a traditional form of upscaling is how I see it. Like what you use for video playback perhaps. It's not a huge difference but it's a way to upscale lower resolutions to higher resolutions without it having upscaling problems because the render and output resolutions aren't an even multiplier like 2X. So you can upscale 1440p/1080p to 4k without is being a blurry mess easier. At least that is my understanding. I guess they just need to fix the artifacts.

  • @Falorepus
    @Falorepus 2 місяці тому

    Sounds interesting, maybe there is some gaming on PC with low(er) Power consumption coming. Perhaps there is a DirectSR AutoSR Combo possible. Thank you!

  • @andremalerba5281
    @andremalerba5281 2 місяці тому

    This autoSR stuff would be perfect for the docked experience of these handheld PCs!
    Playing native 720p on the go and kicking in autoSR to upscale the image once it's plugged on the wall and docked outputting to a 4K TV.

    • @eSKAone-
      @eSKAone- 2 місяці тому

      Every modern TV has options like Auto SR and AFMF, they're just called different.

    • @andremalerba5281
      @andremalerba5281 2 місяці тому

      @@eSKAone- but does it look that good?

    • @विचित्रलड़का
      @विचित्रलड़का 2 місяці тому

      @@andremalerba5281 nah. Nothing can beat a NPU. Not those shitty tvs.

  • @Cyrribrae
    @Cyrribrae 2 місяці тому

    Exciting. The benefit of having this be at the MS level and widely accessible, is that game creators can start to program for the strengths of this platform. Just as studios have started to consider how to implement DLSS, standardizing around a core upscaler maybe gets them to better TAA solutions and such that maximize the benefit of this. Perhaps.

  • @Dhrazor
    @Dhrazor 2 місяці тому +1

    THis would be so much better if it could use 1080-1440p image... Let's hope that when it arrives to AMD they will allow it...

  • @OwtDaftUK
    @OwtDaftUK 2 місяці тому +2

    Microsoft should produce a mClassic like device with this upscale software on it.

  • @Ziplock9000
    @Ziplock9000 2 місяці тому

    They need to provide a standard way to access motion vectors in DX11/12 that is standardised and any upscaling can use it, including Auto SR. That way proprietary solution vendors would still be happy. Nevermind, that seems to be DirectSR you mention at the end.

  • @human_brian
    @human_brian 2 місяці тому

    AutoSR sounds interesting but DirectSR sounds like the solution we really need. Looking forward to when that releases and the big 3 make their SR solutions work with it.

  • @kran27_
    @kran27_ 2 місяці тому

    looking at this in a comparison between it and FSR1/NIS, it's the clear winner.

  • @ZeitGeist_TV
    @ZeitGeist_TV 2 місяці тому

    A future where Direct XR allows consoles and PC to ship with games that support whatever AI scaler the end user wants will be nice.

  • @FoxGhost7
    @FoxGhost7 2 місяці тому

    Yeah, this will be amazing for handheld gaming. Funny enough, this is basically what FSR1 was. But so much better.
    I hope this level of improvement will not be stuck on windows platforms, android phones or a new Steam Deck would profit so much off this.

  • @mysticalos
    @mysticalos 2 місяці тому

    This is precisely what I've been saying apple should do with M4 and Metal FX, so far they haven't used the CU units on apple silicon at all for hardware based upscaling. M4 is supposed to add way more for apple intelligence, hopefully they also add it to metalfx

  • @dayveeman
    @dayveeman 2 місяці тому

    I wouldn't mind seeing a head to head against FSR1 as upscalers that only require the final image will always have a use case. Curious to see how these two compare and if using neural processing has the potential to take final image upscaling further than what FSR1 currently does.

    • @विचित्रलड़का
      @विचित्रलड़का 2 місяці тому

      Ofcourse it would be better. Have you ever tried fsr 1? 720p upscaled to 1080 looks like shit. And this thing is doing 4k.

  • @Trai1b1aze
    @Trai1b1aze 2 місяці тому +6

    They need to implement something like this in Switch 2 so that it will look decent in docked mode when hooked up to a native 4k TV (unlike the current switch).

    • @jaimeguzman9086
      @jaimeguzman9086 2 місяці тому +3

      switch will have the nvidia technology it will be far better.

    • @fensoxx
      @fensoxx 2 місяці тому +4

      Like jaimeguzman9086 said, DLSS is coming to switch 2 which will be the best tech available.

    • @techsamurai11
      @techsamurai11 2 місяці тому

      They have - it's called a Sony TV 🙂Being Japanese, Nintendo probably assumes that everyone has a Sony TV and the Switch looks amazing on it. But it is scary to see the Switch on a flagship LG or Samsung compared to a Sony.

    • @sean8102
      @sean8102 2 місяці тому +1

      With Nintendo using Nvidia Soc's I have no doubt the next generation Switch will support DLSS. I'd imagine DLSS 3+Frame Generation.

  • @youp1tralala
    @youp1tralala 2 місяці тому

    Technology has also invented "a pair of glasses" as a preprocessing filter for your eyes to see a sharper and more detailed. image. Auto SR feels like additional glasses

  • @itzdcx
    @itzdcx 2 місяці тому +1

    man The future is amazing

  • @powmod1
    @powmod1 2 місяці тому +5

    Isn't this the same as Lossless Scaling program, but running on chip dedicated to neural networks?

    • @Ziplock9000
      @Ziplock9000 2 місяці тому

      Both run on chips, both use NN

    • @cube2fox
      @cube2fox 2 місяці тому

      I believe Lossless Scaling doesn't have these strict NPU requirements as Copilot+. I guess Lossless Scaling doesn't require an NPU, nor that it even is AI based.

    • @ghost085
      @ghost085 2 місяці тому +1

      Lossless Scaling tries to scale low res images without the usual blur we get with other upscaling techs, it doesn't add new detail or tries to make the images look higher res. AutoSR does try to get an higher res image and adds new details (or fake pixels, if you prefer the term).

    • @LutraLovegood
      @LutraLovegood 2 місяці тому

      @@ghost085 Unless you're using bilinear upscaling, you're always adding new details by upscaling.

  • @Dookie69uk
    @Dookie69uk 2 місяці тому

    Id say for a weak Snapdragon CPU on a laptop its pretty impressive, id be happy enough with it. Good work.

  • @JoeStuffzAlt
    @JoeStuffzAlt 2 місяці тому

    I'm wondering how this would look on old games. If it can take games that were made with a lower poly count and clean them up, it might be really nice.

  • @Bry.89
    @Bry.89 2 місяці тому +2

    If Auto SR produces its own anti-aliasing, wouldn't it be beneficial to turn off in-game anti-aliasing solutions in these games? Otherwise the algorithm has to fix the blur caused by TAA solutions.
    Also, if its possible to create a neural network that can do this, what's stopping anyone from making a neural network that can manifest its own guessed motion vectors?

  • @MsMarco6
    @MsMarco6 2 місяці тому +6

    If they can make this work from higher res inputs & fix HDR support this could be awesome. I use Lossless scaling whenever 2160p DLSS isn't giving the performance I want, upscaling from 1800p or 1620p. But this seem leagues ahead of any of the algorithms on their so could be useful.
    It could also be a cheap way for Xbox to compete with PS5 Pro. I doubt they'll do this but imagine a Series X/S refresh with an added NPU. Games using FSR 2 could upscale to slightly reduced resolutions to limit artifacts then use AutoSR to go the rest of the way I.e. instead of 1080p to 2160p it could be 1080 to 1440p then AutoSR to 2160p, the image would probably be similar (though less artifact ridden like PSSR) whilst freeing up a bit of performance. And for the increasing amount of games missing 2160p and even 1440p this would be gamechanging.
    Again I know this won't happen but I think it hints at the future of upscaling, a mixture of heavier temporal techniques mixed with this new Ai based spatial method. This will be especially crucial if 8k does take off in the next generation as a technique like this is the only way a decent 8k image is happening (and at 8k the difference between this & a native render would be invisible on any screen less than like 120").

  • @JeydetaJosen
    @JeydetaJosen 2 місяці тому

    damn that looks realy good O_o
    Thats DLLS Levels of feeling.

  • @solonepeon5805
    @solonepeon5805 2 місяці тому

    Awesome tech this is. Even tho Switch itself cant do this I use 2 mClassic, gaming cable, cinema cable & the 4k gamerpro all daisy chained & I get the results of better upscale picture in 4k so I understand what this Auto SR is doing.
    Whenever Switch 2 comes out I'll try the same setup to see the difference.

  • @od1sseas663
    @od1sseas663 2 місяці тому +1

    I wonder how XeSS/FSR 3.1 Native (720p) + AutoSR will look like vs DLSS 3.7 UP 4K

  • @youtubevanced4900
    @youtubevanced4900 2 місяці тому +1

    That flickering in the footage is horrible. Definitely would not use this feature.

  • @andrewmoura4436
    @andrewmoura4436 2 місяці тому

    I had to watch this with Lossless Scaling as the video footage felt like viewing 25 - 30 FPS :)

  • @kahuna3901
    @kahuna3901 2 місяці тому

    Really quite exciting. The next Xbox will surely have some sort of NPU. could be another drive in back compat work. Furthermore, not auto SR per say, but a dedicated SR built into engines so developers can have more expensive assets and technologies whilst running at lower than 4k resolutions but absolutely nailing higher res becuase of the neural network

  • @MacVerick
    @MacVerick 2 місяці тому +1

    this can be amazing for handhelds

  • @Dangerman-zg3ui
    @Dangerman-zg3ui 2 місяці тому +1

    Hopefully with NPUs on Laptop/Mobile SoCs will get better/faster we'll see Auto SR scale with that with much better results. Especially when Strix Halo & Medusa Halo come out (unless Medusa comes out with AI Reconstruction ala DLSS)>

    • @chien.nguyen.
      @chien.nguyen. 2 місяці тому

      The truth is that they just need to push it to the dedicated AI core on the GPU and all problems are solved. Anyway, the power of the GPU related to AI is still much greater than the NPU, I think this is their solution. Simply upgrading the experience for PC and laptop models that do not have a strong enough GPU but still have an NPU

    • @bltzcstrnx
      @bltzcstrnx 2 місяці тому

      ​@@chien.nguyen.NPU is for neural processing with low power. The point of dedicated hardware is it's capable of doing specific tasks much more efficiently.

    • @chien.nguyen.
      @chien.nguyen. 2 місяці тому

      @@bltzcstrnx but the problem with NPU is that the performance per W when handling AI-related tasks is still not as effective as GPU, I really don't know why they make NPU anymore, when they simply need to improve The igpu advancement available in their cpu is enough

    • @bltzcstrnx
      @bltzcstrnx 2 місяці тому

      @@chien.nguyen. probably because GPUs are not efficient real-estate wise when doing low precision vector math. Look at the size of the modern GPU even when inside an APU. They're huge, much larger than other components. With modern devices trending towards low power mobile operations. Real-estate and power becomes very high priority.

  • @Shannon-ul5re
    @Shannon-ul5re 2 місяці тому +1

    Very impressive tech

  • @LinxESP
    @LinxESP 2 місяці тому

    If windows could use sr/nis/fsr and allow to select it would be quite cool, even more if it allows to keep all config on windows settings

  • @meherenow793
    @meherenow793 2 місяці тому +1

    if we could lower the base resolution for better performance and then upscale to base...
    👌

  • @Xilent1
    @Xilent1 2 місяці тому

    Rich might had said it and I apologize in advance. Can you use DLSS and Auto SR simultaneously? He showed the differences in 9:04 but not sure if you can at the same time though. Sorry for the Noob question.

  • @xxkairzzxx1994
    @xxkairzzxx1994 2 місяці тому

    It would be interesting compering this to "nis" (enabled in control panel) which also works on a similar way minus the ai

  • @rodrigofreitas3288
    @rodrigofreitas3288 2 місяці тому

    "allegedly instant notifications" 😆 thanks for the video on the topic 👍

  • @AlikanAlmeida
    @AlikanAlmeida 2 місяці тому

    I think it is a very viable upscaling solution to play on smaller (up to 20 inches) screens. It looks way better than FSR.

  • @adamantiumreaver4283
    @adamantiumreaver4283 2 місяці тому

    This is great tech for hand helds. Hopefully they start implementing it

  • @colbyboucher6391
    @colbyboucher6391 2 місяці тому

    The modern equivalent of weird scaling filters for old SNES games that got rid of the pixels by connecting them with diagonal fills.

  • @BlindTrustProject
    @BlindTrustProject 2 місяці тому

    Auto SR seems to work way better than other spacial scaling techics like FSR1 and Lossless Scaling. I really wonder what could be the result applied in Xbox Series S : most game are native 900p to 1080p upscaled... Whith Ok tier result in 720p to 4k, Auto SR could really be great for Series S.

  • @quintrapnell3605
    @quintrapnell3605 2 місяці тому +1

    just seems less viable than traditional options. I can imagine this being used for Xbox on 4k TVs in games lacking an upscaler, but on desktop the steam Lossless Scaling app seems to share the post process path and fewer limitations.

  • @alandiegovillalobos
    @alandiegovillalobos 2 місяці тому

    Felt like someone was explaining the Matrix to me. That can’t be done lad!!

  • @wretchedslippage3255
    @wretchedslippage3255 2 місяці тому

    I think this is very interesting! I really look forward to reading all the Anti-Upscalers cry.

  • @Wigglylove
    @Wigglylove 2 місяці тому

    Do you think they would incorporate history in the future?