Nvidia Sana A New AI Model-The GPU Maker Created Their Own Diffusion Model!

Поділитися
Вставка
  • Опубліковано 27 лис 2024

КОМЕНТАРІ • 54

  • @TheFutureThinker
    @TheFutureThinker  Місяць тому +6

    Resources:
    nvlabs.github.io/Sana/
    sana-gen.mit.edu/
    arxiv.org/abs/2410.10629
    hanlab.mit.edu/projects/sana

  • @electronicmusicartcollective
    @electronicmusicartcollective Місяць тому +5

    WOW, I cant finish the projects. You always come up with such great news, thank you 👌see ya

  • @MrDebranjandutta
    @MrDebranjandutta Місяць тому +2

    About bloody time. No prizes for guessing this wont run on Apple and amd hardware

  • @crazyleafdesignweb
    @crazyleafdesignweb Місяць тому +12

    Here are a few key takeaways about NVIDIA’s Sana:
    High-Resolution Image Generation: Sana can generate images up to 4096 × 4096 resolution, making it capable of producing ultra-high-quality visuals.
    Efficiency: It uses a deep compression autoencoder that compresses images 32 times, significantly reducing the number of latent tokens and improving efficiency.
    Linear Diffusion Transformer (DiT): Sana replaces traditional attention mechanisms with linear attention, which is more efficient at high resolutions without sacrificing quality.
    Text-Image Alignment: The model employs a decoder-only small language model (LLM) as the text encoder, enhancing the understanding and alignment of text prompts with generated images.
    Fast and Accessible: Sana can generate a 1024 × 1024 resolution image in less than a second on a 16GB laptop GPU, making high-quality image generation accessible even on consumer-grade hardware.

    • @testales
      @testales Місяць тому

      I'll believe it, when I see it. That's just too good, an open model that generates higher quality images than Flux at a higher resolution and with better prompt understanding while using a lot less resources and hence a lot faster too. That sounds absurd to me. Also it's one thing to generate big image but another to create an image that actually uses it's resolution to the fullest and doesn't just look upscaled.

    • @canyongoat2096
      @canyongoat2096 Місяць тому

      @@testales Well Flux dev isnt really good at creating high res images. When it generates 1080p or 1440p images, it looks blurry and not that detailed. Ironically Schnell is doing great at these resolitons creating sharp images.

    • @ImShubhamY
      @ImShubhamY Місяць тому

      For that Vram we have to switch to AMD LOL,

    • @testales
      @testales Місяць тому

      @@canyongoat2096 No open model out there is good at creating images much larger than 1024px though with a lot of finetuning (millions of steps...) I could get a 1.5model to somewhat work up to 1536px and some SDXL models can also do 1280px pretty good. The way you can get higher resolution images out of flux and other models is with upscaling and more or less complicated workflows with noise injection and stuff. So 4k images are still somehwat easy to archieve. But with Flux this just takes ages, 2 minutes or more with a low step cound in the final stage on the best hardware you can get right now.

  • @Mranshumansinghr
    @Mranshumansinghr Місяць тому +3

    It looks more like an upscaler and enhancer than a Diffusion model.

  • @MotivationMan-p2o
    @MotivationMan-p2o Місяць тому +1

    Great video, thank you for sharing, appreciate you

  • @sambas9257
    @sambas9257 29 днів тому +1

    Quality is on par with SDXL Turbo...even in speed. But it's better in hands...

  • @Strawberry_ZA
    @Strawberry_ZA Місяць тому +2

    I will be very interested if it can generate from 4096 x 4096 latent space. We beed higher resolution before upscaling

  • @VinciSid
    @VinciSid 29 днів тому +1

    Sana All

  • @insurancecasino5790
    @insurancecasino5790 Місяць тому

    Wow. That model is mindblowing and with low Vram? Thanks for the update.

    • @TheFutureThinker
      @TheFutureThinker  Місяць тому +2

      Low parameters, low VRAM, able to do something similar to Flux, I take it.

    • @insurancecasino5790
      @insurancecasino5790 Місяць тому

      @@TheFutureThinker Word

    • @TheFutureThinker
      @TheFutureThinker  Місяць тому

      @insurancecasino5790 yes and word on image , this is awesome , it allow media agency to create banners.

  • @Lv7-L30N
    @Lv7-L30N 26 днів тому

    please compare prompts with other models

  • @HolidayAtHome
    @HolidayAtHome Місяць тому

    5:13 I don't think that's A1111, but just the default web UI look

  • @TheRoninteam
    @TheRoninteam Місяць тому

    That is pretty amazing!

  • @lancemarchetti8673
    @lancemarchetti8673 Місяць тому

    Brilliant

  • @testales
    @testales Місяць тому +1

    Meanwile we here in Germany shut down all our nuclear power plants, build wind turbines everywhere and have plans to restore the swamps that our ancestors had drained with a lot of hard work. But our moral superiority makes totally up for being left behind in terms of technological advancements that are are made in the rest of the world. We will have rescued the climate in the end.

    • @TheFutureThinker
      @TheFutureThinker  Місяць тому +1

      Wind turbine waste is a problem because the blades are made from fiberglass, which is difficult to recycle:
      Landfills: Most wind turbine blades end up in landfills, which is an unsustainable way to dispose of them.
      Incineration: Blades can also be incinerated, but this releases pollutants into the environment.
      Transportation: The blades are large and heavy, making them difficult to transport.
      Resource loss: Landfilling and incinerating blades is a loss of valuable resources.
      However, there are some ways to deal with wind turbine waste, including:
      Recycling: Some companies are developing ways to recycle fiberglass blades. For example, Danish wind company Vestas has a chemical technology that breaks down the blades into a liquid, which can then be used to make new blades or other materials.
      Repurposing: Blades can be repurposed in a variety of ways, such as in bike sheds, noise barriers, or pedestrian footbridges.
      Composting: Some researchers are developing compostable wind turbine blades.
      On calm days, wind might generate unnecessary power; and during peak usage periods, turbines might generate nothing. When the wind stops, smaller, less-efficient natural gas power plants kick in, increasing capital investment and electricity costs. Wind energy also lacks the versatility of natural gas and oil.
      www.heritage.org/energy/commentary/wind-turbines-not-green-not-reliable
      So, if it's real from what your mentioned, then tell your government, don't be stupid to use wind turbines.

    • @testales
      @testales Місяць тому

      @@TheFutureThinker The govenment isn't the root of the problem, it's the idiots who voted for it and still do so encouraged by the MSM which are controlled by those who are actually in power. Also just looking at the Wind turbines, it's even worse. Since there is a planned duty time of I believe 20 years, a Wind turbine will be taken out of service after this time while another one will be build elsewhere to replace it. On top of this since nobody ever has considered all the trouble of removing the tons of concrete which have been poured into the ground most of the facility will be left as it is. It's all about collective insanity and stupidity as even otherwise smart people don't seem to understand these totally obvious issues. Seeing how quickly other nations rise and build one technological marvel after the other and about everybody focusing on nuclear power, makes it even worse.

    • @testales
      @testales Місяць тому

      The government isn't the root of the problem, it's the idiots who voted for it and still do encouraged by the MSM which are controlled by those who are actually in power. Just looking at wind turbines, it's even worse. Since there are is planned active duty time of about 20 years or so, a wind turbine will be taken out of service after that time and anotherwill be build elsewhere to replace it. But because nobody had considered the trouble of removing the tons of concrete that have been poured into the ground, most of the facility will be left as it is. So as even otherwise smart people all these obvious issues, it's matter of collective insanity and stupidity. Seeing other nations rise and building one technological marvel after the other and about everybody focusing on nuclear power makes it only worse.

    • @testales
      @testales Місяць тому

      @@TheFutureThinker The government isn't the root of the problem, it's the id!ots who voted for it and still do encouraged by the MSM which are controlled by those who are actually in power. Just looking at wind turbines, it's even worse. Since there are is planned active duty time of about 20 years or so, a wind turbine will be taken out of service after that time and anotherwill be build elsewhere to replace it. But because nobody had considered the trouble of removing the tons of concrete that have been poured into the ground, most of the facility will be left as it is. So as even otherwise smart people all these obvious issues, it's matter of collective insan!ty and stupid!ty. Seeing other nations rise and building one technological marvel after the other and about everybody focusing on nuclear power makes it only worse.

    • @arnoldbuzdygan
      @arnoldbuzdygan Місяць тому

      Problem w tym, że nie uratujecie.
      Klimat i tak się zmieni cokolwiek ludzie by nie zrobili

  • @leonidaspap.5498
    @leonidaspap.5498 Місяць тому

    I got 2 times error and gen time over 120 secs. The suggested prompts are , logically pre-gened

  • @isabellatang7753
    @isabellatang7753 Місяць тому

    can i use this model in SD1.5?

  • @ImShubhamY
    @ImShubhamY Місяць тому

    Is this a loophole for nvidia to sell gpu's in china, through Tsinghua University...

  • @rolarocka
    @rolarocka Місяць тому

    Nice 😍

  • @SteveM45
    @SteveM45 28 днів тому

    How Can i download the pics?

    • @TheFutureThinker
      @TheFutureThinker  28 днів тому

      on the interface, mouse Hover the image, on the top right side, there's a down arrow icon, where you can download the image.

    • @SteveM45
      @SteveM45 28 днів тому

      @ hi, i see this But on my iPad i Must give them the Extension .jpg.

  • @plattendoktor
    @plattendoktor Місяць тому

    Still does not work:
    - The feet of a woman lying on her stomach in bed
    - A collapsed melting volleyball at the beach

  • @AInfectados
    @AInfectados Місяць тому

    💡Code (Coming soon)

  • @CharlesLijt
    @CharlesLijt Місяць тому

    10:28 "skin looks natural without shiny platic style"....... Man, please check that image, you can be more wrong

    • @TheFutureThinker
      @TheFutureThinker  Місяць тому +1

      I said compare with Flux , listen the whole thing not some part.
      By the way, run that in Flux, "please check that image, you can be more wrong"

  • @hmmrm
    @hmmrm Місяць тому +8

    STILL flux is better

    • @audiogus2651
      @audiogus2651 Місяць тому +1

      Anything with control net is better for me

  • @Oxes
    @Oxes Місяць тому

    hmmm

  • @PetrBelohoubek-ot5ok
    @PetrBelohoubek-ot5ok Місяць тому

    text encoder does not work :D :D :D :D

  • @VladislavKusmin
    @VladislavKusmin Місяць тому +1

    TBH it looks like finetuned SD1.5

  • @beginnenmetinux
    @beginnenmetinux Місяць тому

    Text in Dutch is much worse then Flux.

  • @PixelsVerwisselaar
    @PixelsVerwisselaar Місяць тому

    Or people who dont like to use there left brain 🤣🤣🤣🤣😭😭😂

  • @orangehatmusic225
    @orangehatmusic225 Місяць тому

    Every major company is now getting into making porn image and video generators and ai slaves... the future sucks.

  • @Deadlious
    @Deadlious Місяць тому +1

    not impressed at all.

  • @aegisgfx
    @aegisgfx Місяць тому

    No one cares about 4k (or 8k or jibbitebillion k) and no one ever Will.

    • @Wyn3e
      @Wyn3e Місяць тому

      My ranked teammates: