Road map of Gaussian Splatting possibilities

Поділитися
Вставка
  • Опубліковано 27 лис 2024

КОМЕНТАРІ • 86

  • @badxstudio
    @badxstudio 7 місяців тому +3

    Super informative brother

    • @OlliHuttunen78
      @OlliHuttunen78  7 місяців тому

      Thanks a lot! I’m just watching your latest podcast with Winbush and EJ. Great episode!

  • @360socialms
    @360socialms 7 місяців тому +9

    Excellent explanation !!, didactic and updated, which demonstrates research on the subject, a summary that cannot be found in other channels.

    • @Tactic3d
      @Tactic3d 7 місяців тому

      Cannot Say better! Exact same thoughts

  • @eldragon225
    @eldragon225 5 місяців тому +5

    I see massive use potential for Guassian Splats replacing existing 3-D tours in the real estate industry.

  • @DavidHeath-u8m
    @DavidHeath-u8m 7 місяців тому +3

    Ollie, I love your explanations and have followed your journey with Gaussian Splats since you started. Keep up the great work and coverage. Greatly appreciate your innovation and insight. Keep it coming!😄

  • @tosolini
    @tosolini 7 місяців тому +2

    Bravo Olli for a great practical video about one of the hottest 3D tech of the moment

  • @davidarhodes3d
    @davidarhodes3d 7 місяців тому +4

    Great overview, Olli!

  • @jeanm7115
    @jeanm7115 7 місяців тому +1

    Great presentation. Thank you very much. Hopefully technology develops fast so we can use a proof version of such solutions. Personally I would be grateful when Blender can clean up the .Ply model coming out of Spotshot. I then add my lighting or other objects inside an interior model for further use in 3Dvista .Glb file. Thank you once more.

  • @360_SA
    @360_SA 7 місяців тому +1

    Great job. Thank you for bringing the old way to see you, and the way you talk is amazing.
    I wish if you could show how you make the ghost room and by pressing g it goes to the normal room

  • @AndreasMake
    @AndreasMake 7 місяців тому +1

    Awesome Olli!!! Thanks for sharing your view on the practical applications and use-cases! 👌🙏

  • @alpaykasal2902
    @alpaykasal2902 7 місяців тому +1

    Great work Olli, your content never fails!

  • @ns194
    @ns194 7 місяців тому

    Thanks for putting this together, Olli. I'm on this journey with you, deploying splats in an educational setting!

  • @Olstman
    @Olstman 6 місяців тому +1

    Brilliant! Thanks For such well organised roadmap in the world of Gaussian Splatting

  • @RelicRenditions
    @RelicRenditions 7 місяців тому +1

    Thank you for another great production. Well done, Olli.

  • @imaginingPhysics
    @imaginingPhysics 7 місяців тому +1

    Thanks for these videos. Keep them coming!

  • @brappineau4161
    @brappineau4161 7 місяців тому

    This is by far the most useful video out there when it comes to gaussian splats.
    I can't wait until I can convert to mesh environments to optimize for standalone viewing. Isolating movement for 4D recordings and pasting into those for playback.... this would be amazing for capturing loved ones & moments

  • @DaveDFX
    @DaveDFX 7 місяців тому +2

    I'm using it in my VFX projects. Future is bright for 3DGS.

    • @AndresArosemena
      @AndresArosemena 7 місяців тому +1

      I just watched your tests on your channel, very cool stuff. Have you shared somewhere else your vfx shots where you used this technique?

    • @DaveDFX
      @DaveDFX 7 місяців тому +1

      @@AndresArosemena I'm on NDA for that project until I't released so I can't show anything. Will be using 3DGS and Photogrammetry for digital environmental work and in NukeX Compositing.

    • @AndresArosemena
      @AndresArosemena 7 місяців тому

      @@DaveDFX looking forward to when you are aloud to share them!

  • @hanskarlsson3778
    @hanskarlsson3778 7 місяців тому +1

    Exactly what I was looking for!

  • @monocilindro3655
    @monocilindro3655 4 місяці тому

    Your videos are pure gold, thanks!

  • @christian-schubert
    @christian-schubert 7 місяців тому +3

    WOW. This has probably been the most helpful UA-cam video in quite a while.
    Gaussian Splatting has always been a sealed book for me (yes, that is entirely on me, I could've researched the material, it's clearly out there).
    This has the potential to revolutionize Real Estate visualization!
    Just gotta figure out
    a) sustainable workflows on non iOS devices
    b) a way to circumvent subscription models - I know, "ownership" is a term of a bygone era, but I hope there's at least a way to download and OWN your CREATIONS (i.e. freely integrate them into your own site on your own terms)
    Any chance you'll follow up with a detailed video on this? 😉
    Thanks for sharing, again, this was REALLY insightful!

  • @祁风-h1g
    @祁风-h1g 7 місяців тому

    Thanks for overviewing the splatting world!

  • @punio4
    @punio4 7 місяців тому +1

    Amazing overview Olli. Hopefully I can get aboard all this before everyone else does :D

  • @Zac33544
    @Zac33544 7 місяців тому +2

    Hi Olli, great work as always! You were a big inspiration in my undergraduate dissertation on a comparative study between photogrammetry and Gaussian splatting, I’m curious to hear your ideas for Gaussian splatting in forensic science i.e. for use in police investigations and in courts.

  • @TheMrLeoniasty
    @TheMrLeoniasty 4 місяці тому

    Great video, thanks for the incredible information

  • @grafpez
    @grafpez 7 місяців тому

    I have a feeling 3DVista is going to implement Gaussian Splats hopefully soon down the track ;-) thanks for your fabulous contributions

  • @simonkennedy6116
    @simonkennedy6116 7 місяців тому

    Thanks Olli, there are some things here I hadn't heard of

  • @speedsoft
    @speedsoft Місяць тому

    Hey Olli! Amazing video. I was wondering if you have any suggestions for web embedding? At the moment I have been using Luma, but I'm interesting on producing and hosting myself.

  • @XaviSerrat
    @XaviSerrat 7 місяців тому

    great video as always, thanks for sharing your experiments and insights

  • @remedytee
    @remedytee 7 місяців тому

    Great overview! Much appreciated!

  • @surfkid1111
    @surfkid1111 7 місяців тому

    Very valuable video, thanks.

  • @우종범-s1z
    @우종범-s1z 7 місяців тому

    Great overview! Thanks

  • @mat_deuh
    @mat_deuh 7 місяців тому

    Thank you for this :)

  • @benwinstanleymusic
    @benwinstanleymusic 5 місяців тому

    Thank you so much, this is incredibly helpful

  • @CornuDev
    @CornuDev 7 місяців тому

    Thank you for sharing

  • @irrealix
    @irrealix 6 місяців тому +1

    We have released a cool plugin for After Effects to work with GS3D

  • @onvacation960
    @onvacation960 7 місяців тому +1

    Great video! Just finished my thesis about 3DGS for Virtual Production and came to a similar conclusion. Use in VFX may be imminent.
    Note, that VP does refer to all real-time XR applications in the entertainment industry, not only LED wall ICVFX. A paper that has blown me away was the Gaussian Codec Avatars by Meta. Also a great prospect for future VP.

    • @binchen-l9x
      @binchen-l9x 7 місяців тому

      I hope you can share more experiences related to 3DGS and virtual production

    • @bethany-rp2tq
      @bethany-rp2tq 4 місяці тому

      Hey, is there a way I can read your thesis? I am working on 3DGS for my thesis too :)

    • @onvacation960
      @onvacation960 5 днів тому

      @@bethany-rp2tq Hi, sorry just saw this. Is it still relevant for you? You can text me your email:)

    • @onvacation960
      @onvacation960 5 днів тому

      @@bethany-rp2tqHi, sorry just saw this. If it is still relevant for you, you can send me your email:)

  • @stagrei8233
    @stagrei8233 7 місяців тому

    Thanks for this insight

  • @andybrice2711
    @andybrice2711 7 місяців тому +1

    Scaniverse is amazing. I consistently find it to outperform Polycam despite being free.

    • @DaveDFX
      @DaveDFX 7 місяців тому +1

      Yes It's awesome ! No need to upload to cloud and the realtime points in the viewer when scanning helps a lot.

    • @andybrice2711
      @andybrice2711 7 місяців тому

      ​@@DaveDFX I've just tried the new Gaussian Splatting feature and it's incredible. And that's being processed *on a phone!*

  • @simsimsim-n2t
    @simsimsim-n2t 7 місяців тому +3

    you can also edit the .ply file in blender

  • @niks.3388
    @niks.3388 7 місяців тому

    huge thx

  • @kaxoxinho
    @kaxoxinho 7 місяців тому +1

    Hi Olli! Amazing work! Btw INRIA is also adding VR support in their Github repo

  • @Leyverse
    @Leyverse 7 місяців тому

    LOVE IT

  • @AlexRanedo
    @AlexRanedo 13 днів тому

    Hi Olli, first off, thanks so much for the very well put together content you are producing, they are of great help and entertaining too! I have a question but it seems the answer is no from researching: Is it possible to train Gaussian splats from obj/glb etc models? In particular I am hoping to convert a Matterport - Matterpak obj model (and maybe using its corresponding texture jpgs), into gaussian splats. I would imagine that thus far software such as Postshot require the original images to train the splats, so I guess it's likely not an option. Any info would be greatly appreciated as I'm at a bit of a loss with finding out. Cheers!

    • @OlliHuttunen78
      @OlliHuttunen78  13 днів тому +1

      in fact, I was just at an event where I was asked this same thing. In principle, it is possible to convert 360 images from Matterport to Gaussian Splatting format, but they must first be processed and extracted into smaller parts such as cubemap squares. Postshot does not yet understand the Equirectangular format and because of that it is important to convert frames out of 360 images without fisheye distortion. But creating a successful Gaussian model also depends on how densely the 360 ​​images for the virtual tour are captured. How far are the camera recording points from each other? I have made my own video about the cubemap conversion. you can check it here: ua-cam.com/video/hX7Lixkc3J8/v-deo.htmlsi=6qrAbyGYYZzYwHGN
      One way or another, the task is not easy, but it is worth trying.

    • @AlexRanedo
      @AlexRanedo 6 днів тому

      @OlliHuttunen78 nice on, I'll check that out. It's always interesting getting into new tech like this at a relatively early stage. Just waiting to see how it evolves...thanks Olli

  • @reasonsreasonably
    @reasonsreasonably 11 днів тому +1

    Scaniverse is out for Android now.

  • @boskobuha8523
    @boskobuha8523 7 місяців тому

    Bravo!

  • @madsvadsholt5324
    @madsvadsholt5324 7 місяців тому

    Thanks for all your research! How far away do you think we are from animating splats?

  • @bobbykingAiworld
    @bobbykingAiworld 7 місяців тому

    That is real cool.

  • @jac6350
    @jac6350 6 місяців тому

    Do you think Spotshot will have a connection with others softwares like After Effects in the future: Da Vinci Resolve , The Foundry Nuke or Autodesk Flame ?

  • @Lucky-ui7dh
    @Lucky-ui7dh 5 місяців тому +1

    Is it worth it to learn Postshot over using Polycam? Can you tell a huge difference? Thanks Olli.

    • @OlliHuttunen78
      @OlliHuttunen78  5 місяців тому +1

      Polycam is easy and with it you can create certain quality of Gaussian Splatting models. With PostShot you see how the process go and you can train much better quality models because you are able to tweak the controls and train you model much further than the default setting that Polycam offers.

    • @Lucky-ui7dh
      @Lucky-ui7dh 5 місяців тому

      @@OlliHuttunen78 You're the best.

  • @taavetmalkov3295
    @taavetmalkov3295 Місяць тому

    top channel! go Fin!

  • @KORTULSGAMEROOM
    @KORTULSGAMEROOM 7 місяців тому +2

    Thx! How do you adjust Splat Scale in Spline for your models imported from Postshot? When I import the model in Spline from Postshot each splat is tiny, like a point, and the resulting shape is semi transparent. In Postshot there is a slider to adjust this called Splat Scale. In spline it is imported as 0.1 scale instead of 1.0 like in Postshot for me.

    • @KORTULSGAMEROOM
      @KORTULSGAMEROOM 7 місяців тому

      Hm, this seems to be fixed if PLY is exported from new 0.3 Postshot instead of 0.28. However, splats look significantly better in Postshot still - in Spline now the individual splats seems too big resulting in flioating artifacts. I'll try retraining with a new version.

  • @tvguide4khv
    @tvguide4khv 7 місяців тому

    Love your English :)) thanks for wrk!

  • @buroachenbach703
    @buroachenbach703 7 місяців тому

    Great video, Ali, would you consider making a spine tutorial for GS creators - I have played with it, but I feel I’ve not comprehended it completely. I’m sure there are a few tricks that you can teach us all with spine.

  • @madfraser2017
    @madfraser2017 7 місяців тому

    Amazing Thx a Lot 🤯

  • @iainisbald
    @iainisbald 6 місяців тому

    I wonder if you could create High Dynamic Range Gaussian Splats and use them in 3D modelling workflows to replace traditional HDRIs.

  • @failerstone7100
    @failerstone7100 7 місяців тому

    I reached out to the team of Postshot.
    I asked there is any possibility to convert a e57, rcs, ryp ---> to a ply.
    They said thei are planning it in the future.
    Here is my question.
    Do you know anything to connect the gaussian splatting with a LIDAR Scanner.
    Normally you get an ugly Pointcloud where you dont really much see anything, but if you could combine these technologies, that would be insane.
    Do you know anything that is already advanced enough to process a e57 file to a nice 3D gaussian splat model?
    Thanks!

  • @brappineau4161
    @brappineau4161 7 місяців тому

    Also I noticed your UE5 character interacting with the car. Did you figure out mesh conversion?

  • @bethany-rp2tq
    @bethany-rp2tq 4 місяці тому

    What types of software can we use to render and view 4D GS for dynamic scenes where there is motion in the scene?

  • @jayes5066
    @jayes5066 7 місяців тому

    we need like an instagram for splatts. probably be best for VR/XR viewing.

  • @whatisrokosbasilisk80
    @whatisrokosbasilisk80 7 місяців тому

    What music did you use, it's a bop

  • @sharpvidtube
    @sharpvidtube 7 місяців тому +1

    I hope Scaniverse comes to android.

  • @beksf
    @beksf 5 місяців тому

    i think you are missing the piece where the video output of lumia can be fed into stable diffusion to create AI videos

  • @sirens3237
    @sirens3237 7 місяців тому

    Thanks Olli thats great, I know that Nvidia Omniverse has plans to add it. Dont have a timeline for that....

  • @kaiselone
    @kaiselone 7 місяців тому

    I would need to use this technology in the fields of engineering and architecture. Being able to take measurements and work with it using CAD software. Does something like this exist?

    • @briandavis4866
      @briandavis4866 7 місяців тому

      while the "splatting" isn't available, the pointcloud can be loaded in certain CAD/Modelling programs - I use CloudCompare to convert these to LAS points see loading in ua-cam.com/video/fCtOUtUCSmM/v-deo.html

    • @kaiselone
      @kaiselone 7 місяців тому

      @@briandavis4866 Thanks a lot!

  • @nitisharora41
    @nitisharora41 5 місяців тому

  • @abcmaya
    @abcmaya 2 місяці тому

    8:09 Skeletor?

  • @jpjpomxyz2319
    @jpjpomxyz2319 7 місяців тому

    Please remove this painful background music. It is wortless, and ruins the quality of the video. Thank you.

  • @obvioustruth
    @obvioustruth 7 місяців тому

    Excellent video 🙂👍