Tutorial - Gaussian Splatting

Поділитися
Вставка
  • Опубліковано 28 гру 2024

КОМЕНТАРІ • 45

  • @GevaiseQuinlan
    @GevaiseQuinlan 13 днів тому +1

    probably the cleanest splat ive seen

    • @GevaiseQuinlan
      @GevaiseQuinlan 12 днів тому +1

      im also trying to do this and having so many issues lol. alot of packages that needed to be installed besides nerfstudio, im stuck at `GLIBCXX_3.4.32' not found

    • @GevaiseQuinlan
      @GevaiseQuinlan 12 днів тому +1

      never mind after 4 hours i figured it out lol
      forgot to instal gsplat on top of nerf, for some reason i thought it was built in lol

  • @chejz
    @chejz 15 днів тому +1

    Man this is amazing, I have learned a lot of stuff here. May I ask you to do huge scene, like arial one for bigger environment? would like to see how it looks :)

    • @simonbe
      @simonbe  15 днів тому

      @@chejz I would love to, but as a responsible fpv Pilot, I know that there is almost no legal way to fly drones over interesting areas without a special permission...

  • @johanneskrugersoftwaredeve9408
    @johanneskrugersoftwaredeve9408 2 місяці тому +4

    Outstanding video. By taking tips, I was able to massively increase the quality of my results. I look forward to all your further videos.

  • @lolo2k
    @lolo2k 2 місяці тому +1

    Great video. I'm glad we can share this process with such clarity now.

  • @OlliHuttunen78
    @OlliHuttunen78 2 місяці тому +2

    Very good and clear tutorial. I need to test those april tags also with my reality capture alingments. Thanks for showing how they work.

  • @Henning_In-den-Birken
    @Henning_In-den-Birken Місяць тому +1

    I find the video very inspiring, even if I don't understand what exactly is happening in the background. Many thanks for the interesting insights, Simon. 💪

  • @realitycapturehk-danny915
    @realitycapturehk-danny915 Місяць тому +1

    Thank you very much for sharing! It's highly useful and helpful.

  • @kjlf1212
    @kjlf1212 Місяць тому +1

    Thank you very much for sharing! It looks amazing!

  • @Royvcent
    @Royvcent Місяць тому +2

    Nice tutorial! What mm lens did you use?

    • @simonbe
      @simonbe  Місяць тому +1

      @@Royvcent it's an 18mm lens on full frame

  • @jakaverk7500
    @jakaverk7500 2 місяці тому +1

    Wow awesome video.

  • @manual1398
    @manual1398 2 місяці тому +1

    great tutorial Simon! 👏👏👏

  • @kangaroowang4900
    @kangaroowang4900 2 місяці тому +1

    great tutorial!

  • @holmesstony3138
    @holmesstony3138 2 місяці тому +1

    Thank you! That's very great video! I learnt a lot!

  • @DamaruM
    @DamaruM 2 місяці тому +1

    excellent tutorial. really useful.

  • @taviuskoktavy3235
    @taviuskoktavy3235 2 місяці тому +1

    Really solid tutorial, thanks! I need to be scanning by DSLR more often. Can the next video be a rundown of all the nerfstudio parameters and why/when to use them?

    • @simonbe
      @simonbe  2 місяці тому

      Thank you :) I might do a video about supersplat next.
      Regarding nerfstudio, I can try saying something about the params I use, but I am no expert in that

  • @jank54
    @jank54 Місяць тому +1

    Many thanks for the very well explained insight of your process. I am doing tests right now with Jawset Postshot But my results are far away from your final dataset. Great work. Many thanks for sharing your final model. The problem with my capture is that we have white walls and a white floor in the office, the result is that there are much too less points generated on the walls... I will try to add the april tags, see, what postshot will come up with. Maybe a workshop or a garage could be something to capture better.

    • @simonbe
      @simonbe  Місяць тому +1

      @@jank54 white walls are really hard to resolve. I think the best option would be to choose an option with using lidar of an iPhone

    • @jank54
      @jank54 Місяць тому

      @@simonbe LiDAR of an iPhone is achievable in the App Scaniverse at no costs, but the first tests were unpromising. But maybe I'll give it one more shot with the AprilTags together.

  • @jakaverk7500
    @jakaverk7500 2 місяці тому +3

    Did your images contain any blur since you took photos at f/4? My Nikon D750 with Tamron SP 24-70 produces very blurry photos if I do not have f-stop at like 11 or 13.

    • @simonbe
      @simonbe  2 місяці тому

      Honestly: yes they did. Also I made half a mistake by not using auto focus and forgetting to readjust the manual focus. I did use manual focus, because sometimes focusing blocks the shooting. I can provide some samples later today.

    • @simonbe
      @simonbe  2 місяці тому

      Here are some samples: drive.google.com/drive/folders/1QDa3ikW-ZbZPJi079RyIp1EGahn1CjQ4?usp=sharing

    • @jakaverk7500
      @jakaverk7500 2 місяці тому

      Did you get better results with NerfStudio than with PostShot?

    • @simonbe
      @simonbe  2 місяці тому

      @@jakaverk7500 I have never tried postshot but it's results look very good. However, I expect postshot to become expensive soon...

    • @jakaverk7500
      @jakaverk7500 2 місяці тому

      @@simonbe I am also afraid that it will be to expensive :(

  • @Z3r0cks
    @Z3r0cks Місяць тому +1

    Is it possible to use your dataset and the transforms.json for my master thesis? I need to do distance measuring in a NeRF scene and do not have enough time to do this on my own. One very important part is the pose estimation.

    • @simonbe
      @simonbe  Місяць тому

      @@Z3r0cks Yea, I think that's fine. I have to check if I have all those files ^^

    • @Z3r0cks
      @Z3r0cks Місяць тому

      @@simonbe It would be awesome.

    • @simonbe
      @simonbe  Місяць тому

      I think I have all the files you need. Can you maybe contact me directly on discord? Maybe on the server of Nerfstudio?

  • @InLoveWithFlight
    @InLoveWithFlight 2 місяці тому +1

    Nice!

  • @xscapevisionoyedo856
    @xscapevisionoyedo856 Місяць тому +1

    great work. Please explain How to export to obj with good usable mesh. My results are not very good

    • @simonbe
      @simonbe  Місяць тому

      This not possible. Gaussian Splats are a different kind of matter.

  • @cdvsguo923
    @cdvsguo923 2 місяці тому +1

    If I don't want AprilTag to be in the image, is it still captured well? I don't think it looks good to have AprilTag in the final render.

    • @simonbe
      @simonbe  2 місяці тому +3

      @cdvsguo923 that depends on the detail in the scene. Also you can set control points manually. You should just give it a try.
      Also the Supersplat editor will next implement copy&paste. When this is implemented, I will try removing the tags in 3d and fill the holes with copied similar parts

  • @octacongeotechnikgmbh5569
    @octacongeotechnikgmbh5569 2 місяці тому +1

    great!! where can I get the april tags?

    • @octacongeotechnikgmbh5569
      @octacongeotechnikgmbh5569 2 місяці тому +1

      hah, its in the description already! Thanks Simon!! 🙏🔥🚀

    • @simonbe
      @simonbe  2 місяці тому +1

      @@octacongeotechnikgmbh5569 Yea, it's in the description. Alternatively, you can look in reality capture. Below the "Detect" button is another one, that let's you export markers as PDF for printing on paper. However, the contrast of tags printed on paper didn't work well for me