I would like to do PostShot to RealityCpature with my original video RC failed and built a broken model PS did great and I have a very good quality gaussian. ply I would like to convert it into a mesh inside the RC Is there a way to do it? Thank you for your videos
when you say its trivial to have the same coordinate data for photogrammetry and g splats what do you mean? do you have the option to export either one once you import all your clips?
thanks for the video, got my little scene to unreal too after this workflow. Any tips on model or settings for export/import, to have scene appear normal in VR? I imported to ue5 vr template but in vr-review, the splatting model seems to be non-stereo, something is off.. feels bad when looking with both eyes.
This is really good stuff. I've been trying to get a decent point cloud built in Reality capture but it always creates so many different components. Do the components have to be merged together before the PLY file is exported from Reality Capture or how is it done? I tried to look at the settings in your video and it looked like you had many separate components too.
Correct, everything needs to be merged into a single component for things to be aligned properly. In terms of your work (combining multiple cameras or views from a 360 camera), there are some tricks to making sure everything aligns like, making sure all cameras "see" the same feature at the start/end of a loop. You could even print out AprilTags that will ensure RC will recognize them as shared features across the cameras: wizardofaz.medium.com/how-to-use-my-3d-printable-apriltag-scale-markers-for-realitycapture-6e3244da050e I have a few more tricks listed out here: wizardofaz.medium.com/reality-capture-alignment-tips-fixes-d49371ee6643
You mention that you need to export registration and point cloud files to the same folder as your images. I usually have my drone images in a separate folder to handheld images following a component workflow in RC and then merge components. Is there a way to make this workable with your process? Thanks
Hey man, is it possible to use this without PostShot. I am trying to use the imagine alignment of RealityCapture and make it work in Gaussian Splatting in the same time.
At 7:01 you say "If you want to use the mesh from photogrammetry but the visuals of gaussian splatting, importing them and having them be aligned at the right scale is trivial because they're based on the same alignment data, so that to me is a massive benefit." Sorry if this is a dumb question, but are you just talking about how RC is useful for alignment, or can you actually combine the mesh from RC and the splat from Postshot in some other way? Is there a way to combine them beyond alignment data?
Great tutorial, like always! Did not used PostShot a couple weeks, I see they added new option " Splat MCMC" - does it work better compare to just "Splat" ? Thank you
Why will you go on RC first if you can train the photos directly on PostShot? Can you help me understand, on RC you will need to create the model, texture, unwrap, and export, it's a large workflow just to get a 3DGS.
No, you don't need to create the model, unwrap, texture, etc. You just need to align and export. The reason you'd do that is because RC's alignment is much faster than PostShot's COLMAP. Watch the intro again.
@@AzadBalabanian I tried your process on Postshot just with Alignment and the photos, after a while on Postshot I received the message "Reach the maximum 32k' but the Gaussian result is ugly. I think the process isn't finish. I have a 4090 don't think the error is about Vram
@@markinmkn I imagine it's due to the accuracy of the alignment isn't very high? Try using the default "compute from images" setting in PostShot instead of importing RC alignment
Depends on the data. However, I agree that Metashape can have a more robust alignment than RC's sometimes. There is also a PostShot workflow for Metashape as well. But RC is my preferred software and is now free to use
thank you for your tutorial
I have finally understood why i couldn't do it
Never heard of this app. Miss seeing your posts on twitter (since I quit it a while ago) but will certainly check out your blog more often!
Thank you, this greatly improved our results and made the process faster!
Massive thanks for sharing! I haven't kept up with gaussian splatting and this brings me up to speed and gets me fired up at the same time 🙏
Excellent! I was stuck on exactly what/how to export for import into Postshot.
I would like to do PostShot to RealityCpature
with my original video RC failed and built a broken model
PS did great and I have a very good quality gaussian. ply I would like to convert it into a mesh inside the RC
Is there a way to do it? Thank you for your videos
Thanks Azad! You are always ahead in digital twins!
Helpful??? - I's fkn game changer for me man. you have solved a MASSIVE issue I had. Thanks, Top man!!!
Pretty cool workflow. Thanks for sharing.
when you say its trivial to have the same coordinate data for photogrammetry and g splats what do you mean? do you have the option to export either one once you import all your clips?
Failed to import files: PlyReader: unexpected table size? what is this mean?
thanks, awesome tutorial!
thanks for the video, got my little scene to unreal too after this workflow.
Any tips on model or settings for export/import, to have scene appear normal in VR? I imported to ue5 vr template but in vr-review, the splatting model seems to be non-stereo, something is off.. feels bad when looking with both eyes.
This is really good stuff. I've been trying to get a decent point cloud built in Reality capture but it always creates so many different components. Do the components have to be merged together before the PLY file is exported from Reality Capture or how is it done? I tried to look at the settings in your video and it looked like you had many separate components too.
Correct, everything needs to be merged into a single component for things to be aligned properly. In terms of your work (combining multiple cameras or views from a 360 camera), there are some tricks to making sure everything aligns like, making sure all cameras "see" the same feature at the start/end of a loop. You could even print out AprilTags that will ensure RC will recognize them as shared features across the cameras: wizardofaz.medium.com/how-to-use-my-3d-printable-apriltag-scale-markers-for-realitycapture-6e3244da050e
I have a few more tricks listed out here: wizardofaz.medium.com/reality-capture-alignment-tips-fixes-d49371ee6643
You mention that you need to export registration and point cloud files to the same folder as your images. I usually have my drone images in a separate folder to handheld images following a component workflow in RC and then merge components. Is there a way to make this workable with your process? Thanks
Currently, I don’t believe so (and it’s an annoyance for me as well for org purposes)
Hey man, is it possible to use this without PostShot. I am trying to use the imagine alignment of RealityCapture and make it work in Gaussian Splatting in the same time.
Thank you, excellent content!
At 7:01 you say "If you want to use the mesh from photogrammetry but the visuals of gaussian splatting, importing them and having them be aligned at the right scale is trivial because they're based on the same alignment data, so that to me is a massive benefit." Sorry if this is a dumb question, but are you just talking about how RC is useful for alignment, or can you actually combine the mesh from RC and the splat from Postshot in some other way? Is there a way to combine them beyond alignment data?
certainly. You can combine them in engine and create a seemly blend of the two. See: ua-cam.com/video/-cAL9zQGRVE/v-deo.html
are you using the Apple Vision pro in this? the headshot is sick brother
Indeed!
Thanks for your excellent tutorial! Will you share this dataset sample in youtube for downloading?
Great tutorial, like always! Did not used PostShot a couple weeks, I see they added new option " Splat MCMC" - does it work better compare to just "Splat" ?
Thank you
I believe that’s now the default splat model. There’s another model that focuses on density. Haven’t tried it much though.
@@AzadBalabanian Thank you
Really cool tutorial and thks for the script, but I tried with nef files (Nikon Raw) and postshot don't recognize the format (need to try with jpg)
I don't suppose you have a tut on how you use control points to create real world relative accuracy?
Here ya go ;) wizardofaz.medium.com/setting-1-1-scale-in-realitycapture-aadeaafc3737
Veery cool, thank you
Yes please, I subscribed and am super keen to see more videos.
Your shortcuts are lightning as well.
Why will you go on RC first if you can train the photos directly on PostShot? Can you help me understand, on RC you will need to create the model, texture, unwrap, and export, it's a large workflow just to get a 3DGS.
No, you don't need to create the model, unwrap, texture, etc. You just need to align and export.
The reason you'd do that is because RC's alignment is much faster than PostShot's COLMAP. Watch the intro again.
@@AzadBalabanian Thank you for your help, did you already try that with laser scan data inside RC?
@@markinmkn I dont understand. Yes, you can process LiDAR data in RC. No, I don't think they'll work in PostShot for gaussian splatting
@@AzadBalabanian I tried your process on Postshot just with Alignment and the photos, after a while on Postshot I received the message "Reach the maximum 32k' but the Gaussian result is ugly. I think the process isn't finish. I have a 4090 don't think the error is about Vram
@@markinmkn I imagine it's due to the accuracy of the alignment isn't very high? Try using the default "compute from images" setting in PostShot instead of importing RC alignment
It won't work while the target is in actions from a single camera.
tq bro share
按流程做了一遍，到postshot提示，plyreader：unexpected table size
also RC alignment success is like 10x lower than Agisoft
Depends on the data. However, I agree that Metashape can have a more robust alignment than RC's sometimes. There is also a PostShot workflow for Metashape as well. But RC is my preferred software and is now free to use
I have 100% CPU usage and 0% GPU usage in RealityCapture1.4 alignment, here's why.