Oculus Quest 3 + Photogrammetry + Gaussian Splatting
Вставка
- Опубліковано 8 січ 2024
- Enjoy our new VR experience of Holic Castle. We have combined the newest technologies so you can view and admire this beautiful castle and its unique architecture. Almost 10,000 images and 200 laser scans were captured to bring this unique place into virtual reality. The surrounding areas are again created by Gaussian splatting, and we are proud to say that this is our first VR experience implementing this method.
- Наука та технологія
very nice work~!!!
Amazing work on the capturing!
The idea of combining all these technologies is really cool.
Have you tried to make an apk packaging to run directly on the glasses?
yes we did, and we are constatntly trying, but unfortunately GS is not supported yet for standalone apps
Amazing
thank you
Now walk around at ground level!
The request from our client was to make the birth view VR, as it is part of the exhibition directly in the castle and the visitors can see the place from the ground level in real. But technically its just about positioning the "walking level" lower, so it would be a problem at all. You can take a look also on the second video from this project here: ua-cam.com/video/Ne0xCRTsSHY/v-deo.html
Looks great, the details in trees etc. are amazing compared to traditional photogrammetry. Is there any way to see this experience in VR?
Google earth is the closest
@@PrimyFritzellz Google Earth is still great sure, but I would like to see the difference in the greenery with Gaussian Splatting in VR. Google just uses "old-school" photogrammetry for their map data.
You hit the point :) gaussian splatting does magic with vegetation, but it has its limits and thats the distance. If you come to close you will start to see the "splats". So in close up details the traditional PG is still winning but from a distance is GS the leader. Check this video: ua-cam.com/video/Ne0xCRTsSHY/v-deo.html
I really want a game that uses photogrammetry that looks nearly identical to the real world and make a game from it i know msfs does but bits really rough i would love to feel like i am in the real world with real lighting
A racing game maybe drivin through actual town with the actual road surface not a 3d reimagine but an actual replica where it all feels surreal
Many of the current games are using photogrammetry, but unfortunately the biggest miracles in the photorealism are making the high res textures. And the amount of the textures is still somehow limited in gaming industry... even with UnrealEngine5 and nanite
amazing work!!!
thank you
This looks like lille, france
Hi Guys!
Great work.
What PCs are you using for that kind of project size?
Best
Karol
Hi. Thank you. We are using high performance workstation and we have many various configurations. Looking at GPU, we are using Quadro card, RTX 4090 etc.
Hi, thank you for quick response@@Overhead4D !
What about CPU?
For CPU: do you think Intel works better with clouds?
As I understand the logic behind RAM is "the more the better".
Best
Karol
What drone and camera did you use?
DJI M600 with Sony A7r camera, Mavic 3, and leica rtc360 laser scanner
Whoa- is this running the VR headset or on a PC?
This particular one is running on the PC and wireless streamed into to headset
@@Overhead4D Do you think it is possible to load gaussian splattings in an apk to run in standalone?
@@Kzyon unfortunately you cant rung GS on standalone androit app.. not yet
Microsoft Flightsimulator has alot of work todo :D
we are waiting for a request from their side :)
That's great, how do we see it in VR?
You have to visit the place... that was a wish from our client to keep it only as part of their inhouse exhibition
@@Overhead4Doh okay, thanks for the reply!
Even if the aim was to have a bird - like perspective the scale seems to be wrong, it feels miniature - like, not like a real place
After watching the second video: color on this one seems washed out, and the detail is not really there, at least as shown. The other one feels magnificent in comparison [prolly also the time of day difference]. You might wanna film the next ones with HMD not on your head, shakiness does not help both with perceived detail and with yt compression algorithm struggling to keep up. Also you might want to check what color space you are working with on Q3. It is different than Q2.
Over all it is extremally cool that you have a client on that work, and the content is GOOD. Keep it up!