Hacking Reality in Unreal Engine 5
Вставка
- Опубліковано 27 сер 2024
- Uploading real world to Unreal Engine 5 to create a super small metaverse.
A short video but a long process based on 1500 pictures to recreate the all alley. Full photogrammetry from 6k videos.
I think that's what the metaverse should look like few years from now, if a company decides to put the work into that challenge.
It took me 10 days but I spent almost half thinking and learning how to get better rendering for this environment, as each environment is a new challenge for me. This 3D-scan was not easy, long hours to spent on cleaning all the messy surfaces of the top because I took pictures from ground only and had to reconstruct all the roof details.
Rendered with ray tracing in 4K resolution in 15 minutes, model quality is even beyond but I still have issues with the engine to get the best of the textures.
All models were made by me except :
Creepy doll head by MacDesigns under Creative Commons
link : skfb.ly/6rDAz
Mural : Artwork by Banksy
IMPORTANT : Edited video shared on twitter can be misleading : their 19 seconds edit is showing both REAL video and UNREAL render. I always use UE logo when it's rendered and none/camera logo when it's real life video. Original video above is made in unreal engine from 0:03 to 1:45.
Thanks for pinning this and confirming!! Still a fantastic job on the UNREAL parts!
Awesome work, just want to clarify something, because it doesn't add up. If it's "unreal engine from 0:03 to 1:45", then why does the logo only appear at 0:12? Which indication is correct, the logo or the time stamp?
@@NicKeLas time stamp is correct. To simplify I use transitions between real and unreal, one blur transition at 0:03 and the portal effect at 1:45. I wait a few secs to add logo to let some doubt at the beginning. I'll probably set camera logo in next videos as I see people are confused here 😅
@@3dystopia606 Oh, I see, thanks! Yeah, it makes sense that the transition effect separates them from one another. But yeah, because of the logo, I thought that the street sign belonged strictly to the real part right before a very spotless switch:) Anyway, glad you clarified it, keep it up!
The footage is awesome and it looks really nice! Good job!
Did you scan the location or did you model everything on your own?
If the former, what tech did you use and how did you achieve creating this scene?
Imagine walking in ancient Rome this way, or time traveling elsewhere in history. Amazing tech.
I would love that
Without accurate historical data you might as well say 'imagine walking through the shire with this." Would just be an artist interpretation, like anything else.
@@opx4real Exactly
@@opx4real and it’d still be cool
we've already made one of these for the ancient period from 1995 to 2030,
for anyone who wants to witness the first emergence of our simulated realities
Bro, this is actually bonkers. If it wasn't for the movement, I couldn't've told the difference
same! this is scary too
@bong well ok
That's because it's a photoscan. All the diffuse lighting is baked into the model's textures, and as the materials are very diffuse except the pipes (which look to be replaced to be properly smooth and reflective), they look correctly even with camera movement.
@bingchilling yeah textures look grainy
@bingchilling I agree, it’s the most impressive CGI I’ve seen but I can still see minor details that are off. Super close to real life just a little bit off!
Imagine what games will be like in 20 years time full on realism
Yeah but developers need time to manage that all
Imagine the game we are in right now !
@@swastikapsingekar4998 AAA studios will have the resources
@@user-uk9er5vw4c probably won't have the passion though.
@@sharkwithnotoes3051 don't need to. AI will do most of the job.
The lighting is really what sells it. Amazing.
The lighning is purely texture. It’s just a three dimensional photo. Ask yourself why its allways cloudy in these techdemos. ;-)
@@saschay2k you have no idea what you are talking about. The lighting is done by raytracing. It is actually bouncing around rays to calculate the brightness of objects. This is NOT baked lighting.
@@Rem_NL okay. 😊
@@Rem_NL you know that photogrammetry models come with baked real shadows and light bounces right? Ofc he is using a sun light on the project to make it better but a photogrammetry itself if well done can be realistic even without a lighting setup
@@0fenser yes you can have the models come with baked lighting and shadows. BUT this guys says and i quote " The lighning is purely texture "
In the description he clearly states : Rendered with ray tracing in 4K resolution in 15 minutes, model quality is even beyond but I still have issues with the engine to get the best of the textures.
hahaha i do like the removal of the creepy doll head, image what horror games can be created when graphics are this real ! great job
I was expecting an epic jumpscare, tbh 😅
from the distance it looks very realistic, but as the camera is getting closer, we can see the pixelated textures - still it's impressive :D
There are actually a ton of things that are off. The specular quality on wood and brick textures was way too good giving them a sheen that's unrealistic, almost reflective. The ambient occlusion around the cylindrical pipes is also absolutely unnecessarily high and under such direct light the bright side should not have any visible shadow, but you can clearly see it, breaking realism. The overall color temperature and tone mapping was also off, I think perhaps rendering and capturing in HDR would have solved the problem.
Overall still impressive, and I think we're currently on the way up from the bottom of the uncanny valley in terms of rendered photorealism.
The background sound effects really help sell it. This tech is getting freakily good, almost past the uncanny valley of environments i would say!
This looks great, just imagine that in 30 years they will be looking at this like we are looking at 90s game now.. lol
30 years lol
Humanity will die sooner
@@FutureDreamingAI idk dude with what I'm working on I hope to speed it up to tomorrow morning around the time I take my daily 💩
@@FutureDreamingAI Humanity has been saying that for millenia. You're wrong.
@@deadboltzz5199 What do you mean?
@@FutureDreamingAI bruh
Incredible work! You did a really good shot that shows the real, That's the charming of photogrammetry!
This is way too real man damn..
having AI convert everything to PBR would really take this to the next level, looks nuts well done!
That's already done, dude. Blender has a plugin e.g.
OT though, there are plenty of really bad textures here where in particular the normal mapping didn't work at all. It's completely flat.
@@azynkron yeah you’re right. I think that’s what nanite is supposed to solve but I don’t know how well it works on a much smaller scale like the near-microscopic bumps and contours on an old wall for instance. Normal and parallax mapping eventually give themselves away. Also, do ambient occlusion and shadows work on that scale? If you have near-microscopic polygons, you’ll need tiny tiny pools of AO to sell the depth of those small crevices. I don’t think that’s necessary for building a beautiful, modern game, but it’s one of those things that would really fool you if you walked up to a surface to inspect it.
There’s a VR demo done in UE5 that is excellent at showing very small polygons on cave walls and lumen does a great job of lighting it all in real-time.
@@azynkron i know it's done, i was referring to this project
I think displacement maps are what really make the textures shine. Really allows for next level appearance.
one day games will look like this in real time
c'est terrifiant j'ai douté pendant un long moment mais les pixels sur les murs sont bien présents même en qualité 4k , le boulot est insane bravo 😳👏
yep encore un peu de taff a faire sur les texture mais sinon j'arriverais pas a faire la difference non plus, d'ici 5ans ce sera parfait
the lighting, textures, modelling
All of them work together to create absolute realism
I'm so excited to see how far the technologies and especially the video games are gonna be, cause it's gonna be awesome, but please give us good IA from the enemies in those games and realistic physics
You mean AI, what is “IA” you stated?
@@thez4827 he is Spanish. IA = AI
Nobody's talking how that doll head disappeared after the guy looked up. Convenient.
This is no pun intended, UNREAL. It is so absolutely close to IRL that most people won't know that it isnt.
Oh my god congratulations, it's really hard to tell the difference between reality and Unreal Engine, the graphics have improved a lot during the last couple of years, by the way what photogrammetry software did you use to create that shot. I know there are lots of tutorials out there, but I think you should create your own to show the process of creating such realistic environments!
Is it weird that the UE footage looks better than the IRL footage? This is incredible!
@stefan I can’t verify the authenticity but I don’t see any stains. I see reflections which could have easily been recreated in UE.
@@MahkelGames or post productuin
Not weird bc it’s a french village
@@itsmattzed true but that seems like an unnecessary thing to add in post. I would guess that it is just a product of a lighting effect.
@@subarsu do French villages notoriously look bad? I’ve been to a couple and I don’t remember them having bad graphics, but that was a long time ago!
Imagine being able to recreate for example your town or something like that, it's incredible
The more you look at it, the less real it seems. The mind picks up on it eventually. One giveaway is how smoothly the camera is moving
I first saw your clip on twitter and thought it was some add on my feed and then I read the caption. You are so talented and must have taken a lot of hard work.
magnifique encore du super boulot, cela fait presque trop vrais, si quelqu'un regarde la vidéo sans être au courant il n'y verra que du feu.
Merci Fabrice ! Content que ce projet soit enfin terminé 😅
Yo c'est toi qui a fait ca? On aura pas de jeux comme ça même dans quelques années on est daccord?
@@DamageiNcDCUO Oui dans quelques années c'est sans doute possible mais en revenant à des jeux couloir plutôt que monde ouvert.
This guy recorded a Real life footage and saying its UE 5 .. oh man i was watching it sooo Deeply to check if i can find maybe a tiny difference that would say its not irl but i failed .. i can't say how mindblown i was when i saw the video Good freaking job
Look at the tires, thats the only minor difference i could see
Just like the reactions of the game "Unrecord"s Reaction. This one is way shocking to see, and very amazing work put on it.
Man, video games in the near future will be ultra realistic. It’s gonna be a new era of video games
This is so freaking good!
Interesting, have you thought about maybe tracking the shot from the video recording so you could have a 1:1 side by side comparison? I would love to see exactly what the differences are so that maybe one could bridge the gap between recording and UE5, this is extremely cool to see, nice job!
here before this blows up
Thanks ! I didn't know about camera tracking before few days ago 😅 but yes this is something I want to do in my next videos. I used my phone linked to virtual camera, it's great too but had some latency issues
actually it's not easy to tell apart the real vs the unreal engine footage...amazing job
The rain pipe weldings gave it away for me. Also every part where you expect a small gap is "smeared" over.
c'est tellement bien fait qu'on a du mal à y croire
who knows maybe 100 years from now streetview will have this fully incorporated, imagine all the streets in the world being captured with this technology, no excuse to ever be lost
Superbe travail, bravo. Vraiment très impressionnant.
The lumen technology is really great! It's practically indistinguishable from the real thing. 👏👏👏👏
Ok.... here me out.... interactive Google Street view but like this.
this is shocking bro, i play videogames since 1999
and everytime i see advancement like this my reaction it's just shock
Ngl, this is insane
Damnnn ! Looking really good :)
wow, 2 minutes of walls and 10 sec of footage of a street, truly the future!
Oak trees grow from acorns
Even the video is making my PC chug
Really unsettling. Totally cray cray.
If it wasn't for some weird reflections and that I came to see this video, I wouldn't have realized it was rendered
The only thing that gives it away is the camera movement. There’s this subtle movement that doesn’t seem quite natural.
Que qualidade fascinante.
Uma das poucas coisas que mostrou que não se tratava de um vídeo real foi o movimento de câmera em certos momentos.
Ainda é estranho algumas sombras, como se ainda faltasse um pouco de luz em alguns lugares, mas nada muito alarmante, pequeníssimos detalhes que não estragam a experiência.
Adorei tudo, deu até vontade de estudar essa ferramenta maravilhosa.
Abraços do Brasil
É literalmente um vídeo, não tem nada de unreal engine kkkkkk
@@Colfax98 logico que tem. O cara fala que o que tem o logo da unreal é feito renderizado. Só no final que é real...
@@Colfax98 Realmente, parando para pensar tudo que está no UA-cam são literalmente vídeos...
@@oprimeirogabrieltoth Transcendeu no comentario kkkkkkk
I've wanted to do this for years around my home town!!! Knowing nothing about 3D renders, I was presuming it would be really difficult e.g. taking lots and lots of hi res photos and stitching them together. I'd be really interested to see a video on how you map the areas to create this.
3 years from now I knew absolutely nothing about 3D and I've been lazy the first year. So you can definitely learn how to do it with some time! I can recommend RealityCapture channel and one of William Faucher as well as @marvelousdecay , these are very good places to learn photogrammetry. The environments like this one requires lot of cleaning and optimization, the best is to begin with little objects and increase size with time.
@@3dystopia606 Thanks! 👍
AMAZING, GAMING IS BECOMING HYPERREALISTIC
You're a madlad 👏
I can imagine videos games being this realistic within my life wow 😲
Imagine playing a Horror Game with this graphics or a VR MilSim shooter. PTSD from gaming gonna get real.😂😂😂
30 years later people will look at this video and say "I can't believe how unrealistic games looked back then lol"
Resident evil and watchdogs in this would look bonkers.
it has this surreal feeling to it
looks almost real but the minute tiny particles present in air can't be created and this makes a difference in computer graphics and reality.
The anticipation for a jump scare!
apparently, no one has ever heard of photogrammetry, and now it suddenly looks like magic
It’s always cloudy in this techdemos.
now you need to add some autofocus artifacts, camera shacking and brightness change (on 0:53 sky will be blue and all other things will go dark until it slowly balance) - 100% reality. Awesome work!
Why though? If it was a videogame, it would try to emulate the human eye, not a camera (unless it was some sort of cool fatal frame sort of thing)
ça pourrait être le point de départ d'un sacré projet de témoignage historique (si les fichiers étaient utilisables dans un futur plus ou moins éloigné): pour les historiens, les amateurs de généalogie, les artistes en recherche de références...
Sacré boulot mais le résultat est là 🤩.
If it hadn't been for that door, I wouldn't have noticed that something is off.
I think what makes this look realistic is it looks like the view of a video camera and not the eyes. I think video games would look more real if they weren't trying to replicate the view from an eye but rather a camera because we're watching on a monitor.
No. For decades this was already a remark. They remove the view because 99% of players get sick when playing for a long time. But when doing tech demos, they add it to look cool.
Great as art is thats been made from 3d scans. I dont understand how people can find it unbelievable that something made from photos can be photo real.
These streets make me crave a ultra realistic WW2 game!!
c'est un super boulot, la transition pour revenir à la vidéo est génial.
It's really impressive! Except the texture,I really impressed by the lighting environment. Could you please tell a little tips of how to set the lighting environment to be like the real world?Did you use photo-scan HDRI sky texture?
Montrichard is beautiful virtually and in reality.
If this is not real footage then we are definitely living in a simulation.
This looks so real
the doll got me scared 💀 great job 🤍🔥
aha it might come back, take care ! 😝
What I notice is that the surfaces all seem to be the same material, the metal pipes and stone wall reflect the same amount, and the reflection on the metal pipes doesn't move with the angle of the camera. Both things that could be adjusted by a human after scanning though. and maybe even by some machine learning. Still amazing though.
Thanks ! Yes this is mostly one material. The pipes are a different PBR material and too reflective compared to reality (virtual pipes are metallic, real are plastic). I'll check about the lack of reflections when camera move. Might be because there's not much direct lighting inside the alley.
@@3dystopia606 Good stuff! I meant the reflections on the pipes don't move because they are part of the texture, rather than a result of reflection. Anyway, it looks amazing, I was only noting the small things that our brains notice but we sometimes don't. For sure we have AI that is able to identify and assign the correct material properties within a few years. And next gen VR... I can't wait.
My brain knows something is wrong, my eyes are trying to find any flaw that discerns from actual reality, I personally know this is game footage, and my mind is fucking losing it.
c'est tellement bien fait que j'arrive pas à savoir si c'est un mensonge ou pas
the displacement on the walls gives it away
The drainpipe looks like something off the PS2
the real life part looks very real, the unreal engine 5 part looks very unreal
So in the future, you'll be able to virtually travel to cities without even stepping on an airplane? Cool.
Impressive.Thanks for sharing your work. Can't wait to see more use of protogrammetry
For a trained eye, we're probably still a good ten fifteen years away from not being able to tell if something is a video recording or a video game
I was waiting for a jump scare when that head disappeared
waa aussi crédible que la réalité tu ne l'aurais pas mis dans le titre j'aurais pensé que tout est réel, gg !!
If you can add bugs, ants at the wall and floor that would be so real and cool
0:28 the baby head disappeared
This is insane , rly great work
Looks great but you can see clear pixelation especially from the sides of the walls. The textures (ik it’s a real image scan) are a bit low res and at certain points look like a PS1 texture if you zoom in a bit.. but no. This is great work, keep it up
Thanks for your comment ! You're right, actually textures are really high res on paper, but because it was captured by video, there's some blur in it. That's what can make it look low res on some spots more than others. It was faster and more convenient to do, compared to taking pictures, which is often ending in 🧐🤨 face reactions from neighbors ahah
I can't help but imagine the creation of false proofs via Unreal Engine and the usage of them against someone. That's creepy
They should re create London 1888 Whitechapel,would be awesome to see jack the rippers hunting ground,maybe turn it into a game
Ok did nobody else notice the baby head is there at 0:19 then gone at 0:39 ??
Are you scanning the entire alley? Really is amazing work. Anytime I see something like this that looks super real, I know before I look it’s yours. LoL
Aha thank you ! Yes I scanned the entire alley but only the first part is highly detailed to get lighter file. I'll probably do more of this concept, even if it's the second video that youtube algoritm seem to boycott.
@@3dystopia606 why in the world did it boycott it??? It’s literally an alley! LOL that’s crazy. Man, did it take a long time to scan it?
@@MarcIndy333 Well they have their own rules and since we're not allowed to know it too... 😅 the scan was not so long but it litteraly took days to clean and then what took the most time was cleaning the little details that looked wrong. It was like 2% of the surface but it made it obvious that it was 3D (the gutters and plastic parts, mostly..)
This is not unreal engine, this is fcking real engine.
Alright this is pretty insane.
Wow, stunning work!
This is just ,,
what can I say ,,,, _Unreal?_
Imagine counter strike or battlefield with this graphic😍
amazing work, thats the new gaming
it looks so real
Imagine if a Bethesda game looked this good
Nahh this is unreal.. pun intended 🔥🔥
Imagine Half Life 3 looking like this
Still looks uncanny, bit like interactive version Google street view, but this may be fault of ingame camera. I wonder how convincing would look scans of more sleazy environment.
I want some resident evil horror game with this graphics 😲 wow