To answer frequent questions. The software used is Reality Capture. I recorded video with a gopro mounted on a bike. 4 directions are recorded, forward, backward, left and right. Every 10th frame, or so, is extracted from the videos, not every frame is used. There were about 4.000 images, but with later experiments I realised it could be done with much less. This reconstruction took about 5 days with a lot of manual addition of many control points, not counting numerous previous failed attempts. It was reconstructed in parts and then they were combined together into one whole track. The whole track is 1,4GB. 700MB are textures and kn5 file is other 700MB Regarding tutorial. I am planning a bigger project with a larger part of the city in next few months. I will record the process and try to make something between tutorial and devlog. Thanks for your interest.
If you have the power necessary, try to feed those parts into an evaluation system. Imagine having a working AI that is able to recreate Props and outlines from life camera footage. Could revolutionize gamedesign as a whole.
You should make a track about the historic center of Rome, Colosseo included. I have an AirBnb i'd give you for free for as much as you need here near the Rome historic center, whenever the Covid situation gets better. A track like that could sell greatly! Good job
It's called structure from motion - there's plenty of free and open source software out there that can be used for it. Someone did something similar as an experiment many years ago, but the quality of the mesh was pretty poor (particularly where reflections are involved). There's a reason laser scanning is generally preferred.
I think 20 years is to much tbh. I think realistically something like 8 years from now. 10+ years and plus is like real-life VR territory. Imagine wind hitting you and feel everything all from your room while racing anywhere in the world....
@@mosasa1307 Nah, 20-30 years is right on par with how long it would take. You have to account for the fact of where current tech stands. To make something on the scale the OP was talking about, within less than a decade they would have to begin working on it within the next few years. And the fact remains that current CPU and GPU tech would not be able to do it. Just look how Microsoft Flight simulator brings all but the highest end built PCs to their knees in terms of performance. And the graphical quality is not even that high.
Combine that with iRacing driving physics, BeamNG destruction model/physics, Forza Horizon 4 car selection, Automation level of modification, toss in some peds with GTA ragdoll physics and funny ass monologues, police chase minigames from NFS and we've got a forking game, lads.
I think you could already create maps in rfactor 1 using google maps but i don't remember how (they were only roads until you added the buildings i think)
@@istvanilosvai2962 Ah but google maps wouldn't work for the types of roads Im talking about. Plenty of underpass sections in the city and forested areas out in the twisties don't work with Google Earth's imaging, you'd have to go out and take the footage yourself like the guy who made this video did.
This is really cool. I can't wait for this technology to reach a point where you could just mount a few cameras on your car and get a usable track. It would be cool to model your route to work for example, and see how fast you could get to work in a racecar.
This is absolutely amazing! I really mean it. I can't believe how far in the 'future' we are, removing the need to take several pictures of a street, having to match the focal lengths and such, not being so sure of things in terms of distances when roads are curving upwards or downwards, this is absolutely amazing. The results were more than useable, they were splendid for what they had to work with.
Now just put an A.I system that can read both of these variables and correct the defects; the real word and the photogrammetry, and you got a true simulation. Awesome work regardless
This is absolutely insane. Does it just create one huge texture as well? Do you mind saying which program you use to get it from gopro footage to mesh?
@@djtechnodj that would make the track look better in reverse. The issue here is that there is very little vertical movement so you don't have that much information about the shape of things.
@@SHRModding yeah, the better the footage the better the model. Sharper footage with less motion blur will give better models while higher detail and better colours will improve the textures.
To do this you need to take a lot of photos of the area that you are interested with (preferably aerial), then with professional software (such as Agisoft Metashape) you have to process these photos to create cloud of points and then if you have these points you'll probably be able to export them as a model. From that point I don't know much about AC modding but I suspect it won't be that difficult to convert it to a format that AC supports.
Look up structure from motion on UA-cam and you'll find information on how to do this. There's quite a lot of open source software capable of creating point clouds and meshes using this technique.
@@izzieb right but does it teach you how to make a map and port it over to assetto corsa? I really want a 1:1 of my city(Minneapolis) and just race around where I'd usually drive a Toyota Camry LMFAO.
@@mosasa1307 i'm in the process of figuring this all out. #1 - its not simple. you cant just make one tutorial for all this. start with 'photogrammetry'. look up a program called 'meshroom' and try it out. then look at assetto corsa track building tutorials. #2 - you wont be able to build an entire city. you might be able to manage a whole neighborhood or something.. maybe a square mile worth of city... but theres no way to jam an entire city into a game without a whole professional development team spending months on it. its definitely worth messing with though. highway networks and such have been built for assetto corsa, so modders can do some pretty ambitious things. give it a shot.
Look up structure from motion on UA-cam and you'll find information on how to do this. There's quite a lot of open source software capable of creating point clouds and meshes using this technique.
Wow this is so cool! I have been thinking lately that games will eventually go in this direction but I thought roughly 20-30 yrs from now, I’m so excited it’s possible now! 🙌🏻 Also I appreciate the work you put into this 🏁
Dude its amazing when you think about it. Having the chance to race in your neighborhood and other parts you would never race irl is insane. Like imagine racing around your school or something.
MAAAAAAANNNN! this is amazing, I allways had this dream of a an open world sim/circuit on real cities... Very nice work. It's mater of cleaning the mesh on the street/side walk... Even for a mod you should start a croudfund for this! Great Work!
Looks like those weird dreams.. Dont get me wrong, I freaking LOVE IT! It made me feel like I want to do the same thing in my neighbourhood. Looks amazing
This is legit one of the few things I watched this year that legit impressed me, I had no idea we were at this point in the technology if creating virtual game maps. I wonder if big AAA game developers are already using this technology which would explain why most open world games have really impressive maps.
This some witchcraft
How fast you reckon you can lap it on a lawnmower?
Love your videos Jimmy! The Automation hillclimb livestream was a banger
jimmer???
So I was not the only one to get this recommended to me lol
Ayy
To answer frequent questions.
The software used is Reality Capture. I recorded video with a gopro mounted on a bike. 4 directions are recorded, forward, backward, left and right. Every 10th frame, or so, is extracted from the videos, not every frame is used. There were about 4.000 images, but with later experiments I realised it could be done with much less. This reconstruction took about 5 days with a lot of manual addition of many control points, not counting numerous previous failed attempts. It was reconstructed in parts and then they were combined together into one whole track. The whole track is 1,4GB. 700MB are textures and kn5 file is other 700MB
Regarding tutorial. I am planning a bigger project with a larger part of the city in next few months. I will record the process and try to make something between tutorial and devlog.
Thanks for your interest.
Looking forward to a tutorial. 🥳
Nice work !!
If you have the power necessary, try to feed those parts into an evaluation system. Imagine having a working AI that is able to recreate Props and outlines from life camera footage.
Could revolutionize gamedesign as a whole.
maybe you could use a 360 camera
You should make a track about the historic center of Rome, Colosseo included. I have an AirBnb i'd give you for free for as much as you need here near the Rome historic center, whenever the Covid situation gets better. A track like that could sell greatly! Good job
This is the perfect way to get started with a neighbourhood track and then clean it up by hand! I would love to know how this was done!
+1 modding comunity is waiting for that
please
It's called structure from motion - there's plenty of free and open source software out there that can be used for it.
Someone did something similar as an experiment many years ago, but the quality of the mesh was pretty poor (particularly where reflections are involved). There's a reason laser scanning is generally preferred.
@@izzieb You can also get models from google earth.
I’ve always wanted to race through my neighborhood lol!
in 20 years we will drive through the whole world captured in absolute detail with this technology like it was nothing.
That will be so awesome.
I think more like 30 years, and in 50 years it's gonna be on play station 10
I think 20 years is to much tbh. I think realistically something like 8 years from now. 10+ years and plus is like real-life VR territory. Imagine wind hitting you and feel everything all from your room while racing anywhere in the world....
@@mosasa1307 Nah, 20-30 years is right on par with how long it would take.
You have to account for the fact of where current tech stands. To make something on the scale the OP was talking about, within less than a decade they would have to begin working on it within the next few years.
And the fact remains that current CPU and GPU tech would not be able to do it. Just look how Microsoft Flight simulator brings all but the highest end built PCs to their knees in terms of performance. And the graphical quality is not even that high.
We already flying the entire world... The entire world.... So
This is one of the coolest things I have ever seen.
You AC modder guys are incredible. 10/10
Hear me out
“Microsoft Flight Simulator”
“But with cars instead of plane”
100% possible in the future
Combine that with iRacing driving physics, BeamNG destruction model/physics, Forza Horizon 4 car selection, Automation level of modification, toss in some peds with GTA ragdoll physics and funny ass monologues, police chase minigames from NFS and we've got a forking game, lads.
Cars don't fly bro.
equals to American Truck Simulator in 10 years, probably
Microsoft Driving Simulator lol
Don't (DO!) let Google see this. Imagine the GMaps SIM becoming a thing.
3 laps of Norway today lads!
I really hope they release some kind of track builder using this, so much potential in my local roads if they werent covered in engine oil and diesel.
@@CheapskateMotorsports So much potential in so many city roads
If speeding wasn't illegal 😢
This real life track digitizer thing is an absolute dream
I think you could already create maps in rfactor 1 using google maps but i don't remember how (they were only roads until you added the buildings i think)
@@istvanilosvai2962 Ah but google maps wouldn't work for the types of roads Im talking about. Plenty of underpass sections in the city and forested areas out in the twisties don't work with Google Earth's imaging, you'd have to go out and take the footage yourself like the guy who made this video did.
@@CheapskateMotorsports Street view is part of Google maps. It could be done if google used the same camera setup here
Amazing work! Can't wait to see it finished 🤙🏻
Same! This is very promising!
Mr. M helloooo!
What's up Mr. M!!
welcome people
@@LordKurian what
"Honey, why is there a race car passing by?"
Bec au s e H
h
Not gonna lie these visual glitches even have their own unique charme
looks like some weird dream where everything looks weirdly real but just slightly off
exactly what i felt
As a kid, I always dreamed about being able to race around my city in a video game. Awesome to see that this might become possible in the near future.
I feel like I've been waiting for this my entire racing game career
Finally, I can race around the neighborhood without waking them all at 3am.
Looks like your neighborhood had a nuclear aftermath xD.
Jokes apart, well done 👍
welcome to the balkans buddy
What? No it doesn't.
@@komrander7497 lol the models are a bit dented it'll buff out
Does kinds look like fallout tbh
But like russia
Wowwwwwwwwwwww
slap you here what?
Further in the Comments, software used was Reality Capture using a GoPro & a bike.
This mod really goes above and beyond, very revolutionary for a mod!
This is really cool. I can't wait for this technology to reach a point where you could just mount a few cameras on your car and get a usable track. It would be cool to model your route to work for example, and see how fast you could get to work in a racecar.
@@Roderickspeeder That's awesome!
This is absolutely amazing! I really mean it. I can't believe how far in the 'future' we are, removing the need to take several pictures of a street, having to match the focal lengths and such, not being so sure of things in terms of distances when roads are curving upwards or downwards, this is absolutely amazing. The results were more than useable, they were splendid for what they had to work with.
1:25 Neighbourgring GP 2021 start here
Lmaoo
Gotta go to each house neighbouring
Hahahahaha!
what I really love all the relics on the road. the houses, car on the side road, poles. pretty good job
Svaka čast, ovaj video ima da explodira za par dana.
Now just put an A.I system that can read both of these variables and correct the defects; the real word and the photogrammetry, and you got a true simulation. Awesome work regardless
At high speed...it looks freakin' passable and so realistic.
This is really cool and has some serious potential, keep it up !
This is absolutely insane. Does it just create one huge texture as well? Do you mind saying which program you use to get it from gopro footage to mesh?
The higher the speed, the more difficult it is to distinguish from reality. Stunningly😯👍
If you use two cameras, one like this one and second above the car on stick then the models should be better. Overall immersion is good. Gratz.
What about 360 cameras? Would it work?
@@djtechnodj that would make the track look better in reverse. The issue here is that there is very little vertical movement so you don't have that much information about the shape of things.
@@Bruno-cb5gk very interesting, does the quality of the footage matter? for example, is it worth using a dslr over a gopro?
@@SHRModding yeah, the better the footage the better the model. Sharper footage with less motion blur will give better models while higher detail and better colours will improve the textures.
Imagine driving your dream car in your hometown...
Respect the enthusiasm!
I see some great potential in this.
More and more outstanding things taking modding to another level, I can see how perfect (literally) mods will be in few years
Brilliant technology. This should get some more attention and progress more.
it's a future of sim racing.
good job,man
Real life: actual neighborhood
Assetto Corsa: *it seems this town has been exploded by a nuculear bomb*
This is like one of those trippy dreams that feel real, but little things make it seem just off
It looks really good! I'd definitely play the heck out of this track if you released it!
this is really cool . i can already see me and my homies doing biggest convoys
Any tutorials on how to do this?
Same
X3
X4
X5
To do this you need to take a lot of photos of the area that you are interested with (preferably aerial), then with professional software (such as Agisoft Metashape) you have to process these photos to create cloud of points and then if you have these points you'll probably be able to export them as a model. From that point I don't know much about AC modding but I suspect it won't be that difficult to convert it to a format that AC supports.
THIS is the stuff i always dreamed of happening. Keep it up
Can you please make a tutorial on how to do this, I'm sure everyone would like that
Need to learn this!
Look up structure from motion on UA-cam and you'll find information on how to do this. There's quite a lot of open source software capable of creating point clouds and meshes using this technique.
@@izzieb right but does it teach you how to make a map and port it over to assetto corsa? I really want a 1:1 of my city(Minneapolis) and just race around where I'd usually drive a Toyota Camry LMFAO.
@@mosasa1307 ye same
@@mosasa1307 i'm in the process of figuring this all out.
#1 - its not simple. you cant just make one tutorial for all this. start with 'photogrammetry'. look up a program called 'meshroom' and try it out. then look at assetto corsa track building tutorials.
#2 - you wont be able to build an entire city. you might be able to manage a whole neighborhood or something.. maybe a square mile worth of city... but theres no way to jam an entire city into a game without a whole professional development team spending months on it.
its definitely worth messing with though. highway networks and such have been built for assetto corsa, so modders can do some pretty ambitious things. give it a shot.
That's why we love our Assetto Corsa community and modders impressive mate keep it up man
0:23 Lada Niva, yeeeeeee(I'm russian)
I'm Serbian broo
I think you have hit on something pretty special here, this is genius!!
This would be amazing for making rally stages
OMG this is unreal! Wow, when I look at something like this I get super excited about the state of sim racing in the next 5-10 years. God status!
please make a tutorial for this!
Congratulations on a great work, we hope to see it soon and see your other projects even much bigger. Hi, and thanks for sharing!
0:23 - Вау, это же настоящая русская Нива
Она там не одна, скажу так
Yeah there's many Lada Nivas in Serbia
the way it fcks up skinny trees actually looks very artistic. cool aesthetic and all around very impressive.
Oh the back road rally tracks I could make of my local home town
Just imagine what happens if someone helps this dude. All this blurry texture is so negligible and easily fixable. Amazing work man,amazing!
Could you make a tutorial on how to do this?
Look up structure from motion on UA-cam and you'll find information on how to do this. There's quite a lot of open source software capable of creating point clouds and meshes using this technique.
@@izzieb But how to put that information on the game?
@@paulofernando7858 same as how you would design a track in 3D like 3ds max or blender and port it to AC i guess?
This bodes really well for the future of truck and bus simulators
Okay. That seems like big step for gaming world ! Imagine open world game-based on ... OPEN WORLD :3
Wow this is so cool! I have been thinking lately that games will eventually go in this direction but I thought roughly 20-30 yrs from now, I’m so excited it’s possible now! 🙌🏻 Also I appreciate the work you put into this 🏁
The track looks like a warzone!
Dude this is freaking cool
but... how? "is it possible to learn this power?" looks amazing, at least a great base to work with
"it's not perfect"
I feel that's gonna be perfect real soon...
Awesome work!
We absolutely need a tutorial, I will pay for this
I feel like this has so much potential. Nice work!
interesting shit. at least your neighborhood has asphalt, i live in mud and macadam
Dude its amazing when you think about it. Having the chance to race in your neighborhood and other parts you would never race irl is insane. Like imagine racing around your school or something.
The world after an apocalypse be like:
that looks like pretty weak apocalypse
Bravo care, svaka cast! Ovo je top!
thats quite amazing.. looks like some sort of post apocalyptic scenery.. love it
OMG. Awesome... I have not the right words. Thanks for sharing. It makes me think about creating a game in my town environment (Madagascar)
This is absolutely astonishing, GG my dude.
damn it's been in my mind as a kid to drive cars in games and stuff in my old street and this lad just putting this here
This will be the future
i cant wait to see this be used more amazing work bro!
bro just imagine going through the streets of your village in a game. INCREDIBLE
future mod tracks are here. We need more modders like him :)
This is brilliant! Hope you'll upload the progress of this!
MAAAAAAANNNN! this is amazing, I allways had this dream of a an open world sim/circuit on real cities...
Very nice work. It's mater of cleaning the mesh on the street/side walk...
Even for a mod you should start a croudfund for this!
Great Work!
Been saying about this technique for ages glad some dev has implemented it
it has been used for a decade in gamedev. and for 30+ years in making 3d models in general.
yea this is fire!
Damn, this is sick! Well done!
Great way to find out if your neighborhood is the ideal racing track
Looks like those weird dreams..
Dont get me wrong, I freaking LOVE IT!
It made me feel like I want to do the same thing in my neighbourhood. Looks amazing
Even with the bad textures this does feel so realistic holy
This is legit one of the few things I watched this year that legit impressed me, I had no idea we were at this point in the technology if creating virtual game maps.
I wonder if big AAA game developers are already using this technology which would explain why most open world games have really impressive maps.
Brutal dude... Looks amazing.
The beginning of something amazing
This is what us sim racers are waiting 4, the world will be our playground haha great job 👏
Wow scence of speed is real when you have a narrow road and lots of details
This would be perfect for replicating my city to teach students how to drive in a simulated environment! Very impressive. 🙏
We're witnessing the future of map/track modding
Amazing work guys! Nice done!
Beautiful and very promising! Congrats 👍👍👍
Marvelous work, keep it up man🔥
so cool :D just imagine racing racecars around your neighbourhood!! These streets also make the tatuus look way faster
Wow amazing!! Would love to see more of this, a full track made with this could be insane!! 😍
And this is why this is the best racing gaming in my opinion.
Bro this is literally my dream, I would love to plow through my city’s streets, legally, and safely, at breakneck speeds.
Just amazing! 😊 Great effort! 👏
Who does not want to drive F1 car trough his village roads :D Dream come true heh... Svaka čast!
I subbed to keep informed of this amazing stuff! Good luck
Holy macaroni talk about immersion! I can only imagine what the future holds