Getting Started with Photogrammetry Using Your Cell Phone
Вставка
- Опубліковано 29 лип 2024
- 🎁 DOWNLOAD THIS PROJECT FILE & ASSETS FOR FREE! 🎁 som.bz/3u4AZXA
Photogrammetry is a powerful tool for capturing objects in the real world and turning them into gorgeous 3D assets. Now, we’re going to show you how to get started with just your cell phone, laptop, and the shoe off your foot.
In this tutorial, freelance artist Patrick Letourneau is going to show you how to capture images on your phone and convert them into realistic 3D assets.
Patrick’s UA-cam Channel | / @patrickletourneau8177
Instant Meshes | github.com/wjakob/instant-meshes
~ - ~ - ~ - ~ - ~ - ~ -
🎓INTERACTIVE ONLINE CLASSES 🎓
Cinema 4D Ascent | som.bz/c4dascent
All Courses | som.bz/2wKsBDu
🧭FREE 10-DAY INTRO COURSE 🧭
The Path to MoGraph | som.bz/2VNHb7D
🚴♀️FOLLOW US FOR MORE LEARNZ 🚴🏾♂️
Website | som.bz/2VMjr3N
Podcast | som.bz/3czNeCP
Facebook | som.bz/3cF3SBh
Twitter | som.bz/2PQfSWF
Instagram | som.bz/2POOJU7
---------------------------------------------------------------------
Auto-Generated Transcript Below 👇
Patrick Letourneau (00:00): Sometimes the best way to create a new 3d asset is to capture it in the real world. But what if you don't have any fancy scanning equipment? Well, as it turns out, you can get great digital capture using just yourself.
Patrick Letourneau (00:20): Hi, I'm Patrick Letourneau 3d artists, photogrammetry, NIST, and secret crime fighter. You've probably heard the term photogrammetry before, but maybe you thought it was a bit too advanced or complicated to try yourself. Well, I'm here to show you the technique for capturing incredible 3d scans of the world around you. Using tools you probably already have at your fingertips. Photogrammetry is the science of making measurements from photographs. Using multiple input images. Software is able to infer super accurate three-dimensional models that you can put to use better yet. You don't need expensive equipment or complicated software to get started. Just your cell phone and some supplies from around the house. In this tutorial, you'll learn how to set up objects for capture and adjust them into software, how to clean up and simplify your model texturing and baking normal maps. How to export the model into cinema 4d and Redshift, and the difference in quality between a cell phone scan and a commercial scanning setup. Before we begin, don't forget to grab the project files in the description below so you can follow along. Let's get started.
Patrick Letourneau (01:30): So here's my setup. Uh, as you can see, it's just a shoe on a tripod. I've got a toilet paper roll there to elevate the model. This lets me get underneath it to shoot the sole. So you want to be shooting in a camera app that allows you to control exposure and ISO and things like that. Uh, you don't want to just use your straight up camera app because the exposure will usually change between images and you can't set focus separate from exposure and a lot of the default camera apps. Uh, so here I'm using pro app. This lets me get TIFF images. You want uncompressed images of possible, um, as the compression and JPEG will lower your detail a little bit, but, um, that can be a more advanced step. Once you've done your first practice runs, it's probably fine to use JPEG. So a DSLR makes us a lot easier.
Patrick Letourneau (02:15): Obviously don't need to really explain that. You can see, uh, my movements here, I'm attempting to be systematic and kind of create a dome of pictures around this thing. Um, you know, you'll do a ring above the thing, and then you do a ring at the same level as this, uh, as your subject. And then maybe you can go do some orbits of special areas that haven't been covered previously here. You can see them shooting underneath the soul, probably not going to focus on the bottom of the shoe too much for this tutorial, but it's good to have there as additional imagery. Uh, my main advice would be always overshoot, never undershoot. It's a lot easier to delete extra images and to make images you never took in the first place. In addition, you want to shoot on an overcast day and that is critical for outdoor scans. This, if you've got the sun casting shadows across something, those shadows will get baked into your model and then it becomes really difficult to relate it yourself in your CG application. So remember to shoot in the flattest, most neutral overcast light that you can, the next step up from this, of course, it'd be an a studio where you have a lot of light control, but for today's tutorial, we're just going to talk about this sort of entry-level shooting with a cloudy overcast day.
For the full transcript visit: som.bz/3u4AZXA
I remember downloading a photogammetry software to the local library computer back in 1998 because the connection was fast enough to not make it take an hour. I then saved it on a 3.5 inch floppy to take it home to install. The example object was a 'shoe' because I guess thats just what you are supposed to do first. I used the digital photo option of a JVC camcorder to create 640 x 480 photos that where then stitched together in a 12 hour process to produce a sub-1000 triangle shoe model, but I was in 8th grade. Looks like the tech has evolved a bit!
Wow, I had no idea PG was around in the age of floppies! Thanks for sharing
I have to say with all the reality capture tutorials I've watched, none have been as informative as yours.
"Shoot images, press start hey presto, you got a scan...."
I speak for many I'm sure when I say thank you for taking the time to put this together. 🤜🤛
Small tip to go along with shooting on an overcast day; try to shoot some where with a lighter or more neutral floor. The environment will still bounce color around. If you shoot above grass, you'll have a lot of green light bouncing up. A white surface would be ideal, the same light from above will mostly be bounced back up to make the lighting really even.
This tutorial is so well done. More from Patrick, please!
The youtube algorithm finally gave me something i needed, amazing tutorial 👍
😂😂👍🤘
Oh man I’ve always wanted to be blessed by The Algorithm. Glad you enjoyed it!
Yes!
Good for you, Creator.
Same bro
Wow. I was involved at a commercial industrial level of metrology. Airbus, Boeing manufacturing etc. I'm astonished at how accessible photogrammetry has become. Great video. Thank you for sharing your expertise ... 🇬🇧
capturing photos with a dslr in snow covered mountains can lead to far better 3D scan. the snow will light it up like a spherical light dome. You taught it so good! thanks!
This is awesome! Thanks for putting this tutorial together!
Thanks Patrick for the video, didn't know about this method, much appreciated the sharing. Keep rocking with more tutorials like this.💪
That old shoe got a lot more exposure than was ever expected, I'd say! Thanks for the content :)
Wow, I knew you could do 3D scanning but both of those models ended up wild! I got into 3D about 12 years ago and fell out of it and got more into mograph and it's awesome to see where things have come to!
Hey, andrew woow u r 12 years in to 3d, what about 3d artist 3d modelers future are they loose there jobss, if this technology comes.????????.then no future for no 3d modelers?
@@pradeepj7919 They will not loose their jobs. Lots of models are not things that are real that can be scanned. Also these models would more than likely need to be touched up by someone with experience. Also there is much more to 3D than just getting a model into the program so artist are not out of a job.
@@pradeepj7919 Hi, just reading you comment and just wanted to add an answer. I worked in the 3D industry for +10 years too and based on my experience, 3D modellers will not loose their job. This techniques are good for specific purposes (E.g. Historical conservation, education, etc..) but if you want to use this models for real 3D production (E.g. VFx, video games etc..) they will need a lot of job to fix them, like retopologise them, or more advanced: poly flow fixes for animation. So photogrammetry is a great technique but it will not fully replace a full the pure job of building 3D models for specific industries, it will just give you a starting point.
Hope it helps!
that's absolutely fantastic, can't wait to have a go and try it. can you do some more samples?
90% of the time I have no idea what you are talking about but I watched till the end and subscribed as this is totally mesmerising 👍🏻
Ohhh man... I cant wait to try this.
Wow, what an introduction! Great tutorial thank you!
This is insane!! So cool!!
incredible video esp with the commercial comparison at the end!
This is awesome, I would be interested in having Blender used on the last part
Yeah just make a model from 6 pictures.
Perhaps #TomDickson could post a vid on this.
With Meshroom + Blender this can all be done for free.
Clear and understandable thank you so much!
Thanks a lot, this is a great tutorial! Learned a lot.
Hello good people, i need to scan an engine for my project and i wonder how dimensionally accurate the 3D model from this method will be. Is there a way to specific dimensions to make sure that all sizes are correct? Thank you in advance!
That was amazing!
nice video. I enjoyed watching. Might come in handy
Wow! Really great! This is so accessible, love it
Thanks Patrick! You rock!
I'm not sure when I am going to use this but I'm glad to have learned something great
man what a great time to be alive
How did you capture the shoe bottom in your turn table setups? Does the shoe laces keep their positions if you till the shoe?
This has blown my mind.. I didn't know how easy and accessible this was.
If accessible means paying 3750 euros....
@@barderino5673 3750 Euros for what?
Patrick,
what program would i use if I am trying to show that a chip in the glass was not in the morning picture but is in the afternoon picture so i can prove my glass installers did not cause the damage? The problem is that the clarity of the morning picture is not as good , especially when I zoom it to match the scale of the afternoon picture making it hard to say conclusively whether the chip is there or it isn't. Is there an app that improve the clarity. Any help is appreciated.
VERY cool video. Blew my mind...
Got something i needed
Any plans for a tutorial on how to make that pro scanning setup?
Great video!
Question: Do you do something special with the RC and turntable process? When I stay static, taking photos from same position and only my object turn on, i get problems with my align.
Thank you!
Are you removing the background from the images, only leaving the product or asset behind?
Great tutorial!
What is the lowest size possible of the output file enabling zippy loading of web pages?
Amazing, Thanks
Thanks for the video!
Fascinating stuff, and I'm not even into photogrammetry or 3D modeling or anything like that.
What was the name of the camera/photo app you used in the first couple minutes?
Its awsome. I can predict this is the basic technic to build communication via hologram
Microsoft Mesh was announced a few days ago
I really like your delivery.
I’ve used meshroom with my iPhone to good results.
As long as there’s features your fine.🤓🤜🏼🤛🏼🇦🇺🍀
Did you find meshroom on the apple app store at all pls? Doesn't find it on mine :(
@@chrisrossi5176 I used my phone to take the photos and used meshroom on my workstation.
@@stevesloan6775 Thanks for the reply Steve, where did your grab meshroom from pls, was it for pc or mac?
@@chrisrossi5176 I’m using a dual Xeon windows PC. I’m not sure if meshroom is offered for Mac. All you need to do is google meshroom and I’m sure you’ll find it. I will say you need an Nvidia graphics card for meshroom. It’s free and open source.
@@stevesloan6775 Thanks for the info Steve, will have a look for it, much appreciated.
This is so, so damn cool. Thank you for this! :)
ok thanks, that's a pretty great comparison
awesome stuf. tnx a lot
Which mobile app do you recommend for photos?
Nice to see you working
Thanks for this easy-to-follow tutorial, I've actually struggled with this in the past so great to actually see it play out step by step. How do you like the new iPhone lidar scan stuff do you think it holds up to your method here?
Thanks! The LIDAR is promising, and I'm excited to see where it is in 3-4 years. As is, it only shoots out a few hundred dots per burst, and they're spaced out several inches at typical scanning distance. With photos, you can get ~12 million points of info per photo, ie sub-MM spacing between info points.
LIDAR definitely works better for shiny objects, which is why I'm excited for it, but if i were to do this shoe with Apple LIDAR it would basically be a blob. Fingers crossed for the future
@@patrickletourneau8177 Good to know, I'm an android guy myself but was waiting on the next iPad Pro so I could mess around with the lidar stuff but seems like it's not really there yet huh. I'll try this method as well. Thanks for the info 🤙🏾
@@JonathanWinbush Lidar is good for room-size scans, but not object size scans, if that makes sense.
@@thegreatszalam ya 100% thanks
I'd expect the lidar to be used like the AR camera for hitfilm. You can track your 3d environment and place 3d models in videos.
F-n amazing! Get this tech to the police department for use in crime scene forensics. Detectives could put on virtual headsets and see the crime scene anytime they needed. You could bring in jurors to see the crime scene in the same way!
Law enforcement already do this with LIDAR scanners, super neat!
Then we get minority report...no thank you haha
Educational. Thanks for sharing.
Just wow !
Very detail video. Thanks
Is there none CUDA based freeware software available for the few times I want to play with this just for the sake of it? Can't find anything with acceptable results
Great tut!
Very interesting, thanks!
Great tutorial
How do I use these techniques to scan the inside of a minivan? Does the model handle interior vs exterior? I want to use the scan of the interior of the minivan in the design of a small RV in Sketchup.
Thank you so much!
I haven't seen the whole video but I'll know it will be interesting I'll just subscribe and save the video for later. Thank you for your contribution and knowledge and thank UA-cam for creating this platform.
Are there ways to attach small adhesive pieces of glossy paper or other reflective material or perhaps designated special purpose markers to assist in 3D image reconstruction? I've seen people use such markers/stickers with a 3d scan to produce high precision models.
I believe that would be more useful if you have a surface with a flat color and no anchor point for the align process to rely on.
For instance if you want to scan a room with a white wall it's gonna be difficult to get the correct position without putting marks on it
Imagine taking images from all angles from your (past) girlfriends and creating 3D models out of them... Great showcase on how this works! 3D modeling, and working with 3D programs like Blender is such an awesome thing that I wish I had more time to learn it.
I didn't understand a work of it, but enjoyed watching.
Great tutorial!
is it possible to open a reality capture finished 3d model without installing any programs on your android phone ???
Cloudy day = worlds biggest soft box.
amazing tutorial! in the normals part of the tutorial, I can't find the link to 'reproject model texture' help!
would this method work with precise parts? can this method make dimensionally accurate CAD models for copying for example broken parts for making replacements?
It's amazing how far we can go with just a smartphone.
Very interesting. Any idea how well it would work using stills from a drone? I’d love to create a model of my property to help plan my landscaping.
It works great, and I’ve done exactly that!
What app did u use to capture the photos?
Can your 3D program of choice be Element 3D?
How many should I practice after the effect of an hour a day
Can this method be use for software like fusion 360?
Does this require an aftermarket graphics card and does it accept Canon RAW images?
imagine being his neighbour and seeing him make 100 photos of a shoe in his backyard
Smart people are always seen as crazy by idiots
"Come and look, love. He's trying to sell his single smelly gym shoe on OnlyFans."
@@BeachBobRoss lol
Should I shoot photos is raw and process them in Lightroom or jpeg will be enough? Thanks!
Halfway through and this looks awesome for reverse engineering.
If you had say a 5 sided enclosure where the open end is the bottom and the enclosure has features inside like two screw posts and a few indentations, can you capture those features by going all the way under it and capturing it? Also can this export an stl file that can be converted to a dimensioned model in Fusion360 or Solidworks where you could edit out whatever the object was mounted to for the setup?
Iconasys makes very nice photography turntables that can take up to 8,000 photos per rotation if necessary. The automated photography software and background removal tools make the image capturing much easier.
I totally appreciate this tutorial but if its possible to make one through blender would be amazing!!!
Yes Blender please!!
You can clean up things with blender, but you cant "scan" here
super amazing
Awesome channel ❤️❤️❤️
Hi, thanks for sharing. Can you get accurate dimensions as in 3D scan? Would it be reliable for reverse engineering?
I want to know this as well.
3:38 so it's not gonna work well with AMD cards will it? What's a different program I can use then. Preferably free
I don't know about supported card types but 3DF Zephyr or Agisoft Metashape are good alternatives.
Metashape is good with AMD
@@rskl3284 is it free tho, like meshroom free
Brilliant!
Great tutorial! What image resolution would be ideal in your camera to take pictures for photogrammetry? Also what lens would work better? My guess is 50mm .
A: The highest resolution camera with the largest sensor will always win. B: Focal length depends on what you're scanning. Tabletop type scans typically a tighter lens like that yes, but with buildings i use a 20mm. It's critical to get a lens that is sharp in the corners (since you want all that data) and with low CA, low distortion
Use LiDAR Scanner on your phone and it will save you time... but also, I wouldn’t go with the 50 mill (too much focal length to deal with). Instead try the 32/16 millimeter sigma contemporary lenses. The one I have is for canon apsc sensors.
And I love the future 😍😍😍
is there any way to select parts of the shoe and assign different materials to them?
Спасибо! Очень хороший урок!
really nice thanks!!
Glad you enjoyed!
holy shit! the shoe looked perfect
So you could fairly easy use this to make game assets? For instance I have a wwii helmet. I could scan it myself and use it for a game asset?
Thanks!
Omg, that was amazing when it render in2 a sneaker w/ color. Do U have an online tutorial on this app? Thx 4 sharing on Utube.
With Nanite in Unreal Engine 5, we may be able to use these meshes without (too much) cleaning
(And Reality Capture got acquired by Epic, coincidence?)
Super kool magnific👍👌💎💎💎💎💎
one dose not need position data from a accelerometer or something like that?
Will this work with a 6k 3D 180 degree or a 2D 360 degree Camera.
When I was young I made 3D image with POV 3D programming solution on Atari ST. To see one poor image you to wait 20 mn. With realistic effects it could be hours.
I do it too and I made a 2D scan on printer lol now we can scan 3D asset with a phone I love technology 🤣
So what would happened when t subject is on a black stand w/ black background. Would it still captures the toilet stand?
Question, did you flip the shoe to get the shots of the soles?
Wow! Did an alien invent this software? Amazing!
what app on the iPhone is he using... I can't find "Pro App" in the App store?