Hands-On with Lightform Projection Mapping!
Вставка
- Опубліковано 27 чер 2018
- Projection mapping is one of the coolest visual technologies that so far has been out of reach for consumers. Lightform is hoping to change that with its projector-mounted scanner and software. We get our hands on the Lightform device to see how it maps objects and environments in front of it--like a replica movie prop--and go through the software to learn how to create striking augmented visuals on top of the real world.
Shot by Gunther Kirsch and edited by Norman Chan
Subscribe for more videos! ua-cam.com/users/subscription_c...
Follow us on Twitter: / testedcom
Get updates on Facebook: / testedcom
Tested is:
Adam Savage / donttrythis
Norman Chan / nchan
Simone Giertz / simonegiertz
Joey Fameli / joeyfameli
Kishore Hari / sciencequiche
Sean Charlesworth / cworthdynamics
Jeremy Williams / jerware
Ariel Waldman / arielwaldman
Kayte Sabicer / kaytesabicer
Bill Doran / chinbeard
Gunther Kirsch
Ryan Kiser
Kristen Lomasney
Set design by Danica Johnson / saysdanica
Thanks for watching! - Наука та технологія
For those curious, it's $699.99 for the Lightform LF1, and $1499.99 for a bundle kit that includes the Lightform LF1, a 1080p projector, and some other things like a tripod.
That is a great price point for small business commercial use.
I'm guessing that if you get the free version of the software (which they keep talking about) and use your own webcam and projector and computer to drive the software this could be very cheap :)
I want!
Rejinx during the night time have it project a advertisement/logo onto a big glass window on the store front
Could be great for a amusement park or anything like that
I love how the tested person presses for tech details really respectfully. It makes sense the person from light form wants to talk in plain terms but I’m sure others agree it’s really appreciated seeing the specific nuances
Incredible. Tested is keeping us up close and personal with a lot of cutting edge stuff. More please, more!
This makes light mapping so much easier. I can't wait to get my hands on one of these to enhance my technology classroom. Thanks for the video showing the great light mapping technology.
This is so cool! Cant wait to see where this technology goes. Great job Lightform!
This is without a doubt one of the coolest things I've ever seen.
Sometimes I just can't come to grips with the world we live in and am left in awe. This is absolutely incredible.
Very cool, I've been interested in projection mapping for live music applications for a few years, but it always seemed very complex or expensive, will definitely look into buying one of these Lightform devices!
This thing is awesome!
and very good vid on it, I understand how it works and what it can do, thanks Tested!
I'd love to see medical uses for this - a surgeon could see an xray or MRI superimposed on the body, so they could see exactly what's underneath before making incisions. Blood work and other scans could automatically update colors as they work.
I LOVE THE INSERT COIN SHIRT. AWESOME VIDEO TOO,BIG FAN.
We already pre-ordered the Lightform complete kit a few weeks ago and can't wait to get our hands on it (Have to wait until Nov 2018)... Now , gotta have the Zorg ZF-1.
This is BEYOND awesome! Lots of great possibilities for marketing, special events, DJs, weddings, AV gaming, etc. Great price point too!!!
David would be proud now all he needs is tilt shift and deep learning! This is so cool!!!
Dang, wish I had this when I was a kid, I could make the floor truly Lava!
95TurboSol Apart from directly below you! Although the top of your head would be lava in that instance.
Even better, you can do it now as an adult!
Wow! That subpixel accuracy is bananas.
Wow this is amazing! !! The possibility for retail application is mind blowing, you could grab the attention of people with this and boost your sales. Or attract attention to a car in a car show, and have everybody looking at your display to the exclusion of all others.
this is awesome! i already know what I would use for!
This looks amazing! will be buying it one day certainly
Really want to see this upgraded to incorporate real time tracking for moving subjects
You should check out the video Box on the channel Creators, it's made by Bot & Dolly. It's not quite RTT, but a very well choreographed video.
I just got one, i can't wait to use & review. thanks for your video
Receive it yet?
Very cool! Thank you for this review!
I can imagine presentations and instructional activities, once it becomes truly real-time interactive. Projection on white globes could be used to display geographical or planetary information. Projection on blank human figures could show anatomical details; a larger than life torso could show an operation with depth of field as opposed to flat video imaging. Architects could project renderings of a finished space on an empty room or large space. This will only get better.
To what end though? "Projection on white globes could be used to display geographical or planetary information." That's essentially an inverted planetarium. Those have been around for decades now. Operating Rooms have observatories for teaching, and any projector "could project renderings of a finished space on an empty room or large space". The only practical use for this tech is to make a store's sign more eye-catching, and Amazon is killing the retail store. It could do some cool shit in a nightclub too I guess. But I don't see this taking off. I wouldn't have a use for it in my home.
It's used extensively in artistic fields
It has already gotten better using HTC Vive tracking.... ua-cam.com/video/2gkidC6hTlY/v-deo.html
real-time projection mapping with automated edge-detection, etc. will be game changing for this tech.
For my job I have to use multiple projectors to create 4-5th dimension simulation with projection mapping , and you can loop gifs onto the objects that are scanned that creates awesome effects
I would love to see this for menus in shops or more practical uses
this is too cool!
You can see a projection mapping performance every Tuesday around 8:40 pm in downtown Redwood City at the Courthouse Square. Excited to see this tech in consumer hands.
As someone who is studying projection mapping its interesting to see where the industry is headed and I'm terrified that with this product, my job will become obselete. :/ curious to see how it handles curved and complex-curved objects.
your job is safe. no "pros" will use this. this is no match for D3, VYV ect.
Amazing and Innovative!!
I hope that there will be live tracking marker support soon, so that say you have a picture frame on a stage, and you could put your power point on that picture frame, and while you are delivering a talk you could pick up that frame and walk around and still change your slides... for example, I could see other uses for 3D objects and props that you could use in a live show if they could be trackable.
This is crazy awesome could use this in music shows
THIS IS AMAZING!!!!
This tech is very interesting. I could see adapting it to taking scans of objects and producing 3d maps of them. I could also see tech like this used in robotic vision to replace things like LIDAR, if you could speed up the process and switch to using dual cameras instead of the projector system. Maybe use a near IR projector and camera paired with a pair of visual spectrum cameras so that the robot can see different colors and has a map of the 3d space to work with for planning movement. Very cool tech. This does have a little feel of being an ad, but the tech is unique enough that it is also interesting.
I am very excited about this tech.
I wish I would be a team member of Tested, I would gain so much knowledge
Looks awesome! You should put the link to their website in the description
Processing is the same whether you are dealing with a 1 foot cube or a large building. The 1080p projector is the limit. Same number of pixels for both. It's just that the graphics will be really chunky on the massive target.
This is awesome
can't wait to see this combined with eye/head tracking via ar glasses so that the projections can be in response to where you look, and perhaps the projector/sensor array being worn. Saw some research being done along these lines years ago, not sure where it is now. This would enable high resolution graphical overlays that are shared between the user of the AR system and bystanders, while having the lenses/LCD displays flipped up or somehow removed from the users line of sight, allowing a clear view --- as needed. The user could then flip the displays down and have the projector turn off, while having graphics (of a lower resolution) overlayed as in a traditional AR system. XR (extended reality) I guess is the class of device this would be.
Very cool. Would like to see this in a theatrical application!
Constructively, informative.
I don’t see many consumers adopting this, but I think we’ll see big companies using this in really innovative ways
5:10 His head says no, but his mouth says yes...
Yea I noticed too.I guess they are not there yet but hope to be there in the future?
his mouth says yep*
His head is right, his mouth tried to dodge and spin it. Like he mentioned before, it works with "normal throw" projectors, so anything that is too wide won't work at all, and anything that is too narrow will have low resolution.
Professional versions of this kind of system generally decouple the projector(s) from the camera(s); they construct a 3D model of the scene (from multiple cameras and / or LIDAR data), then you select which image you want to appear flat from where (i.e., you define the intended viewer position), and it calculates the deformations necessary for each projector. This means the projectors and cameras can have any focal distance and don't need to be at the same location; if there's no coverage you simply add another camera. Here, you are limited by the camera they chose to use and by its fixed position relative to the projector.
.... Norm is just straying from the use case which he is unable to respond too without being like, dude I just told you it has to be mounted on a projector. He never even says yes, he just goes back to the topic at hand. He needs more practice in peopling for sure.
Despite that glitch, robots have still come insanely far. I think in a few more years this android model will pass the Turing test.
this was pretty awesome
@2:53 that Las vegas sign is amazing
Nothing goes better w/ tested than a cup of Joe and morning blue summer skies
It's 2018 and Jamie Heynaman still doesn't have a channel following the raising of small birds in his mustache called "Nested"
or a finance advising channel called "Invested"
The bird is the word.
I love theses shows, and they are free.
Software looks great!
An alternative is Madmapper which is very like this software, maybe a bit less plug and play especially with the camera, but also cheaper in some ways :)
I will defiently try Lightform out some day!
madmapper had this basic setup for like 6 years now right? even with the same scanning algorithm
you still need your computer to run madmapper though. With this you can set it up, then just leave the LF and the projector.
Or you can simply use HeavyM ah ah Lightform software is close to the idea of HeavyM I think. Simplify the video mapping.
yep.
You could also have interactivity based on events rather than physical input. For example, rather than having a dial that changes the speed of an animation or changing color, you could have a change happen when you get an email, text, reminder, or something else. Or different animations altogether to indicate various real-world events. Pretty cool!
Oh my god the last bit with the laser cut globe! Its like dark magic! Lets have it dynamic track the glove so I can hold it and move it around with projection! And also real-time scan my body and have occlusion so no projections on my hands
this is the coolest gadget i have ever seen.
Just wow
Interesting video, thanks! This guy named Maxin10sity has done some astounding visualizations, projected onto large buildings.
@9:30 dang i love this company!!! so good!!!
Wow
So cool! Thanks for this - How do we buy it?
Why are we hand mapping with a pen tool? I thought the entire point of Lightform was to have it done automatically. What am I missing?
There's still depth information that you can use to apply the shaders to, even when you adjust the map manually.
Thats pretty awsome!
This technology could be used to project any fantasy into a white Zentai suit. That could be used in a special place for games in augmented reality, escape rooms, etc.
Tiago Oliveira this will not work since it is not realtime scanning a small movement will cause every masking to unmatch. This only work with infrared realtime scanner.
It appears that lightform is closing shop. Just came across this video three years later and was hoping their solution had improved.
Interesting tool, wonder if they are able to export any file formate usable for After Effects like a depth map or the setup vector masks.
Hey guys! Thanks for your webcast it's great! I wonder if this could eventually replace Madmapper? Can you import 2-3 videos and run them simultaneously? I don't see them having a time line of any kind? Could you link sound, like a movie with it's audio? Thanks!
this is sooooo cool
that's really pretty fucking good. With all the lighting on this video shoot it looks ok but not so 'wow', but you know that's gonna look great at night in a store window or whatever
LIVE FOREVER AS YOU ARE NOW!
hello, nice video
what projector they are use? how many lumen?
Thank you
does the Lightform works on any projectors? I'm looking for a solution for outdoor projection for a building, what projector does the Lightform work on and what projector do you recommend for outdoor projection
I am using a projection mapping app on my tablet. its free(for noncommercial use) and pretty decent but completly in japanese. You have to manually set it up and then you can just stream it to any projector.
I guess automated mapping is cool, but manual mapping works for most simple geometric shapes.
Cool. It would be awesome for B&M retail
With MadMapper and a Camera is possible to achieve the same thing since 2011ish
It must be such a burden being as cool as you
I LOVE how lightform closed and the support is zero now
oh man VFX artists have been doing this since 2002 its soo easy!
Extremely cool. Spoiled by him using his buzz words like compelling and Magic. Save that for wholesalers, retailers or press releases so it makes them look stupid instead of the creators.
Photography and film are always linked to magic tricks. It's the roots of it.
I did not see them select the viewer position at any point, so it looks like this doesn't compensate for actual curvature and 3D shape, it's just a masking system for procedural effects, and they don't even trust the automatic masks (he did the gun totally by hand), which makes it very "meh". Everything it does can be done easily and interactively by hand (I've done it myself for several live shows, drawing the masks and effects while seeing them being projected, which is much more accurate - I _did_ have to render the effects as movies, but once that is done you can play them off sub-$50 hardware, no need to leave a $700 device connected to each projector in the show).
It doesn't even seem to have any sensor inputs to change the effect based on external events (like people stopping in front of it, or objects being moved), so being able to render the effects in real time is kind of pointless. It's effectively just recalculating the same frames over and over. Waste of power.
I guess this might find a market in shop displays, but it's not powerful enough for professional installations (also, the cost scales very badly with multiple projectors, since they expect you to have one per projector, whereas other systems use a few Kinects or webcams to cover the whole scene, and can then control dozens of projectors) and it's kind of pointless for home use.
It seems like they have spent more time getting the web frontend working rather than the actual computer vision stuff. It really should be possible to get a much better masking direct from the device. It may depend a bit on the scene though.
Putting an arbitrarily shaped object on a shelf close to the wall is kind of a hard case to detect if you have limited depth resolution. It will be hard to get good detection of the edges of the object as they blend into the wall.
Could you share the other systems that use kinects or webcams to cover the whole scene?
i also would like to know how this can be done more cheaply. I don't mind spending the time to manually set up the mask. What is the equipment and procedure?
madmapper has had the scan capability since version 1.0 - with a canon dslr
Can I use a different projector? I'm assuming you may as long as it has the right inputs/outputs etc. But I'd like to use a smaller one to project onto smaller areas. Thanks for the info!
Dayum. I need one.
its called spatial scanning, the software madmapper has it for example, useable with any canon dslr and any projector.
Actually, the scanning of lightform is not used to get an auto mapping. You have to draw each point of your object...
Great questions.
purty cool mang
"Permanent onboard storage. Unlike an SD card that can fail over time."..
Only has the onboard storage that can fail over time then? And unable to be replaced.
Electra Flarefire was thinking that too clever marketing terms ey
go look at people saying "what's wrong with the raspberry pi" and you'll notice the SD card is a big gripe. people with it was more reliable on-board storage. You're still connecting to the thing with a cable regardless.
I have no need for one of these but I want one desperately!
That's very, very cool.
pretty dope
Holy buckets of flaming shit balls Bat Man I want one right now!
That's one hell of a comment! I love it !
It's amazing how many comments have been made about how this can be done easily by, coders, hardware gurus, undergraduates. What about, soccer moms, waiters, ditch diggers, and junior high art students?
Everything is easy for experts in the field. This device trades complex features for ease of setup and use. In other words, as stated in the video, it makes it accessible to the average person.
I. Fucking. Hate. Cynics.
Its not exactly rocket science to do this, and they are charging 799 for a device which's harware is less powerful than a phone. And they are calling it magic and shit
For those curious, you could probably do the same thing with a RPi and a 1080p webcam paired with a projector. Good Luck!
Expand on this please?
Like all things tech, there is a place and an application for this. Yes it is low rez, and yes there seems to be plenty of hand work to address mapping, but it does capture some depth information in the scanning according to the Lightform rep. That speaks to potential as it evolves. He also mentioned the availability of warping grids for pre-distortion on complex surfaces. Something more advanced (expensive) existing solutions of course do now... but for $699, it has its place.
1) Don't overlook the fact that there is no such thing as projecting black... so there will be an additive amount of light outside of the areas masked and projected that will show the extents of the projector, regardless of what is used.
2) Closer the projector is to the receiving surface the better the results too I would imagine, as you would be using more of the available resolution of the projector. Ideally the extents of the projector should be coincident with the boundaries of your receiving surface, otherwise you are loosing resolution.
Thanks for sharing this overview, looks fun!
Late to this party ... aside from the bigger nut to crack - "tracking moving objects"( mentioned in video ) this needs precision (4k, 8k...) and most importantly real world input - this means when I put my finger on a real physical object(or special laser pointer type device) it should scan back to software and allow me to only work in 3d and minimal to no computer screen etc.
Use case for me would be in construction : projecting stuff for customers or management etc. Could be used as multiple laser levels , map multiple holes for drilling (as opposed to lifting a cupboard in place to mark holes for drilling).
Would love to see more projection mapping stuff, especially in a project setting! Unfortunately i cant justify $700 for one, but all you really need is a projector and software anyway XD
Try HeavyM ;) :)
Imagine having this on an ironman suit replica! Not sure if it would go through glass but CAN YOU IMAGINE! it would be like that scene from iron man 2 when he wakes up his workshop. Add a clap turn on mechanism and you are half way there. If I was rich Id have the coolest house ever haha love the video.
Been wanting to projection map the whole front dash of my car with a pico laser projector. This will make it soooo much easier.
Sync this with some electronic music and you get the perfect party :-D
Brian Eno has been doing light projections for a while now. I wonder what he could do with this.
maybe i'll wait for the LF2.5, it should come out in time for christmas.
Damn that is cool.
I need this for my acid/shrooms trips.