MIDAS Projection: Markerless and Modelless Dynamic Projection Mapping for Material Representation

MIDAS-projection system enables markerless and modelless projection mapping onto dynamically moving targets at 500fps with millisecond-order latency.
The visual appearance of an object can be disguised by projecting virtual shading as if overwriting the material.
However, conventional projection-mapping methods depend on markers on a target or a model of the target shape, which limits the types of targets and the visual quality.
In this research, we focus on the fact that the shading of a virtual material in a virtual scene is mainly characterized by surface normals of the target, and we attempt to realize markerless and modelless projection mapping for material representation.
In order to deal with various targets, including static, dynamic, rigid, soft, and fluid objects, without any interference with projection light, we measure surface normals in the infrared region in real time and project material shading with a novel high-speed texturing algorithm in screen space.
The proposed method realizes dynamic and flexible material overwriting for unknown objects.
Web page
ishikawa-vision...

[@ltlitetools6975]

incredible!

[@timmiltz2916]

Wait until Miley Cyrus gets ahold of this !
Really though - the potential for performing arts is sky high. This MIGHT be that extra edge I need to get into ballet.

[@timmiltz2916]

Move over Blue Man Group !

[@Борода-ж2п]

ох это очень красиво
киберпанккк

[@Geancg]

No more updates?!

[@Geancg]

caralho mane! kkkkkkk

[@seskamol]

< 3