Zed 2i 3D Scanning in TouchDesigner - Tutorial

Get access to 200+ hours of TouchDesigner video training, a private Facebook group where Elburz and Matthew Ragan answer all your questions, and twice-monthly group coaching/mastermind calls here: iihq.tv/Trial
The Zed 2i camera is a great device! In our previous video, we did our initial first impressions of what the device can do and how we might be able to use it for interactive and immersive experiences. In this video, Elburz dives into one of the most interesting features of the Zed 2i device, which is the ability to do spatial mappings (or 3D scans) natively from inside of TouchDesigner. This feature brings a lot of creative potential and is easy to work with!

[@blablabladado]

Please more tutorials for this device, I recently have one. And I need more of youre knowledge guys.

[@TheInteractiveImmersiveHQ]

Thanks for the suggestion, I've sent it over to the team for consideration as a future video topic :)

[@lucaperrin]

Agreed! Continuing this video series about the ZED camera capabilites inside TouchDesigner would be awesome!

[@Nanotopia]

YES YES YES! Thank YOU for these tutorials - looking forward to heading outdoors

[@bobocsamuel]

I want more of zed tutorials :D

[@TheInteractiveImmersiveHQ]

Hey thanks for the suggestion! I’ve relayed it to the team for consideration as a future topic

[@3xAudio]

absolutely amazing what you can do with TD

[@TheInteractiveImmersiveHQ]

Couldn't agree more! Thanks for watching :)

[@NurbNerb]

Its about damn time

[@pataguan]

Muchas gracias por la introducción, Tengo una ZED 2 y la malla la puedo guardar como archivo tog para trabajarla después. Se podrá hacer algo similar con la nube de puntos? ya que solo visualizo en tiempo real, pero me gustaría poder guardar la nube de puntos como parte de un proyecto que pueda trabajar sin estar necesariamente conectado siempre a la zed.

[@ufhouck]

thanks! WEN!! skeleton detection for TD.

[@taj_ninny]

Hey thank you for this nice video, did you finally get to scan the outdoors ? (you got me hyped with your next week video :)

[@TheInteractiveImmersiveHQ]

Our pleasure :) I’ll check in on the status of that video, stay tuned!

[@scottiefox2525]

I've been using the ZED operators with my zed2i over the last 6 months, however - I'd like to start getting into the SDK where I can pull skeleton and positional data. Will you be exploring the python scripts to pull data into a TOP, or DAT in the near future of this "ZED series"?

[@pedlumb2435]

I need this too. ZED SDK is so robust, would be nice to use some of it in the TD environment

[@ethanalloway5946]

Ayo! More Zed2i content!

[@rgsaura]

Awesome!

[@TheInteractiveImmersiveHQ]

Thank you! Cheers!

[@SeppMessner]

Hi,
I just scanned my first spatial texture / object.
how could I export it in blender?
whats the difference between spatial texture and point cloud (at swttings)?
kind regards

[@TheInteractiveImmersiveHQ]

The easiest option for exporting the data to blender would be to right click on the ZED SOP and click “Save Geometry…”. This will allow you to save it as an FBX file which you can import into Blender.
The Point Cloud mode gives you point cloud data in a texture format - each pixel’s RGB channel values correspond to XYZ point positions.
The Spatial Texture mode gives you the texture extracted during spatial mapping by the ZED SOP, which allows you to apply the texture to the 3D geometry/mesh just like we do in the video.

[@maming7286]

excuse me，With 3.0 usb，ZED software works, like Zed Exploer and Depth view。and CUDA also installed, why can't TD open zed ？（An exclamation mark indicates that no hardware was found）

[@adamittomyslivecek3509]

which version of SDK and TD are you on?