Reactive GPU Particles: TouchDesigner Tutorial
Вставка
- Опубліковано 28 лип 2024
- Get access to 200+ hours of TouchDesigner video training, a private Facebook group where Elburz and Matthew Ragan answer all your questions, and twice-monthly group coaching/mastermind calls here: iihq.tv/Trial
If you’re a TouchDesigner Beginner, check out our TouchDesigner Tutorial Series! We teach you all the basics of how to use TouchDesigner, including mouse controls, hotkeys, parameters, the operator families, and more: interactiveimmersive.io/touch...
Reactive particle systems are always in demand by clients and are extremely fun for audiences. In TouchDesigner, we can create a fully reactive GPU particle system with just a handful of nodes in less than 10 minutes. Optical flow is the main techniques that allows to make just about any video input suitable for reacting to particle systems and other simulations.
Check out our blog post about TouchDesigner GPU Particles & Optical Flow: interactiveimmersive.io/blog/...
TouchDesigner Beginner Crash Course Contents
00 - Introduction: • 00 - Introduction - To...
01 - Get Started & Downloads: • 01 - Get Started & Dow...
02 - Mouse Navigation: • 02 - Mouse Navigation ...
03 - Creating Operators: • 03 - Creating Operator...
04 - Network Navigation: • 04 - Network Navigatio...
05 - Signal Flow: • 05 - Signal Flow - Tou...
06 - Hotkey Notes: • 06 - Hotkey Notes - To...
07 - Operator basics: • 07 - Operator Basics -...
08 - Parameters & Operator Info: • 08 - Parameters & Oper...
09 - TouchDesigner User Interface: • 09 - TouchDesigner Use...
10 - Working with TOPs: • 10 - Working with TOPs...
11 - Working with CHOPs: • 11 - Working with CHOP...
12 - Working with COMPs: • 12 - Working with COMP...
13 - Working with DATs: • 13 - Working with DATs...
14 - Working with SOPs and MATs: • 14 - Working with SOPs...
15 - Outputting Content: • 15 - Outputting Conten...
16 - Next Steps: • 16 - Next Steps - Tou...
17 - Create background content in TouchDesigner quickly and easily: • Create background cont...
18 - Trails & Frame Delays in TouchDesigner: • Trails & Frame Delays:...
19 - Reactive GPU Particles in TouchDesigner: • Reactive GPU Particles...
20 - Generative Geometric Design in TouchDesigner: • Generative Geometric D...
21 - Audio Reactive Analog Content in TouchDesigner Tutorial with Crystal Jow: • Audio Reactive Analog ...
22- Generative Visuals with Particles & Kinect in TouchDesigner with Crystal Jow: • Generative Visuals wit...
23 - 2D Texture Slicing in TouchDesigner: • 2D Texture Slicing: To...
Your turtual always so useful,very appriciate!
We're glad you enjoyed it :)
thank you so much for the great video
Our pleasure, glad you enjoyed!
Thank you!
Our pleasure!
Bro you are the best!
Thanks! Glad you enjoyed it :)
Awesome effect, I must give it a try 🤸♀🤸♀🤸♀
Definitely do! It’s a lot of fun to build. One thing to note, we actually did an update on this a few months ago as the new particlesGPU has a few changes: Interactive Particles with Optical Flow and ParticlesGPU 2022 - ua-cam.com/video/xODS0pZ6CEo/v-deo.html. If you’re interested in continuing with particlesGPU, also make sure check out Geometric Solar Flares with particlesGPU - ua-cam.com/video/t-yiOEgx6gY/v-deo.html!
@@TheInteractiveImmersiveHQ awesome thank you. I've just finished watching Interactive Particles with Optical Flow and ParticlesGPU 2022 amazing. I'm certainly interested in continuing with particlesGPU and will watch the Geometric Solar Flares shortly 👍
When I move I want the particles to follow the outline of my body similar to the dispersion effect you can create in still images. Could I use the same process?
Hi, thanks for video. I need a help. My particlesGpu component's inputs type are TOP all of them. But i want to change input0(TOP) to input0(SOP). How can make this ? I'm beginner at the TD.
This is awesome. I'm thinking of using touchdesigner for an interactive projection solution. Could you potentially track motion with multiple LiDAR cameras? Also, would projecting this in high res with a horizontal array of projectors work responsively?
Thanks! You could certainly use LiDAR cameras to track motion. You'd probably want to take the LiDAR data, instance some simple geometry on the points, then render those points and use that as the source for optical flow or blob tracking. There'd be no issue with projecting this to multiple projectors, that kind of thing is no problem with TouchDesigner :)
@@TheInteractiveImmersiveHQ thanks so much! I'll certainly bring it up with my team.
for th eone who look in 2024, the "input magnitude" is now called "Optical flow magnitude" and you can modify it wway more in big range thn on the video
Thanks for pointing this out -- particlesGPU has received some pretty big updates since this video was released. Here's a more recent video that covers building this effect with those updates in mind: Interactive Particles with Optical Flow and ParticlesGPU 2022 ua-cam.com/video/xODS0pZ6CEo/v-deo.html
Awesome tutorial! Is there a simple way to add sound effects for when particles are touched/displaced? Like play sound files I might have. Thanks so much!
That would be a bit tricky in this setup since everything is happening on the GPU we dont' really get a response back from it with the status of the particles. You could instead do something like use an Analyze TOP on the output of the opticalFlow so that way if you measure the overall brightness of the pixels in the image a lot of motion could result in triggering audio. Would that work for your idea?
@@TheInteractiveImmersiveHQ The Analyze TOP, great idea, I'll try it out! Also wondering if I can get events like I wanted by using the particle SOP instead. Fun stuff!
@@jcnesci With Particle SOP there would be some extra steps to get events but they'd be pretty taxing on your system and a little bit tricky to build because there's no native Python event for that.
Hi! Is there a way to make the particles move from left to right instead of from top to bottom? Super helpful video, thanks!
Do you mean having them spawn from the left and move to the right? If so you can change the External force so it is 1 on the X axis and remove the -1 from the Y axis. That should make them move in the right direction but you also might need to give the particlesGPU a custom camera component so you can reposition your view of the particles, which is on the Render page of parameters.
@@TheInteractiveImmersiveHQ Thank you so much! I'm currently part of a research project group at Georgia Tech, and we are creating an interactive art exhibit using TouchDesigner, so your tutorials have been extremely helpful for all of us :)
@@rachelkim2629 That's fantastic! I'm glad they're useful for you all :) We'd love to see what you're making if you want to email us some pictures or tag us on Instagram @interactiveimmersivehq
Great tutorial! I'm just getting started with TouchDesigner. Is it possible to use TouchDesigner with a projector to get the same effect on someone in a live setting?
Absolutely! You can take the output texture or composite that we made, send it to a Window COMP and then you can open that window on your projector. From there you can experiment with camera angles to have it feel good from the user's point of view.
@@TheInteractiveImmersiveHQ Awesome, thank you so much for the reply!
@@parkermrpink hey ! I just start either, and want to do the same, did you manage to do it ? :)
do you know anything about implementing position based dynamics for fluid systems in touch designer? Thanks!
There are some good github repos you can check out if you search "touchdesigner fluid" and you might something that can match your needs.
Your tutorial is great and thank you! I would like to ask, is there a tutorial that I can use macbooks camera? Or how ti get the video feed in TD? Thanks!
You can access the MacBook webcam using the Video Device In TOP. It should automatically pick the appropriate driver. Here's some more info: docs.derivative.ca/Video_Device_In_TOP Hope that helps!
@@TheInteractiveImmersiveHQ Thanks a lot for your reply!
I will look into it!
thank u so much for the videos, Is there a way to make it reopen with the toe file when the touch player closes for whatever reason?
No problem! Can you tell me how you're using Touch Player?
hey, thanks a lot for the videos! real quick question: does the ndi in not work for mac built-in cameras?
It should work! Do you have NDI Tools Installed? There's a tool that comes with it called NDI Webcam Input which should allow you to route your webcam into an NDI stream.
@@TheInteractiveImmersiveHQ I am on a mac as well and unfortunately for macs we do not get the NDI Webcam Input, any suggestions for a workaround?
@@Shuttered Can you upgrade to the latest experimental build of TouchDesigner for macOS? I was teaching a workshop last weekend and that seemed to help.
Amazing!! Do you connect the camera to TouchDesigner?
Thanks! Correct, however just wanted to mention that in this instance Elburz is first running the camera feed through Nvidia Broadcast to remove the background, and then sending that video signal into TouchDesigner. You can achieve similar results by running the camera directly into TouchDesigner using the Video Device In TOP. Hope that helps!
Thanks for the tutorial! If I want to achieve the effect of opening the face Camera in the 2022 of the software, what should I do?
Great question! In the newer version of particlesGPU, head to the Forces page, and then click on the _Rotation Type_ parameter dropdown. "Face Camera" will be the third option in the list. Hope that helps!
@@TheInteractiveImmersiveHQ Thank you very much!
Hi, do i need specific cameras to achieve this or would anything work?
No special camera needed :) It'll work with just about any type of webcam or Kinect or anything similar. It's very flexible.
Thank you for the video :)!
I am looking for a way to attract the GPU Particles instead of repelling them. If anyone has an idea to share or a link to send me, please do :).
If you're using the Particle SOP built in you can use metaballs and forces for that. With GPU particles, I'd have to double check if it has attraction mechanisms built in.
Hi, I recently started learning Touch Designer, I am using version 2022.24 and the particleGPU component has changed... I have looked at the wiki but it was not clear how to use get the opticalFlow input force on the new particleGPU system. Is this only available on paid versions? Can you please help? Thanks.
We'll have a new updated version of this video coming out in the next week or 2! Stay tuned for how to use the new one.
here's the link to the updated video: ua-cam.com/video/5qo3J5vX0eM/v-deo.html
Hi.. I am new to touchdesigner.. I wanted to know if its possible to particles react to a handdrawn 2d animation?
Definitely! The Movie File In TOP can be used to load a video file (which could contain your animation). You could connect this to the first input of the particlesGPU, which defines the particleSource, to generate particles based on the video file. You’ll likely have to play with the settings as well as the complexity of the animation itself to get the effect you’re looking for.
Hi any update with latest version cos the particleGpu setup is different? Thanks
Yes! We actually did an update on this a few months ago: Interactive Particles with Optical Flow and ParticlesGPU 2022 - ua-cam.com/video/xODS0pZ6CEo/v-deo.html. If you’re interested in continuing with particlesGPU, also check out Geometric Solar Flares with particlesGPU - ua-cam.com/video/t-yiOEgx6gY/v-deo.html. Hope that helps!
Hi, I need help, instead of so many particles, can i deflect just 3 images placed already in screen.
I believe there are documentation for the GPU particles on the Derivative wiki, where it should show you how to add custom textures for the particles. Then you could spawn 3 particles and get the same effect. Particle systems don't always have to have tons and tons of particles. We even use them in situations like you mentioned where we only have a few items but want the same behaviour.
@@TheInteractiveImmersiveHQ Thanks!!
Hi! Firstly thanks for your contents, those are really helpful. But I didn't use NDI webcam from my mac. I downloaded software but it didn't work or I didn't set up, could you help me please?
If you're not using NDI, you can try to make a Video Device In TOP, which will give you access to your local devices like your webcam and your USB devices. Can you try that and let me know if you get your inputs?
@@TheInteractiveImmersiveHQ It worked! Thanks teacher, I'm waiting with impatient your new videos.
@@barankeban3634 Great!! Glad to hear :)
why the Nvidea background remover looks bether on the Nvidea broadcast software then on the nvideabackground OP ?
Good question! I just started working with it, so next week's video we'll take a look at the built in operators for accessing the RTX features in TouchDesigner
I guess the pipeline of the broadcaster is AI with tensorflow… bg remover and other stuff should work with openCV i guess. Nvdia broadcaster is supercool by the way …
@@unveil7762 Very cool and exciting! In the next few weeks of videos we'll look at how these tools can be used in your installation and art works :)
I have an older Nvidia gpu that doesn't support optical flow, how can I overcome this to achieve a similar effect? OpenCV? Kinect? Any help would be appreciated
The optical flow component in the palette actually doesn’t require an Nvidia GPU as it’s GLSL-based effect. You can even run it on machines without a GPU, although the performance won’t necessarily be the same.
Another thing to point out is that particlesGPU received a pretty significant update with the 2022 release. To recreate this effect in the new version, check out this video: ua-cam.com/video/xODS0pZ6CEo/v-deo.html And for more info about the '22 updates: ua-cam.com/video/5qo3J5vX0eM/v-deo.html
my particlesgpu window does not display anything, just a black screen, any suggestions? thanks!
What kind of GPU does your system have? I believe if you don't have an Nvidia or AMD GPU the component won't work.
Hi! The differences between the frames its now happening I build all the system but when I want to overlay my video the particles dissapear. And when I move the particles didnt follow my movements :(
Hi there! We have actually updated this tutorial to match the changes in particlesGPU, check it out here:
*Interactive Particles with Optical Flow and ParticlesGPU 2022 - Tutorial* - ua-cam.com/video/xODS0pZ6CEo/v-deo.html
This must be an old version of the software. I get a totally different parttical system when I drop in ParticlesGPU. It has 3 in's and out's and so much in the container it's impossible to fathom.
Hi, yes particlesGPU received a pretty significant update with the 2022 release! To recreate this effect in the new version, check out this video: ua-cam.com/video/xODS0pZ6CEo/v-deo.html
And for more info about the '22 updates: ua-cam.com/video/5qo3J5vX0eM/v-deo.html
Hope that helps!
-Where'd the "face camera" button go?-
You know what? It was driving me crazy. (I have no idea what I'm doing.)
But I *found it.* It's down under Forces. Look for "Rotation Type."
Glad to hear you found it! As you've probably noticed things have been rearranged in the more recent versions of particlesGPU - check out this video for a similar effect built with the updated version: ua-cam.com/video/xODS0pZ6CEo/v-deo.html
someone know how to remove the background from thecamera ?
for th eone looking like me, he donloaded a nvidia broadcast app for that
You got it, Elburz was using Nvidia Broadcast to remove the background and then routing that video into TouchDesigner.
Would this work on a mac (optical flow)?
Yes, the opticalFlow COMP should work on Mac -- it's just running a GLSL shader under the hood 👍
@@TheInteractiveImmersiveHQ opticalFlow is only supported on windows :(((
When i drop particleGBU nothing happens in my container square (no falling plants) . does anyone could help me ?!
What kind of system are you using? Is it a Mac or a PC? Do you also have an Nvidia GPU in your system?
@@TheInteractiveImmersiveHQ Hello thaks for reply! Im using a PC (nitro 5/ ryzen 7 4800h/ Nvidia GTX1650 ti)
@@pedroaguiartv Can you make sure to run your Windows Update and then update your graphics driver? It should work fine on that machine so if you don't see anything when making a new particleGPU then it sounds like something is happening with the graphics driver. Can you try updating everything and let me know? Also which version of TouchDesigner are you on? I think there was recently an issue with particleGPU so you might want to try to either upgrade your TouchDesigner build or downgrade it one or two builds and see if that helps.
@@TheInteractiveImmersiveHQ Hello! first of all thanks for atention! Soo i upgrade though GEFORCE Experience and there was a pending upgrade. After that particlesGPU is back !! I was a 20 years Mac user and now im back to PC, getting used to it! Anyway thanks again!
@@pedroaguiartv Great!! Our pleasure to help! It's always tough getting used to a new system and PC's especially some of the first things we do if something isn't working quite right is do a GPU driver update. Those things are always moving fast and so is TouchDesigner so it's good to update often.
hey thanks for the video! I am trying to modify the texture to a video and create an instance so that it plays at different speeds (ua-cam.com/video/MB7GkjgxyYI/v-deo.html). I've been looking at this example but I can't put them together.
Thank you !
Our pleasure :) Thanks for watching