Directional Motion Detection and Tracking using Webcam in TouchDesigner

Поділитися
Вставка
  • Опубліковано 4 лис 2024

КОМЕНТАРІ • 64

  • @FunctionStore
    @FunctionStore  Рік тому +2

    Just noticed that from 5:15 onwards the CHOP channels are showing 0 - but this is only a visual bug due to the recording being in 30 FPS and my project file in 60, so we just happen to miss the frames it shows values :D Gets more clear once I put down the Filter CHOP

  • @JBroadway
    @JBroadway 11 місяців тому +2

    Thank you for making this. I found it very helpful! I hope you continue to make more.

  • @rgrant
    @rgrant Рік тому +2

    Great, just what I was looking for!

  • @michaelcarnohan
    @michaelcarnohan 4 місяці тому +1

    Nice tutorial! Clean implementation of Optical Flow.
    May I suggest bypassing components like your Analyze TOPS when they result in flickering like this in the future... some folks have Epilepsy and this can be a trigger. 🙏

  • @jimmysimmons6477
    @jimmysimmons6477 Рік тому +1

    Love the breakdown, thank you!

  • @matildemasenello948
    @matildemasenello948 3 місяці тому +2

    Hi! I just finished watching your tutorial but unfortunately I can't understand how you managed to connect the circle to the particles to use it as an element that dictates the movement. Could you help me?

  • @sarahghazi5539
    @sarahghazi5539 8 місяців тому +1

    Hello! Love the tutorial. I just have a bit of trouble with the analyze TOP. Mine is not blinking the way yours is and when I put the top to CHOP, it gives me an error of 'invalid source TOP specified. Love if anyone can help. Thanks!

  • @Jacobcuz
    @Jacobcuz 4 місяці тому +2

    Thanks for this tutorial. My circle seems to be stuck in the top right hand corner once plugging in the null to the center. Do i need to just adjusting the settings as you mentioned? I'm using a 2023 Macbook pro with built in camera. Any help would be great thank you!

    • @CameronByers_UM
      @CameronByers_UM 13 днів тому

      I have the same issue, did you figure this out?

  • @olwaysoliver6880
    @olwaysoliver6880 Рік тому +5

    thanks for the video! i am having trouble with a lot of noise i think.. The thresholds pick up much more flickering visual than yours do, i have tried to adjust my room lighting without real success.. Do you think my webcam is just bad? there is really a lot of bright flashing images in my threshold frames, but i am in a calm and soft lit environment i tried the blur filter but it really didnt do much.. what can i do?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hey, hard to tell without seeing but might be the case with a lot of digital noise from the camera. You could try adding a little bit of feedback to your input image to average the noise a bit more. As last resort if you have an RTX GPU you can try the nvidia denoise top, but would make sure to decimate the resolution to at least half before with a resolution TOP.

    • @FunctionStore
      @FunctionStore  Рік тому +2

      how about changing the Optflow Lambda and threshold?

    • @js4741
      @js4741 8 місяців тому +1

      Hey, just wanted to share I was having the same issue with my built-in webcam (Macbook M1 Pro). A ton of flickering visual from the threshold nodes.
      FunctionStore's suggestion of changing the threshold in the optflow was really helpful. The default optflow threshold value is 0 and I was getting a ton of flickering. As soon as I changed my threshold to 0.004, suddenly my threshold nodes looked a lot more like they do in the youtube video, with just the outline of me/my hand at a lot less noise. Hope this helps someone!

  • @markus_knoedel
    @markus_knoedel Рік тому

    Thank you. Good stuff.

  • @hernancrocce
    @hernancrocce 7 місяців тому +1

    Hi there. Lovely tutorial and well explained!
    Out of curiosity...What would be a workaround to use also the depht/z axis with the optical flow tool?

    • @FunctionStore
      @FunctionStore  7 місяців тому +1

      Hey thanks! Using this method only I don't think would necessarily be possible to get depth information. Also since this tutorial aired I recommend people to check out MediaPipe

  • @apofis_media
    @apofis_media 14 днів тому

    nice one, but how the first visual as example was made ?

    • @FunctionStore
      @FunctionStore  14 днів тому

      @@apofis_media please read description

  • @so0ofii
    @so0ofii 2 місяці тому

    hi, I was wondering if there could be some expresion that help me with the borders of the circle, it keeps going off the field. Anyone knows?

  • @dingwenxiao5660
    @dingwenxiao5660 Рік тому +1

    Can you make a tutorial on how to do this particle effect with Azure Kinect? THANKS~~!

    • @FunctionStore
      @FunctionStore  Рік тому

      If you mean the thing you see on the right: check out Noonesimg's tutorials on flex.

  • @SandervanLaarpixellaar
    @SandervanLaarpixellaar 3 місяці тому

    nice work! is this also possible with a image and when you walk by change in liquid?

    • @FunctionStore
      @FunctionStore  3 місяці тому

      @@SandervanLaarpixellaar sure, anything is possible that you can/want to control with a chop

    • @SandervanLaarpixellaar
      @SandervanLaarpixellaar 3 місяці тому

      @@FunctionStore thnx i hope so! because i have a great idea

  • @jamieguterman9598
    @jamieguterman9598 6 місяців тому

    Great video! Once I make a particle system, where do I attach it?

    • @FunctionStore
      @FunctionStore  6 місяців тому

      Thanks! That's the beauty of TD, you can attach anywhere! But in my case I was controlling the gravity of an Nvidia Flex system.

    • @jamieguterman9598
      @jamieguterman9598 6 місяців тому

      @@FunctionStore Thank you for the advice! I was able to attach the motion tracking to an eye visual I created following this tutorial: ua-cam.com/video/3ptfQFkNaHc/v-deo.html . When The eye moves with my body / hand, I'm getting a looottt of drag on the visuals. Is there a way to fix this?

  • @femi8637
    @femi8637 7 місяців тому

    Hi, great tutorial thanks! I am unable to make all the operators a component, there is no drop down option- could you let me know how to do this? TD newbie here!

    • @FunctionStore
      @FunctionStore  7 місяців тому +1

      hey, sorry not sure what you mean, probably best to watch more beginner courses and come back!

    • @femi8637
      @femi8637 7 місяців тому

      @@FunctionStore okay thank you for your reply!

  • @saurabhsswami
    @saurabhsswami 4 місяці тому

    Hey! I followed your steps but my result is very janky and had to use another method

  • @aldyferdiansyah5133
    @aldyferdiansyah5133 Рік тому

    Hi, I'm a new user of TouchDesigner. How do I connect Motion Detection with Nvidia Flex, and are there any tutorials available for this?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hey just connet the output of this tutorial to the gravity or any parameters of the flex you like (probably with some Matb CHOP to get the value in range) . In the description there is a flex tutorial.

  • @streamingdev1163
    @streamingdev1163 Рік тому

    I just bought the paetron for this video, what do I do next to get the pixels like you were showing at the beginning of the video?

    • @streamingdev1163
      @streamingdev1163 Рік тому +1

      I am confused on why you didnt show the ability to attach the particles either, very new to TD so kinda confused on what to do next

    • @FunctionStore
      @FunctionStore  Рік тому

      @@streamingdev1163 it was just a quick example to show the kind of interaction you can integrate. The visuals are based on an Nvidia Flex tutorial (and Patreon content so it's unethical to share anyway) linked in the description from Noonesimgs.
      In this video I never claim to share any of the visuals, only ever talk about the interactive component.
      TD has a very steep learning curve but once you reach a certain point you will never want to do anything else so keep on keeping on!

  • @Kancha1996
    @Kancha1996 8 місяців тому

    Can you show how to make basicFlex of your work on video, please?

    • @FunctionStore
      @FunctionStore  8 місяців тому

      Please check description

    • @Kancha1996
      @Kancha1996 8 місяців тому

      @@FunctionStore yes I watch it but idk how to make it move with circle. sry but I'm newbie about this program. 😅

    • @FunctionStore
      @FunctionStore  8 місяців тому

      @@Kancha1996 I was controlling the gravity of the flex system

  • @sliderpox7758
    @sliderpox7758 Рік тому

    Do you know if the circle only tracks 1 person at a time, or can I make it follow multiple hands?

    • @FunctionStore
      @FunctionStore  Рік тому

      Hi it only follows general movement in the camera view. It's not tracking anything in the literal sense so no.

  • @unclefillTV
    @unclefillTV Рік тому

    I am not seeing an option for ‘CHOP Reference’ when I right click “center” in my Circle TOP as you show at 13:17. Are you right clicking there? I get different options. Would love to finish this!

    • @FunctionStore
      @FunctionStore  Рік тому +1

      Hey! I am dragging the CHOP channel onto the parameter. Be sure to activate the viewer of the CHOP (null1, to activate click the little star icon at the bottom right of the operator) and then drag the channel you want to reference!

    • @unclefillTV
      @unclefillTV Рік тому

      @@FunctionStore wow! I think I got it. My next question would be, how to get the final effect as you show at the beginning of the tutorial? I’m finally able to move my ball so thank you!! Any help there?

    • @unclefillTV
      @unclefillTV Рік тому

      Or does that need it’s own tutorial? 😅

    • @FunctionStore
      @FunctionStore  Рік тому

      @@unclefillTV do you mean the particles on the right of the screen? Check this tutorial for the basic setup: ua-cam.com/video/0ym50KEXi48/v-deo.html I am controlling the gravity of the system (no speed CHOP needed in this case just math to multiply the values)

  • @artnomalie
    @artnomalie 11 місяців тому

    Can this be done without optical flow (i am on mac :) ?

    • @FunctionStore
      @FunctionStore  11 місяців тому

      Optical Flow from the palette should work on mac!

  • @zasmorning
    @zasmorning 3 місяці тому

    after all the steps, my math TOP only works in positive, not negative... 0, +1, 0 +1 and O dont know why

  • @ghassanterek4675
    @ghassanterek4675 Рік тому

    how did you create the null component

  • @nadijasafaryan2926
    @nadijasafaryan2926 Рік тому

    I have no source names for the NDI in... how can I fix that?

    • @FunctionStore
      @FunctionStore  Рік тому +1

      Hey I'm only using NDI because my camera image was already occupied by my recording software. You can just use Video Device In TOP for example

    • @nadijasafaryan2926
      @nadijasafaryan2926 Рік тому

      ​@@FunctionStore thank you for your reply. I'm a student who just started with TouchDesigner for a project. Do you maybe have another tutorial on how to make the blue wavy design, like in the thumbnail?

    • @FunctionStore
      @FunctionStore  Рік тому

      @@nadijasafaryan2926 Right, based on this tutorial: ua-cam.com/video/0ym50KEXi48/v-deo.html good luck and have fun!

  • @Anckg
    @Anckg Рік тому

    Do you mind showing us how you did merge the tutorial (ua-cam.com/video/0ym50KEXi48/v-deo.html) and the motion tracking bits together? I've been stuck on it for quite some time, I'm new to TD :]

    • @FunctionStore
      @FunctionStore  Рік тому

      I was controlling the gravity I think

    • @olwaysoliver6880
      @olwaysoliver6880 Рік тому

      would love some help with that aswell, i have been trying to combine these two
      did you manage to do it?

    • @FunctionStore
      @FunctionStore  Рік тому

      @@olwaysoliver6880 I'm controlling the Nvidia Flex Solver's Gravitational Acceleration parameters with the LR/UD channels (multiplied by 5 and having a filter with width of 1)