Great video! A small optimization is to set "image.flags.writeable" to False before sending the image object to Holistic and flip the writeable flag back to True after the process() call. By doing this, you will 1) avoid copying the image data by passing it by reference and ii) reuse the same image object for rendering ;)
FANTASTIC! YES, would love to see a continuation of this series, possibly including live display and minmax detection of joint angles at selected joints, velocity of motion for selected landmarks.
The auto reframing would be awesome! I saw a colleague do it recently, will add it to the list. Did you mean the invidual landmarks or the whole series e.g. drop all of the face landmarks?
Thanks a lot, bro, I remember I said to you that please make a video on this topic and finally I got this. {Thanks a lot}😄 while True: print("Thanks a lot ")
This is a godsend and deserves more views dude. Fantastic job explaining and breaking it down individual lines of codes for beginners like me as I'm working on a Final Year Project that detects pose landmarks and using it to synthesise movements from images.
@@NicholasRenotte Hey Nick, I would like to request a tutorial video on motion transfer using pose estimation (i.e. detecting pose landmarks and using it to synthesise movement on images) using Python and if possible, using Mediapipe as well :) let me know if this interests you, thanks! P/S I've also left you a message on LinkedIn because I desperately need help on that..
OMG big thanks Nicholas! I have gone thru so many overwhelming docs still couldn't understand how Mediapipe works until I watched your video. Thanks for making it easy and interesting🥰
Without stopping the code and rerunning the release lines I think as we mentioned in starting code pressing 'q'(0xFF = 'q') in the pop up helps to do that. By the way Thanks, Great job! :)
Nicholas this is exactly what I was hoping you would cover. Love the sound of some examples of rep counters (squats, press-ups, etc.) or body language detection which sounds really interesting. I know there is a lot of research on eye-tracking in psychology I'm sure people in that field would love to see some of that. I would really like to see some onscreen angular output or a way of outputting that data to a file while tracking. The media pipe documentation outlines a Z component for the model which would be very interesting to see in terms of what the model sees in that direction or the computation of angular change during a movement. Keep up the great work man I'm really enjoying the level you are pitching this at - the fact that I can follow along is a testament to your approach. :-)
Thank you so much @Richard, it means the world! Will be building on top of this, I really like the idea of bringing in the z axis into play. I'll brush up on my trig as well and get some angle calculations in there as well!
This tuturial was really helpful, thank you for your work making it! I saw some other commenters mention it too, but using this for realtime 2D/3D avatar manipulation sounds like a dream come true. I use some of the programs vtubers use for training students on motion capture, so it'd be awesome if there was a way to use mediapipe to generate the vmc protocol for something like vSeeFace! Looking forward to seeing if it could be possible!
Ha, definitely going to dig into the linkage to vtubing software @Rachel, the ones that I've seen so far don't seem to have open APIs though. Just realised vseeface is in unity. Will dig into it some more!
Amazing work Nicholas! I'm waiting to see how you apply this- such as using gaze tracking to learn if someone is paying attention during zoom calls or learning about your morale by figuring your emotion through facial landmarks. Side note: I'm working on some of this stuff myself and would love to discuss it with you if you are interested
It's very cool! There are a lot of videos like that, but your videos are the most interesting and you explain it clearly! Thanks! All works correctly and without mistakes and bugs.
On a jupyter notebook, you can create a "key" variable with a value of 0 then make your while with a condition of key!=27. During the loop, you set the value of key to cv2.waitkey(10). It will escape the cam capture window when you press the escape key.
Bro, This is Awesome How about extending this project to create a sign language detection component that detects from the continuous video feed for which we don't need to label specifically for every gesture (like you did in the last live stream) or from a complex ready-made dataset from the internet that includes facial, hand and poses for recognition like British Sign Language, etc. It'll be lit.
It is very awesome and marvellous to watch you contribution in spreading the knowledge. Your current presentation (video) is an inspiring start for our own innovative projects (apps). Based on your contribution many different applications can be created (no limits). Big tomb up for you (unfortunately I can give only one) and Google team for the effort in creating and sharing state of the art work. Have a nice day.
Agreed, it's amazing what you can do with the models that are already out there! I've actually already built a pipeline on top of this code that allows you to apply a custom classifier from the keypoints, possibilities are endless!
Great introduction to mediapipe! I suppose it can also detect multiple persons? How can u detect if a person is lying on the ground? More videos on mediapipe would be great.
Thanks Henk! I believe the Holistic model is a single person model but you can use the pose detection model for multiple people! For detecting those lying on the ground you could apply a secondary ML model to classify based on keypoints, I've got something in this space coming!
In anticipation of your coming video! btw: the landmarks coordinates x,y,x are between [0,1]. Are this is in inches, cm or..? If not how can you map to cm for example?
You, sir, have a really nice channel! I would love to see some tensorflow in react native, I really think that it has a lot of potential! Keep up the good work!
i can’t solve this problem validated_graph = validated_graph_config.ValidatedGraphConfig() 223 if binary_graph_path: --> 224 validated_graph.initialize( 225 binary_graph_path=os.path.join(root_path, binary_graph_path)) 226 else: FileNotFoundError: The path does not exist.
Hey Nicholas, Great work! As a recommendation for your next video using mediapipe (python version): what about a face filter using Python - Mediapipe and OpenGL (not OpenCV) Where you can add a filter to a specific part of the face ;) More challenging right? :D Keep up the good work
I haven’t used ue4 in so long but I think there is a python plugin then you can plug in the .py file then use the renderings in the game or ue4 program code
Thanks for the content as always. Could you suggest some tutorials of docker and amazon aws? In general it would be interesting to see the whole picture as well (meaning not only model creation but its deploy/implementation to production)
Thanks for this incredible tutorial I thought it can be something in healthcare as it is tracking the body movement (bones) but I am not sure yet. Anyway it's great
I would love to see an example of using this model to coach exercise form. For example you could show the model correct and incorrect form of a a push-up. Then given a video input from a user the model would let you know whether your form is closer to the correct one or the incorrect one.
Great tutorial. Is there an example or tutorial on picking of object (=boxes/packages/parcel ) by hand, tracking the movement of the object and identifying the bin/shelf number in which it was dropped?
Hey man, where do you come across this stuff? Are there any particular sites, channels, or subreddits you follow where these come up? Would be awesome to know! Great videos :)
Hi Nicholas, Thanks for doing this project. Extending this module to workout count would be really exciting. Looking forward to that video. Also, I tried the discord link but it seems the link is broken hence I couldn't join.
At first,your video is amazing,i liked a lot,and second I have tried to run the code ,but doesn't appear the markes in my webcam video.Is it because the cam quality?The program version?(I've the comunity version instaled) Or I need to impor something else to the project.Once again,your videos are sensational.
Hey Nicholas, Pls make a video telling us how to program it to detect hand gestures and also simultaneously detect whether our eyes are closed or not? Thank You
@@hargobindsingh9763 yep, the beauty of this architecture is that you can overlay an additional classification model to do just about anything. For that I would use two additional models, one for gestures and one to detect if the eyes are closed or not.
🔥🔥🔥 Can you show us how to animate 3D object according to the detected body movements or at least the approach you would use? (Like when they make 3D object dance like you instantly) Thank you in advance🙏🏼
ERROR: Could not find a version that satisfies the requirement mediapipe (from versions: none) ERROR: No matching distribution found for mediapipe..............please help
Im new to this but it looks awesome! Im a Vtuber so when I saw this I was like "Omg, I could use this with a 3D Avatar!". Now the only doubt I have is: Is that really possible? I really dont know much about programing but it would be awesome!
Great videos as always, I was just thinking how far away are we from using this in skill training? Could be something like record someone doing a task well, then compare a learner and calculate the distance from the 'ideal' as a metric of progress?
Hi Nicholas Do you think it is feasible to project over the forearm a semi-transparent image (or a grid)? I am doing research for my theses in the field of therapeutic FES , and part of the problems I am trying to address is an effective routine for stimulating electrodes placement. In order to work, they have to be near where the nerves ''get into'' the muscles. As of now electrodes are placed randomly and then the patient has to undergo a very lenghty process for mapping electrodes activations to hand/finger contraction/extension. So there is a lot room for improvement. The topology of those points is relatively invariant among individuals (both healthy and not) , so I think that being able to project a semi-transparent anatomic table over the forearm(even if it is not extremely precise), could significantly speed up the process for the subjects and enhance the efficiency of the stimulation, as electrodes are placed more easily near those ''motor points''
I believe you could. Presumably the grid would need to be in a 3 dimensional vector space to be able to place it somewhat accurately. I'm experimenting with overlays as we speak, I've had a bit of a backlog but have a lot more planned in this field!
first of all I would like to TY for doing this video ,it amazing ! I have a few question,I am trying to do pose estimation correcting exercises posture it is possible that next video you can do this topic ? , or can you guide me how should I start ? , thanks in advance.
在使用Python的MediaPipe库时，遇到了AttributeError: module 'mediapipe.python.solutions.holistic' has no attribute 'FACE_CONNECTIONS'的报错,报错原因是MediaPipe库在某个版本的更新中把FACE_CONNECTIONS改为了FACEMESH_CONTOURS，将代码中的FACE_CONNECTIONS改成FACEMESH_CONTOURS即可正常运行了
@@NicholasRenotte Thank you ! I also have a simple suggestion. Have two videos displayed side by side , one source video and other the webcam feed. The idea would be how similar one can copy the movments .
Fantastic tutorial. Minor update: the mp_holistic model has changed the name for FACE_CONNECTIONS to FACEMESH_TESSELATION
YOU ARE A LIFE SAVER MY FRIEND!
I LOVE YOU
THXXXXX
Your life needs to be lived @@Tigas4ever
It's so early in the relationship but yes I love you too @@DaniELGKDG
This is really cool. Also, Instead of copying the code, I wrote the code with the video, so that I can write my own comments.
Awesome work!
This video keeps delivering even up to this day(2-3 years later)! Great!
Can’t wait for the full project 🔥🔥🔥
Yessss, anything you'd like to see as part of it @Daniel?
@@NicholasRenotte yes, I was thinking if you could include an Iris detection using the Mediapipe package
@@danieladama8105 agreed! It's only available in C++ atm but I actually found a workaround.
@@NicholasRenotte Yayyyyyyy!
@@danieladama8105 ayyyyeeee!
The quality of this and your other videos is outstanding. Great job Nicholas.
Thanks so much @Hassanin!
Great video! A small optimization is to set "image.flags.writeable" to False before sending the image object to Holistic and flip the writeable flag back to True after the process() call. By doing this, you will 1) avoid copying the image data by passing it by reference and ii) reuse the same image object for rendering ;)
HOLDDDD UPPPP, did I just have THE @Jiuqiang Tang comment on this!? Thank you sooo much, love your work!
Thanks a lot for listening to my request, Mate. Love Ya.
Anytime my man! Glad you're enjoying it @Sujay.
FANTASTIC! YES, would love to see a continuation of this series, possibly including live display and minmax detection of joint angles at selected joints, velocity of motion for selected landmarks.
Would also be great to see an auto-reframe/dynamic crop of a wide angle view to do landmark-detection-driven "auto tracking".
Can the hand and face landmarks from the body pose set be dropped/made invisible selectively?
The auto reframing would be awesome! I saw a colleague do it recently, will add it to the list. Did you mean the invidual landmarks or the whole series e.g. drop all of the face landmarks?
Looking forward to the series on applications built using Mediapipe. Thank you!
Awesome! Anything in particular you'd like to see?
@@NicholasRenotte Yes! Exercise counters perhaps? Like jumping jack counter or something of that sort? Thanks!
@@hsiaohsu4209 definitely, that's going to be first off the list!
Thanks a lot, bro, I remember I said to you that please make a video on this topic and finally I got this. {Thanks a lot}😄
while True:
print("Thanks a lot ")
youre_awesome=True
if youre_awesome==True:
print('Anytime my man, a promise it a promise ✌️')
Best teaching ive seen on this subject so far in youtube (and Ive seen millions of them)...thank you for this...really...thank you!
This is a godsend and deserves more views dude. Fantastic job explaining and breaking it down individual lines of codes for beginners like me as I'm working on a Final Year Project that detects pose landmarks and using it to synthesise movements from images.
Thanks so much @Eu Yang Chai, gl with your capstone project!
@@NicholasRenotte Hey Nick, I would like to request a tutorial video on motion transfer using pose estimation (i.e. detecting pose landmarks and using it to synthesise movement on images) using Python and if possible, using Mediapipe as well :) let me know if this interests you, thanks! P/S I've also left you a message on LinkedIn because I desperately need help on that..
@@eysamc definitely, working on it atm! Exploring how to do it with Tensorflow using the Barracuda framework!
@@NicholasRenotte This is awesome! Thanks man, really appreciate it.
OMG big thanks Nicholas! I have gone thru so many overwhelming docs still couldn't understand how Mediapipe works until I watched your video. Thanks for making it easy and interesting🥰
Yay so keen you just released this! I was working through how to do body language recognition for the TV show Frasier.
CONG!!! Thanks so much, awesome, quick note, you might need to render the lines as bolder if your image res is larger!
This project is really great. Thanks for it. Please make a full series for this project.
Big fan of your work.
Definitely, I'm going to get onto it next @Nilutpol. Thanks sooo much!
Without stopping the code and rerunning the release lines I think as we mentioned in starting code pressing 'q'(0xFF = 'q') in the pop up helps to do that. By the way Thanks, Great job! :)
Nice, I think sometimes it's a little glitchy on my PC. Looks like it works well when combined with cap.isOpened() as well.
Nicholas this is exactly what I was hoping you would cover. Love the sound of some examples of rep counters (squats, press-ups, etc.) or body language detection which sounds really interesting. I know there is a lot of research on eye-tracking in psychology I'm sure people in that field would love to see some of that. I would really like to see some onscreen angular output or a way of outputting that data to a file while tracking. The media pipe documentation outlines a Z component for the model which would be very interesting to see in terms of what the model sees in that direction or the computation of angular change during a movement.
Keep up the great work man I'm really enjoying the level you are pitching this at - the fact that I can follow along is a testament to your approach. :-)
Thank you so much @Richard, it means the world! Will be building on top of this, I really like the idea of bringing in the z axis into play. I'll brush up on my trig as well and get some angle calculations in there as well!
@@NicholasRenotte I would really appreciate that thanks ;-)
@@richieithaca I'm on it!
bro i'm a broke guy who cant afford rokoko and iphone x and you are my solution. love you
Explored your channel today! Amazing content ! Was waiting for such channel since way long back !❤️
Thanks soo much @Amisha! Glad you enjoyed it!
This tuturial was really helpful, thank you for your work making it! I saw some other commenters mention it too, but using this for realtime 2D/3D avatar manipulation sounds like a dream come true. I use some of the programs vtubers use for training students on motion capture, so it'd be awesome if there was a way to use mediapipe to generate the vmc protocol for something like vSeeFace! Looking forward to seeing if it could be possible!
Ha, definitely going to dig into the linkage to vtubing software @Rachel, the ones that I've seen so far don't seem to have open APIs though. Just realised vseeface is in unity. Will dig into it some more!
Amazing work Nicholas! I'm waiting to see how you apply this- such as using gaze tracking to learn if someone is paying attention during zoom calls or learning about your morale by figuring your emotion through facial landmarks. Side note: I'm working on some of this stuff myself and would love to discuss it with you if you are interested
Awesome work @Tejas, got a bunch more stuff coming in this space particularly for body language detection.
It's very cool! There are a lot of videos like that, but your videos are the most interesting and you explain it clearly! Thanks! All works correctly and without mistakes and bugs.
Your quality of videos is improving 😉
Awesome video
:)
😅 phew! Hahaha thanks so much @Abdullah!
Dude this is fire, its amazing the stuff you can do with python, you are fire bro!
IKR, it's my absolute fav language! Thanks soo much @Bernado, plenty more to come!
this looks better than the paid vtuber face tracking apps on the app store
Woah nice! Haven't checked them out but will take a look!
On a jupyter notebook, you can create a "key" variable with a value of 0 then make your while with a condition of key!=27. During the loop, you set the value of key to cv2.waitkey(10). It will escape the cam capture window when you press the escape key.
Sweet suggestion @Amaury!
Bro, This is Awesome
How about extending this project to create a sign language detection component that detects from the continuous video feed for which we don't need to label specifically for every gesture (like you did in the last live stream) or from a complex ready-made dataset from the internet that includes facial, hand and poses for recognition like British Sign Language, etc.
It'll be lit.
Can you guide me on how to build that sign language thing on top of this?
Heya @Sai, check this out: www.tensorflow.org/hub/tutorials/action_recognition_with_tf_hub
Great video Nicholas! Love the content!!!
Right back at ya @Data 360 YP!
This is insane bro! Thank you for knowledge sharing
Great master @Nicholas! I had already seen some of #mediapipe but with your video I realized that I had only seen the tip of the iceberg, thank a lot.
Heyyyy, thanks for checking it out Marcelo!
What amazing dreams can come true with this tutorial 😍.
Thanks Nicholas
It is very awesome and marvellous to watch you contribution in spreading the knowledge. Your current presentation (video) is an inspiring start for our own innovative projects (apps). Based on your contribution many different applications can be created (no limits). Big tomb up for you (unfortunately I can give only one) and Google team for the effort in creating and sharing state of the art work. Have a nice day.
Agreed, it's amazing what you can do with the models that are already out there! I've actually already built a pipeline on top of this code that allows you to apply a custom classifier from the keypoints, possibilities are endless!
INTERESTING!!! YOU ARE A GEM 💎 NICHOLAS !!!!! Waiting for next video now :)
Thanks so much @Abhishek! Definitley, plenty more to come.
Heya @Abhishek, pt 2 is out! Body language decoding! ua-cam.com/video/We1uB79Ci-w/v-deo.html
Bro your the man and especially a genius 👏great work keep it up will love to see the end result
Ayyye, thanks so much @Lorenzo! Definitely, got some sweet stuff planned with it!
Heya Lorenzo, the follow up is out! ua-cam.com/video/We1uB79Ci-w/v-deo.html
Great introduction to mediapipe! I suppose it can also detect multiple persons? How can u detect if a person is lying on the ground? More videos on mediapipe would be great.
Thanks Henk! I believe the Holistic model is a single person model but you can use the pose detection model for multiple people! For detecting those lying on the ground you could apply a secondary ML model to classify based on keypoints, I've got something in this space coming!
In anticipation of your coming video!
btw: the landmarks coordinates x,y,x are between [0,1]. Are this is in inches, cm or..? If not how can you map to cm for example?
code isn't working
Awesome explanation and demo.
You, sir, have a really nice channel! I would love to see some tensorflow in react native, I really think that it has a lot of potential! Keep up the good work!
Thanks so much @kento, definitely still getting up to speed with React Native but it's definitely coming!
Amazing content Nicholas. Thank you!
Thanks soo much @Thirasha!
Hey @Nicholas Renotte could you please make a video on how to use Hand Pose Detection for sign language :)!
Yes Nicholas,
You can also create a drowsy driving detector
You got it!
@@NicholasRenotte Thanks for the reply! It would be really awesome to see the predictions of the model!
@@gaddesaishailesh2772 agreed! Will get to it!
Thank you for shairing
Please make a video about jumping, i.e. counting when both feet leave the ground.
Fantastic! Congrats man! 👏
Thank you sooo much @Andre, glad you enjoyed it!
Thankyou very much. Keep up the good work really helped a lot of us ♥
Your Videos are excellent!
Thanks a ton @01bit!
You are the best Nicholas keep it going 😍
Thanks soo much @DidU!
Wow!! I love this tutorial. It is very simplified and easy to follow and understand. I must say you are doing a great Job. Thank you for this
Questions:
Can we access and modify the architecture ?
Can we retrain on new data to make it work on new edge cases ?
1. For MP Holistic, no, but you can build custom models on top of it: ua-cam.com/video/We1uB79Ci-w/v-deo.html
2. Yep, see link above
i can’t solve this problem
validated_graph = validated_graph_config.ValidatedGraphConfig()
223 if binary_graph_path:
--> 224 validated_graph.initialize(
225 binary_graph_path=os.path.join(root_path, binary_graph_path))
226 else:
FileNotFoundError: The path does not exist.
Hmmm, not too sure about this one, is there a larger error?
Чувак, ты мега гений
Fantastic. Can you make a video of hand gestures?
Hey Nicholas, Great work!
As a recommendation for your next video using mediapipe (python version): what about a face filter using Python - Mediapipe and OpenGL (not OpenCV)
Where you can add a filter to a specific part of the face ;)
More challenging right? :D
Keep up the good work
Got it coming up! Was actually investigating it today.
Oooh, yes with OpenGL too! 3d perhaps?
@@NicholasRenotte yeah 3D may look interesting
@@badaouiahmed2538 agreed!
One of the biggest youtube mysteries is that how this channel has only 30k subs
Take a look at this: ua-cam.com/video/06TE_U21FK4/v-deo.html
@@NicholasRenotte Thanks sir!
Hold on, that is really cool!!, is it possible to export that motion detection to blender or unity or Unreal Engine?
if yes, could anyone tell me how?
I haven’t used ue4 in so long but I think there is a python plugin then you can plug in the .py file then use the renderings in the game or ue4 program code
I think so, I've seen a few examples but haven't got any working just yet!
Thanks for the content as always. Could you suggest some tutorials of docker and amazon aws? In general it would be interesting to see the whole picture as well (meaning not only model creation but its deploy/implementation to production)
This is really informative!! Really helpful so here's a thanks from I.
Thanks so much @Cool Rock!
@@NicholasRenotte No u XD. Hopefully we can make proper use of this for school purposes.
@@coolrock3733 definitely, got a use case in mind?
Thanks for this incredible tutorial
I thought it can be something in healthcare as it is tracking the body movement (bones) but I am not sure yet.
Anyway it's great
Thanks for such explaining.
I would love to see an example of using this model to coach exercise form. For example you could show the model correct and incorrect form of a a push-up. Then given a video input from a user the model would let you know whether your form is closer to the correct one or the incorrect one.
YES! Like a virtual coach. Nice! I'll add it to the list, definitely possible!
@@NicholasRenotte Exactly, awesome thanks!!
@@CalebSchantzChristFollower anytime! Actually pretty pumped to do that video!
Its amazing. Will always appreciate it.
Awesome stuff @Priyam!
thanks buddy , very helpful to understand
Wow, Great tutorial! wondering if this can be use for VTuber! they don't need to buy expensive tools for body & hand tracking
Man, thank you so much, you've done really great job! :))
Thanks sooo much @Dmitry! Glad you enjoyed it.
Hi great video ! I don't understand why there is no standalone app ready by now its amazing and crazy Ai !
IKR, there's so much possible with it!
Amazing content!
Thanks soo much @Jie!
This is very helpful tutorial thanx for sharing brother.
i had an idea using this for liveness detection
Would be awesome to see action detection done on top of this! :D
Working on it as we speak!
damn, thank you so much! that helped me out a LOT!!
and really nice step by step explanations as well. love it!
So glad you enjoyed it @R J
Great tutorial. Is there an example or tutorial on picking of object (=boxes/packages/parcel ) by hand, tracking the movement of the object and identifying the bin/shelf number in which it was dropped?
Hey man, where do you come across this stuff? Are there any particular sites, channels, or subreddits you follow where these come up? Would be awesome to know! Great videos :)
A lot of it is through client conversations, reading reddit and seeing new projects on LinkedIn and Github!
Hi Nicholas,
Thanks for doing this project. Extending this module to workout count would be really exciting. Looking forward to that video.
Also, I tried the discord link but it seems the link is broken hence I couldn't join.
Thanks soo much @Hitesh. Oh noooo, for real it's not working?
At first,your video is amazing,i liked a lot,and second I have tried to run the code ,but doesn't appear the markes in my webcam video.Is it because the cam quality?The program version?(I've the comunity version instaled) Or I need to impor something else to the project.Once again,your videos are sensational.
Try dropping the detection and tracking thresholds!
Hey Nicholas, Pls make a video telling us how to program it to detect hand gestures and also simultaneously detect whether our eyes are closed or not?
Thank You
In the one app?
@@NicholasRenotte That would be bloody cool
Is it possible though?
@@hargobindsingh9763 yep, the beauty of this architecture is that you can overlay an additional classification model to do just about anything. For that I would use two additional models, one for gestures and one to detect if the eyes are closed or not.
Good tutorial video!! thumbs up for you
🔥🔥🔥
Can you show us how to animate 3D object according to the detected body movements or at least the approach you would use?
(Like when they make 3D object dance like you instantly)
Thank you in advance🙏🏼
Working on it @Thuraya, going to be a long video though by the looks of it 😅
First Links:
MediaPipe Solutions 2:57: google.github.io/mediapipe/solutions/solutions
Cool Touchless Control 3:53: ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html
Thanks for sharing @Luis!
Do a part 2!
Yesss, definitely, coming this week!
It's out! Let me know what you think @Flynn! ua-cam.com/video/We1uB79Ci-w/v-deo.html
Can you give little idea or make a separate video on how to apply clothes etc on human body using pose detection?
Excellent Rajab Raspberry Pi Make a video together
thanks for this tutorial
i going to create a cinama 4d plugin to detect face mocap
help plz
YESS! Sounds awesome! Planning on going some stuff in that space when I get some bandwidth!
Hey how can we resize images so that they match the dimensions in the pipeline.config file.
Should we resize them before the annotation part?
Heya @Shailesh, I'm guessing this is for the OD tutorial right?
@@NicholasRenotte yes sir
@@shaileshsai2386 you don't need to do it, the TFOD API will resize the images for you as part of preprocessing. 😊
Hey Nicholas, I’ve looking for voice classification tutorials but there is nothing!, it would be great if u teach us with your own database!!
You got it, I'll add it to the list @Bernardo. Also saw an awesome example of voice cloning the other day as well!
ERROR: Could not find a version that satisfies the requirement mediapipe (from versions: none)
ERROR: No matching distribution found for mediapipe..............please help
Try running with Python 3.7.3!
Im new to this but it looks awesome! Im a Vtuber so when I saw this I was like "Omg, I could use this with a 3D Avatar!". Now the only doubt I have is: Is that really possible? I really dont know much about programing but it would be awesome!
Honestly I only just found out about vtubing recently 😅, I think we could make something work with it @Rakuzan!
@@NicholasRenotte It would be really cool!
@@rakuzand definitely! Got it coming.
@@NicholasRenotte Thanks so much dude!
Thankyou So much SIrr💌💌
Great videos as always, I was just thinking how far away are we from using this in skill training? Could be something like record someone doing a task well, then compare a learner and calculate the distance from the 'ideal' as a metric of progress?
Hi Nicholas
Do you think it is feasible to project over the forearm a semi-transparent image (or a grid)?
I am doing research for my theses in the field of therapeutic FES , and part of the problems I am trying to address is an effective routine for stimulating electrodes placement. In order to work, they have to be near where the nerves ''get into'' the muscles.
As of now electrodes are placed randomly and then the patient has to undergo a very lenghty process for mapping electrodes activations to hand/finger contraction/extension. So there is a lot room for improvement. The topology of those points is relatively invariant among individuals (both healthy and not) , so I think that being able to project a semi-transparent anatomic table over the forearm(even if it is not extremely precise), could significantly speed up the process for the subjects and enhance the efficiency of the stimulation, as electrodes are placed more easily near those ''motor points''
I believe you could. Presumably the grid would need to be in a 3 dimensional vector space to be able to place it somewhat accurately. I'm experimenting with overlays as we speak, I've had a bit of a backlog but have a lot more planned in this field!
first of all I would like to TY for doing this video ,it amazing !
I have a few question,I am trying to do pose estimation correcting exercises posture it is possible that next video you can do this topic ? , or can you guide me how should I start ? , thanks in advance.
Would take a look at this, you could customize to train for good vs bad poses: ua-cam.com/video/We1uB79Ci-w/v-deo.html
@@NicholasRenotte thanks ! ,really appreciate it. :)
Nicholas, can you do a lesson about generative adversarial networks (GANs) using TensorFlow?
Yup! Definitely @Thirasha!
That's Amazing
Thanks so much @Ahmed!
You could probably save a bit of processing by using $frame instead of $image since $frame is already bgr?
Solid suggestion!
Is the dog's face recognized?
I don't believe so @uunn nnuu, but that gives me a new idea. Pet face recognition, possibly an AI powered dog door?
Can we use this for exercise counting? Can you do a video on exercise counting?
Sure can: ua-cam.com/video/06TE_U21FK4/v-deo.html
can you please do a video on Stroke detection using FAST (Facial drooping, Arm weakness, Speech difficulties and Time)
Hello Nicholas! Thank you very much for this helpful tutorial
Do you have a nice solution to get the landmarks of the mouth and lips specifically?
在使用Python的MediaPipe库时，遇到了AttributeError: module 'mediapipe.python.solutions.holistic' has no attribute 'FACE_CONNECTIONS'的报错,报错原因是MediaPipe库在某个版本的更新中把FACE_CONNECTIONS改为了FACEMESH_CONTOURS，将代码中的FACE_CONNECTIONS改成FACEMESH_CONTOURS即可正常运行了
thank you for help
Great content ! super practical. Perhaps a video could be to build it on a react.js to build some kind of dashboard.
With the mediapipe stuff integrated? Got a few leveraging Tensorflow.Js ua-cam.com/video/7lXYGDVHUNw/v-deo.html
@@NicholasRenotte Thanks for the link . I will have a look to that. Yes , with the react stuff integrated could be great
@@timtensor6994 awesome, will do a little more digging into some React stuff!
@@NicholasRenotte Thank you ! I also have a simple suggestion. Have two videos displayed side by side , one source video and other the webcam feed. The idea would be how similar one can copy the movments .
@@timtensor6994 ah yeah that would be sick!! Could use a siamese network to look at the similarity!
Very helpful and if I need to take the voice of a person what library it's the best to use.
Heya, try looking for voice cloner libraries. There's a few new ones out there!
@@NicholasRenotte thanks
@@user-bp6sv6or1p anytime!
Nich please make video on how to become a self taught data scientist/ML engineer thankyou 👍
You got it! Added to the list @Abhishek!