AI Body Language Decoder with MediaPipe and Python in 90 Minutes

  Рет қаралды 88,609

Nicholas Renotte

Nicholas Renotte

Күн бұрын

Пікірлер: 371
@NiKiTjA_OFF
@NiKiTjA_OFF 9 ай бұрын
I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?! And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model
@one_done_facts
@one_done_facts 6 ай бұрын
HI. you can send requirements.txt string , please!
@hargobindsingh9763
@hargobindsingh9763 3 жыл бұрын
One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks sooo much @Hargobind, so glad you enjoyed it!!
@ameensamhan751
@ameensamhan751 2 жыл бұрын
The most professional easy to understand and implement tutorials on youtube. You really are the best.
@friedafrikadelle9483
@friedafrikadelle9483 3 жыл бұрын
I just discovered your channel and I‘m obsessed. Thank you so much for doing such great content🙏🏻🙏🏻🙏🏻
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thank you so much @Frieda, so stoked you're getting value from it!
@Virtualexist
@Virtualexist 3 жыл бұрын
Me tooo !!!!!
@francis3725
@francis3725 3 жыл бұрын
One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
🙌🙌🙌 sending you all the luck, you'll smash it @Francis!
@harshdasila6680
@harshdasila6680 2 жыл бұрын
have anyone actually implemented this code Please let me know Very urgent !!
@shivlymizi3211
@shivlymizi3211 9 ай бұрын
Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing
@one_done_facts
@one_done_facts 6 ай бұрын
HI. you can send requirements.txt string , please!
@danielamemba5307
@danielamemba5307 3 жыл бұрын
The 210th comment is dedicated to the best content on KZbin. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime my guy, better late than never, WELCOME TO THE FAM!!!
@EduardoGarcia-tv2fc
@EduardoGarcia-tv2fc 3 жыл бұрын
your tutorials are the best tutorials I have seen in my life, congratulations!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a tonnn @Eduardo!!
@srirammadduri8078
@srirammadduri8078 3 жыл бұрын
Man! Your tutorials are really really cool!! And DAMN RIGHT we want a bigger data science series!!!!! Awesome work man!!! Cheers!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSS! So glad you enjoyed it!
@srirammadduri8078
@srirammadduri8078 3 жыл бұрын
@@NicholasRenotte Mann! I thought you wouldn’t respond! Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@srirammadduri8078 nah man! I try to get to all comments. Hit me up on Discord, I check every night and if crazy every second night. bit.ly/3dQiZsV
@emelsoylu3002
@emelsoylu3002 2 жыл бұрын
Your videos are very descriptive and useful. Your content is of high quality. Thank you.
@isaackay5887
@isaackay5887 3 жыл бұрын
Looking forward to watching this later!! Thank you for all the quality videos. Have a great one!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime @Isaac! Thanks a bunch 🙏
@VikramSaigal
@VikramSaigal 3 жыл бұрын
Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Awesome usecase, I'll add it to the list. Never even thought about comparing poses!
@CalebSchantzChristFollower
@CalebSchantzChristFollower 3 жыл бұрын
Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.
@eddysaoudi253
@eddysaoudi253 3 жыл бұрын
Exactly.
@friedafrikadelle9483
@friedafrikadelle9483 3 жыл бұрын
Yes!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!
@CalebSchantzChristFollower
@CalebSchantzChristFollower 3 жыл бұрын
No hurry, you are already putting out content at a crazy pace! Take that break!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.
@ima_lc
@ima_lc 3 жыл бұрын
Only you have the best python vidos on KZbin. Greetings from Russia)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @ONE! What's happening from Sydney!?
@marcfinger4549
@marcfinger4549 2 жыл бұрын
Your channel has helped me so much when working on my dissertation. Thank you 🙏
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
YESSSS, go getem Marc! Hope you smash it out of the park!
@priyambordoloi771
@priyambordoloi771 3 жыл бұрын
Good job brother. I will always appreciate the tasks that you do.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @Priyam!
@nicolasabosch
@nicolasabosch Жыл бұрын
Great tutorial, i wish your channel have more visibility
@victormustin2547
@victormustin2547 3 жыл бұрын
I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yah, agreed! Working on a bunch of stuff in that space rn @Victor!
@victormustin2547
@victormustin2547 3 жыл бұрын
@@NicholasRenotte Amazing ! I’ll be there to see it as soon as it comes out !
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@victormustin2547 yesss! Thanks a bunch for checking out the vids so far as well!
@talhaeneskoksal4893
@talhaeneskoksal4893 3 жыл бұрын
Thanks buddy for really helpful videos. Keep going, Wakanda Forever!
@shalomsonekar6985
@shalomsonekar6985 3 жыл бұрын
This is really awesome , loved the way how you explained everything, great Job. Really Thankful for this. 💯 THANK YOU SO MUCH BRO ! KEEP HUSTLING ❤️
@shai8559
@shai8559 2 жыл бұрын
really amazing content. im currently working on my final cs project and this video (and some others) were tremendous help for me. amazing job man!
@harshdasila6680
@harshdasila6680 2 жыл бұрын
have anyone actually implemented this code Please let me know Very urgent !!
@shai8559
@shai8559 2 жыл бұрын
@@harshdasila6680 i did. What you need?
@harshdasila6680
@harshdasila6680 2 жыл бұрын
@@shai8559 i am getting error
@shai8559
@shai8559 2 жыл бұрын
@@harshdasila6680 you can type the error and ill see if i can help
@nurulsyifa9035
@nurulsyifa9035 3 жыл бұрын
so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thank you so much @Nurul! You could particularly with the hand models! Could even pass to a RNN for action detection!
@yuriemond7340
@yuriemond7340 3 жыл бұрын
@@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@yuriemond7340 definitely, take a look at some of these action models: tfhub.dev/s?q=action
@KamalMahss
@KamalMahss 7 ай бұрын
first, i want to thank you about this big effort. second, can you make a video about fall detection using media pipe please this video will help me a lot
@one_done_facts
@one_done_facts 6 ай бұрын
HI. you can send requirements.txt string , please!
@winniepooh2533
@winniepooh2533 3 жыл бұрын
Hey Man...! You are really cool!!!! I love this project, I'm your new subscribers!!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSS! Welcome to the fam!
@brucewayne9708
@brucewayne9708 3 жыл бұрын
hey can we use this to do real time sign launguage . If we can use this please do a video on it.Thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Bruce! Heya, yup, got something in mind!
@naratilife
@naratilife 3 жыл бұрын
Excellent Presentation. Just loved it.
@JohnGalanakis
@JohnGalanakis 3 жыл бұрын
I love your videos and your work
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a bunch @John!
@shahdsg4527
@shahdsg4527 2 жыл бұрын
Thank you so much!!!!! Please can i do same steps for sign language recognition instead of using mediapipe+LSTM ???
@olatundeolukoya1788
@olatundeolukoya1788 Жыл бұрын
2 years but the video still Lit
@shivamsingh-vv9vm
@shivamsingh-vv9vm 3 жыл бұрын
Let's try something in 3D. That will look great. The AI gym trainer in 3D would be great!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Agreed, on the R&D list as we speak!
@prateekxx
@prateekxx 3 жыл бұрын
55:47 that mic glitch made me spill coffee on myself
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Oh shit 🤣, didn't even know that was in there.
@jmacron4652
@jmacron4652 3 жыл бұрын
Great tutorial....Can you do a tutorial where you can save body and facial motion to BVH or FBX files to use with a 3D Character..
@leonelp9593
@leonelp9593 3 жыл бұрын
Such a cool content ! Thanks for sharing this
@adityasawant1672
@adityasawant1672 2 ай бұрын
what will be chenges, if i wanted to make a .h5 model ? please replyy
@danieladama8105
@danieladama8105 3 жыл бұрын
Just what I needed. Thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESS! So glad to hear Daniel!
@jonathonvandyke6328
@jonathonvandyke6328 3 жыл бұрын
Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Nothing around it yet but will probably do something soon @Jonathon!
@creathyang9413
@creathyang9413 3 жыл бұрын
Excellent vid man, thanks
@KriGeta
@KriGeta 3 жыл бұрын
So awesome, is there any way to control a 3D model in blender using this body estimation technique? Like motion capture?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Haven't seen it in blender but I've seen it in Unity using the Barracuda framework!
@KriGeta
@KriGeta 3 жыл бұрын
@@NicholasRenotte may you pls tag me a tutorial?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@KriGeta don't have anything yet but will shoot it through once it's up!
@KriGeta
@KriGeta 3 жыл бұрын
@@NicholasRenotte that's great 😍
@finance315
@finance315 3 жыл бұрын
thats so cool! i have a question, how can we fix the flickering at then when it's running?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
It would need a more powerful GPU or machine. The lag is due to the FPS drag from the ml model.
@finance315
@finance315 3 жыл бұрын
@@NicholasRenotte i have fixed it!! now running at 10 to 12 FPS, thats still good. thank you so muchhhh
@amilakelum2670
@amilakelum2670 2 жыл бұрын
This video help me in creating my final year project thanks lot ❤
@vishalm954
@vishalm954 3 жыл бұрын
Amazing stuff! Getting to learn a lot:)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @Vishal 🙏!
@jeffreylin2488
@jeffreylin2488 2 жыл бұрын
underrated channel
@prodbyrish
@prodbyrish 3 жыл бұрын
This is so cool! Can I set this up to only detect poses I make with my hands?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup, there's mediapipe models that only detect hands as well. I've got a vid on the channel!
@prodbyrish
@prodbyrish 3 жыл бұрын
@@NicholasRenotte Got it! Il check it out!!
@stannisozbov
@stannisozbov 2 жыл бұрын
at [1:03:13], you told that we could use in a different use cases. But you told like action detection could be different so could you please explain what is the differences and what we have to do if you could say like 'follow this way' advices? thank you so much..
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Check this out: kzbin.info/www/bejne/mqCnhpyepc9pqNE
@stannisozbov
@stannisozbov 2 жыл бұрын
@@NicholasRenotte at first, thanks for your all attention. I already checked this out but when I implement and test all these processes in that video I cannot obtain efficient and accurate results. Do you think may I implement and train for the push up action by using LSTM units? Cuz I couldnt get good results even in basic arm and hand actions. Watcha think about it?
@TejrajParab
@TejrajParab 3 жыл бұрын
I want that pipeline video.
@houstonkoh7614
@houstonkoh7614 2 жыл бұрын
thanks for the video I have a question: i was trying to export the coords but it didnt export to excel
@danielkristioutomo1344
@danielkristioutomo1344 2 жыл бұрын
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou
@wanjohichristopher8556
@wanjohichristopher8556 3 жыл бұрын
Hi Nicholas,i love the content you make.Much thanks for sharing. Can we deploy this??
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Sure can! Been messing around with Kivy for CV (could probs do that).
@harshad-v8s
@harshad-v8s Жыл бұрын
hi nick can you make a more detailed video on explaining the libraries you imported and how the code works in detail?
@이주현-r4w2b
@이주현-r4w2b Жыл бұрын
Hi Nicholas! Depending on the position of the wrist, can you tell me the coordinates of the joint at that time??
@micheletufano6848
@micheletufano6848 Жыл бұрын
Amazing work! Thank you so much!
@fisiologicageral
@fisiologicageral 9 ай бұрын
Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.
@abcd-zw9oh
@abcd-zw9oh 3 жыл бұрын
Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Sure can! I actually did it in the past with a video of the Royals being interviewed.
@satishchandrasekaran3045
@satishchandrasekaran3045 3 жыл бұрын
@@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you. Could you please point me to the video where you use other videos/pictures to train the model?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@satishchandrasekaran3045 still a work in progress at this stage!
@soothingrelaxation8725
@soothingrelaxation8725 3 жыл бұрын
Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!
@soothingrelaxation8725
@soothingrelaxation8725 3 жыл бұрын
Heyy @@NicholasRenotte, yes if u can do that will be great! Thanks a lot for your help.
@mayamayonnala1712
@mayamayonnala1712 3 жыл бұрын
Awesome content. Is it also possible to train the csv file with tensorflow instead of sklearn? Looking forward to watching your other videos!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Sure can!
@庄鹏-l1s
@庄鹏-l1s 3 жыл бұрын
hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names "X does not have valid feature names, but". what's I make mistake? thanks.
@Greygasm
@Greygasm 2 жыл бұрын
Did you find a fix for this?
@hungduongquang795
@hungduongquang795 3 жыл бұрын
Do you know how to optimize the model for production? Great tutorial brother
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Probs a bunch of stuff to do so, want a vid on it?
@SohamMangore
@SohamMangore 8 ай бұрын
@@NicholasRenotte Yess !!
@shortcomedyclip
@shortcomedyclip 3 жыл бұрын
Thats Awesome! For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset? Thanks
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!
@amalendhu8610
@amalendhu8610 3 жыл бұрын
Hey brother, I like your content, your presentation. And a request, can you build a project on a sentence generator when some words are only given.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup! Check this out: kzbin.info/www/bejne/mXncnoCqZriEpJo
@faraazmohammed3693
@faraazmohammed3693 3 жыл бұрын
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Check this out! kzbin.info/www/bejne/mqCnhpyepc9pqNE
@namangoyal8477
@namangoyal8477 2 жыл бұрын
Hey Nick, need a help. Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.
@stanley-elmagico
@stanley-elmagico Жыл бұрын
Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?
@deepshrivastava229
@deepshrivastava229 2 жыл бұрын
Great Tutorial, very professionally and amazingly done. Thanks a lot !!! just an issue in loading the model again after restarting the kernel. Have to train the model every time when I open my jupyter notebook(cuz when loading the model in this condition it is not making predictions even after saving in pickel). Is there any way that I can keep the model intact even after I close the notebook or I have to train it everytime I open my notebook ? Please guide. Is there any way wherein I can save it not using pickel but using h5 format. Please guide !!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Pickle should work fine, are you sure the model is being saved? h5 is normally reserved for keras/tf models.
@deepshrivastava229
@deepshrivastava229 2 жыл бұрын
@@NicholasRenotte Firstly, A Big Thanks for the reply !!!! You Are AWESOME❤️❤️. I am saving the the model with pickel and its working fine for when I am making detections for the first time (just after training), but as soon as I close the notebook and open it the next time and load the same model its not making the detections, and I have to train it everytime. Hence I am unable to save/load it (i.e pickel might not be working or maybe I am doing something wrong in the last part). Can I do it using joblib as well ? Please guide. Thank you.
@FindMultiBagger
@FindMultiBagger 3 жыл бұрын
Thanks lots for great approch and hardwork 🙏♥️ Question :- 1) does it work for multiple person in frame ?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Unfortunately no @Vinay, check out OpenPose for that!
@FindMultiBagger
@FindMultiBagger 3 жыл бұрын
@@NicholasRenotte Thanks Nick 🙏
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@FindMultiBagger anytime!
@firthmanee7735
@firthmanee7735 3 жыл бұрын
Thanks for the great video as always !!, May I ask a question If I want to count how long for the specific position what should I do , do you have any suggestion ? , Thanks in advance.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Could look at counting the number of frames that position had the top score!
@firthmanee7735
@firthmanee7735 3 жыл бұрын
@@NicholasRenotte Thanks !!
@tedbryantesoro
@tedbryantesoro 2 жыл бұрын
hello thank you for this tutorial i was wondering if you can use a group of still image as a dataset instead of manually recording pose
@demonxsave9471
@demonxsave9471 3 жыл бұрын
can you show how to run this code on pycharm
@prtdesh25
@prtdesh25 3 жыл бұрын
Heyy!! Nice video actually I was looking for something like this but is this way generalized. Will this model work on different faces.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Sure will, just gotta fine tune!
@ZoeyZHANGYQ
@ZoeyZHANGYQ Жыл бұрын
Awesome content! But I have an error when running, how should I deal with it? UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names warnings.warn(
@SohamMangore
@SohamMangore 8 ай бұрын
facing the same error, did u find any solution ?
@אביטלמהגרפטה-ס4ו
@אביטלמהגרפטה-ס4ו 2 жыл бұрын
Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.
@sagarsingh2601
@sagarsingh2601 3 жыл бұрын
Good morning sir hope you have a great day thanks for this one
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime @Sagar Singh, what did you think of it?!
@sagarsingh2601
@sagarsingh2601 3 жыл бұрын
@Nicholas Renotte that is super awesome...😁
@shudarshankongkham198
@shudarshankongkham198 2 жыл бұрын
how do we put the threshold on the prediction? also, thank you for all the effort you put into each modules.
@CreatingUtopia
@CreatingUtopia 10 ай бұрын
@Nicholas Renotte , please reply, instead of classifying body language, we can detect spoken words with lip movement right?? Using lips coordinates
@gavel8888
@gavel8888 3 жыл бұрын
Thank you so much. Great tutorial. There is only one problem. The hands landmarks do not record coordinates if I use one of the hands to turn off camera. basically, both hands should be in the view of videocamera from the start till the end to record coordinates. I cannot figure out how to stop recording automatically after certain time. Could you please help with this?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Try using a loop rather than a key, could use something like for x in range(3000) to record 3000 frames!
@gavel8888
@gavel8888 3 жыл бұрын
@@NicholasRenotte Thank you!
@rony3044
@rony3044 3 жыл бұрын
can we use LSTM for this
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup, could apply a RNN layer using the landmarks @Rony!
@denisdj6180
@denisdj6180 3 жыл бұрын
A tutorial using LSTM would be amazing , the documentation is really poor
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@denisdj6180 yah, working on an action detection tutorial atm!
@rony3044
@rony3044 3 жыл бұрын
@@NicholasRenotte Thank you!
@rony3044
@rony3044 3 жыл бұрын
@@denisdj6180 exactly :(
@MsSonoFelice
@MsSonoFelice 3 жыл бұрын
Hi Nicholas !Thank you for nice work sharing. May i know the way to increase the fps for mediapipe . i have very low fps as 1 to 2 fps only. Kindly advice. thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @MsSonoFelice, what type of machine are you running this on? Possibly try a different machine, something with a GPU perhaps?
@aysuncag4545
@aysuncag4545 2 жыл бұрын
This is a perfect project.. Does anyone know, can I use my Keras model for this code?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Yep, sure can, in place of the sk classifier!
@tharindudamith4927
@tharindudamith4927 Жыл бұрын
hey is there any way to train the model with images ,without doing it by ourself
@muhammadahmed9647
@muhammadahmed9647 7 ай бұрын
Hi bro are you still doing it, if you have done it, can you help me with that as I am stuck in training a CNN model on MPII dataset
@anthonysoronnandi1459
@anthonysoronnandi1459 2 жыл бұрын
I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.
@mohammadadnan5988
@mohammadadnan5988 3 жыл бұрын
I trained my model and it's working fine. I have one issue. My application has to do the estimation on a whole classroom. How can we apply this to a group of people? It just detects one face per pic. Would really love some suggestion.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
There's a new pose estimation model available that supports multi person! Check this out tfhub.dev/google/movenet/multipose/lightning/1
@nadila3416
@nadila3416 3 жыл бұрын
hi! awesome video bro! what if we want to convert it into a desktop application or web application?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Could wrap it in Streamlit or Kivy!
@gameofwealth12
@gameofwealth12 3 жыл бұрын
I just discovered your channel and Learned So much about Machine Learning. Could you help me in my project? My Project is Classification of Bad and Good Sitting Posture. How would you deploy this in raspberry pi and send data to mobile application? Hoping for your response and tutorials on this. Thanks! I totally in love with your contents
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya, you couldi fine tune this model for good and bad posture and deploy the same code to RPi!
@yuriemond7340
@yuriemond7340 3 жыл бұрын
Is there a way to know to which joint the x1, y1, or x2, y2 are associated to? Am I mistaken to say that x1 would be associated to the first value of the Pose Landmark Model which is the nose?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Check this out @Yuri, it shows the index mapping: google.github.io/mediapipe/images/mobile/pose_tracking_full_body_landmarks.png
@priyambordoloi771
@priyambordoloi771 3 жыл бұрын
Hey Nicholas. Hope you are doing well. Just want to know how to use Mediapipe to target a particular person among many persons.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Hmmm, it would depend on what the defining characteristics are for that person @Priyam.
@priyambordoloi771
@priyambordoloi771 3 жыл бұрын
@@NicholasRenotte can you please explain me in a very short manner?
@priyambordoloi771
@priyambordoloi771 3 жыл бұрын
Like the mediapipe it always detects the first person in the frame.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@priyambordoloi771 hmm, that's just the way it works. It'll pick up the highest likelihood for a person. You could probably use an alternate method by training for a specific person, haven't tried this out before though :S
@hazemhossam2645
@hazemhossam2645 3 жыл бұрын
Great video!! I have a question, how can I enable the code to detect more than one person in the frame (scene)?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Hazem, not supported in MediaPipe unfortunately, check out OpenPose for multiple person tracking!
@hazemhossam2645
@hazemhossam2645 3 жыл бұрын
@@NicholasRenotte What library would you recommend if I want to make a counting system for people in a scene ?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@hazemhossam2645 take a look at OpenPose, you could then count the number of detections!
@hazemhossam2645
@hazemhossam2645 3 жыл бұрын
@@NicholasRenotte Tysm. Do you recommend any video/link about Openpose to start with?
@tahminazebin6099
@tahminazebin6099 2 жыл бұрын
Can you please provide a code version for doing it on a recorded video instead of the live webcam?
@01bit
@01bit 3 жыл бұрын
Excellent video!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @01bit!
@modyngs5985
@modyngs5985 2 жыл бұрын
Hey Nicholas, Thanks for this tutorial ... i was wondering if there is a solution for training a model with sentence instead of single word? lets say for training a sentence of ""HI, How are you doing?"" and then use it to recognize the sign language or for generation of sign language using animations. I dont want you to go through the whole process but my question is about teaching sentence(instead of single word) to the model using webcam and csv Thanks Best regards
@joinushugabear5847
@joinushugabear5847 2 жыл бұрын
Hi @Nicholas Renotte thank you for this nice tutorial. I was wondering how you could give the face detection data a bit more weight? So that I can do a classification that relies more on if i for instance smile or not? Or is that a training thing mostly? I still want the body language to count, but give more weight to the face in the model. Hope that makes sense? Cheers
@caqbme
@caqbme 3 жыл бұрын
Thank you very much for the great tutorial! Will be looking forward to your future projects. The MP hand detection works with multiple detection when max_num_hands = n. Would it be possible to edit the pose .py to have max_num_poses to detect multiple human poses like openpose/yolo?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Charles, yeah was looking into this, unfortunately the pose model it only works for a single pose/body.
@caqbme
@caqbme 3 жыл бұрын
Let's hope the model gets updated in the future. Really appreciate your work, can't wait for your next video. 😀
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@caqbme I'm with you on that one! YESS, just released today: kzbin.info/www/bejne/e5jNqH6DaLCtfbc
@nguyenvu6371
@nguyenvu6371 3 жыл бұрын
Hello Nicholas. I'm new to your channel and I'm glad that I found you. I saw someone can find bounding box of the face using mediapipe's pose estimation. I don't know how he can do that. I think he can find the width of bounding box by calculating distance between left ear and right ear key points, the center of bounding box probably is nose key point. But I don't know how to find the height of bounding box. Hope you can help me out. Thanks so much.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Nguyen Vu, they might have been using this model instead: google.github.io/mediapipe/solutions/face_detection.html
@sorochinsky
@sorochinsky 3 жыл бұрын
so... well, let's go!!)) It looks cool)
@sorochinsky
@sorochinsky 3 жыл бұрын
01:03:00 - Yes, we did, thank you)))
@sorochinsky
@sorochinsky 3 жыл бұрын
compared to the previous classification method, using image markup, this method looks more promising, but also more complex
@sorochinsky
@sorochinsky 3 жыл бұрын
Nick, information is top, in general, as always, this time I loaded it in full)) Considering that you put everything on the shelves. It will take a long time to digest = D
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSSS! You checked it out! It's definitely a lot more sophisticated than the angle calculation method which is why I was so excited to put it out. It'll perform a lot better in complex scenarios and can have additional logic applied over the top of it to do rep counting, form correction etc.
@panzerfizz2334
@panzerfizz2334 3 жыл бұрын
I was wondering If it would be possible install the program/coding on to a camera or raspberry pie and have a real time over lay. idea for airsoft/paintball headset/molecule.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Woah that would be sick, you probably could. Haven't tested it though yet. The doco mentions running it on Raspberry Pi and a Jetson about half way down: google.github.io/mediapipe/getting_started/install.html
@tasarm4939
@tasarm4939 3 жыл бұрын
hey man ıhave been followin you for a while you done greeaaat jobs your channel is like a full stack course of data science thank you so much for that. but ı really wantto know why are you doin that ı mean beside of a youtube content what do you expect from your projects ? is that something about your IBM carreer ? (like a part of portfolio ? )
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Ayyye, anytime man, glad you like it. I'm just doing it because I enjoy it at the moment 🙂
@pierrehachey
@pierrehachey 3 жыл бұрын
Awesome videos on object detection and great teaching ability. Great video on sign language detection. I wonder if you can create or already have a video on this. Scenario: User takes phone and hovers over an object, like a credit card, where entire credit card must be captured within the defined outlined box. Once the full object is detected "within" the outline a success message appears notifying user that they are centered and can now take a picture. Do you have any videos like that? Kinda like google lens but entire object would have to be inside outline. Thanks!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Closest I'd have is the ANPR series kzbin.info/www/bejne/Zl6XoZKHnNeXmKc
@lakpatamang2866
@lakpatamang2866 3 жыл бұрын
My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?
@joshlenuelpontillas5202
@joshlenuelpontillas5202 3 жыл бұрын
Hi! What do I need to learn about if I want to detect motion instead of a pose? and compare my shooting motion(basketball) from the shooting motion of a pro? Thanks for the videos, I struck goldmine from your channel!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Check this out: kzbin.info/www/bejne/mqCnhpyepc9pqNE
@coffeecoder9458
@coffeecoder9458 3 жыл бұрын
YOU ARE THE SH**!!! Props my man and thank you for making such great content!!
@shwetapatil1726
@shwetapatil1726 3 жыл бұрын
Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?
@lamsongianm
@lamsongianm 2 жыл бұрын
Awesome content!!
5 Python Libraries You Should Know in 2025!
22:30
Keith Galli
Рет қаралды 58 М.
Creative Justice at the Checkout: Bananas and Eggs Showdown #shorts
00:18
Fabiosa Best Lifehacks
Рет қаралды 35 МЛН
黑天使被操控了#short #angel #clown
00:40
Super Beauty team
Рет қаралды 54 МЛН
Smart Sigma Kid #funny #sigma
00:33
CRAZY GREAPA
Рет қаралды 37 МЛН
AI Learns to Do Deadlifts
17:06
Nicholas Renotte
Рет қаралды 41 М.
ML Was Hard Until I Learned These 5 Secrets!
13:11
Boris Meinardus
Рет қаралды 345 М.
Google's 9 Hour AI Prompt Engineering Course In 20 Minutes
20:17
How to Learn DATA SCIENCE Ridiculously FAST
14:07
Nicholas Renotte
Рет қаралды 54 М.
Deep Drowsiness Detection using YOLO, Pytorch and Python
1:18:35
Nicholas Renotte
Рет қаралды 261 М.
Large Language Models explained briefly
8:48
3Blue1Brown
Рет қаралды 826 М.
Using AI to Decode Animal Communication with Aza Raskin
49:36
Build your first machine learning model in Python
30:57
Data Professor
Рет қаралды 383 М.
Creative Justice at the Checkout: Bananas and Eggs Showdown #shorts
00:18
Fabiosa Best Lifehacks
Рет қаралды 35 МЛН