AI Body Language Decoder with MediaPipe and Python in 90 Minutes

  Рет қаралды 80,759

Nicholas Renotte

Nicholas Renotte

Күн бұрын

Want to start decoding body language?
Need to see who’s really saying what in that interview?
Trying to work out what’s the sign for Wakanda Forever? 🤣
You’ll learn how to do exactly that in this Python AI tutorial. In this video you’ll learn how to leverage Mediapipe to estimate both facial and body landmarks. With that data you’ll then be able to build custom pose classification models that allow you to decode what a person might be saying with their body language with fine grain accuracy. Best of all, you can customise this to suit your own needs. If you wanted to extend this to perform drowsiness detection or extended pose classification with hand models you could!
You’ll learn how to:
1. Set up MediaPipe for Python
2. Estimate Face and Body poses using your Webcam and OpenCV
3. Collect and process Joint Coordinates using Pandas
4. Train a custom Pose Classification model using Scikit-Learn
5. Decode Body Language in Real time
GET THE CODE FROM THE VIDEO: github.com/nicknochnack/Body-...
Mediapipe Holistic Tutorial: • AI Face Body and Hand ...
Mediapipe Holistic Baseline Code: github.com/nicknochnack/Full-...
Chapters:
0:00 - Start
0:22 - Introduction
1:05 - How it Works
3:15 - Tutorial Start
5:09 - Installing Mediapipe and Dependencies
19:24 - Capture Landmarks using OpenCV and CSV
41:48 - Load Pose and Face Data using Pandas
49:08 - Train Sciki-Learn Pose Classification Model
57:04 - Evaluate Classification Model and Pickle
1:05:28 - Making Detections using the Model
1:19:09 - Decoded Body Language Demo
1:24:41 - Displaying Probabilities
1:26:00 - Adding in New Poses
1:32:16 - Wrap Up
Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV
Happy coding!
Nick
P.s. Let me know how you go and drop a comment if you need a hand!

Пікірлер: 371
@ameensamhan751
@ameensamhan751 2 жыл бұрын
The most professional easy to understand and implement tutorials on youtube. You really are the best.
@hargobindsingh9763
@hargobindsingh9763 3 жыл бұрын
One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks sooo much @Hargobind, so glad you enjoyed it!!
@friedafrikadelle9483
@friedafrikadelle9483 3 жыл бұрын
I just discovered your channel and I‘m obsessed. Thank you so much for doing such great content🙏🏻🙏🏻🙏🏻
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thank you so much @Frieda, so stoked you're getting value from it!
@Virtualexist
@Virtualexist 3 жыл бұрын
Me tooo !!!!!
@francis3725
@francis3725 3 жыл бұрын
One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
🙌🙌🙌 sending you all the luck, you'll smash it @Francis!
@harshdasila6680
@harshdasila6680 2 жыл бұрын
have anyone actually implemented this code Please let me know Very urgent !!
@NiKiTjA_OFF
@NiKiTjA_OFF 3 ай бұрын
I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?! And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model
@one_done_facts
@one_done_facts 20 күн бұрын
HI. you can send requirements.txt string , please!
@emelsoylu3002
@emelsoylu3002 Жыл бұрын
Your videos are very descriptive and useful. Your content is of high quality. Thank you.
@EduardoGarcia-tv2fc
@EduardoGarcia-tv2fc 3 жыл бұрын
your tutorials are the best tutorials I have seen in my life, congratulations!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a tonnn @Eduardo!!
@isaackay5887
@isaackay5887 3 жыл бұрын
Looking forward to watching this later!! Thank you for all the quality videos. Have a great one!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime @Isaac! Thanks a bunch 🙏
@VikramSaigal
@VikramSaigal 3 жыл бұрын
Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Awesome usecase, I'll add it to the list. Never even thought about comparing poses!
@shalomsonekar6985
@shalomsonekar6985 2 жыл бұрын
This is really awesome , loved the way how you explained everything, great Job. Really Thankful for this. 💯 THANK YOU SO MUCH BRO ! KEEP HUSTLING ❤️
@srirammadduri8078
@srirammadduri8078 3 жыл бұрын
Man! Your tutorials are really really cool!! And DAMN RIGHT we want a bigger data science series!!!!! Awesome work man!!! Cheers!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSS! So glad you enjoyed it!
@srirammadduri8078
@srirammadduri8078 3 жыл бұрын
@@NicholasRenotte Mann! I thought you wouldn’t respond! Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@srirammadduri8078 nah man! I try to get to all comments. Hit me up on Discord, I check every night and if crazy every second night. bit.ly/3dQiZsV
@talhaeneskoksal4893
@talhaeneskoksal4893 2 жыл бұрын
Thanks buddy for really helpful videos. Keep going, Wakanda Forever!
@danielamemba5307
@danielamemba5307 3 жыл бұрын
The 210th comment is dedicated to the best content on KZbin. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime my guy, better late than never, WELCOME TO THE FAM!!!
@marcfinger4549
@marcfinger4549 2 жыл бұрын
Your channel has helped me so much when working on my dissertation. Thank you 🙏
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
YESSSS, go getem Marc! Hope you smash it out of the park!
@shivlymizi3211
@shivlymizi3211 3 ай бұрын
Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing
@one_done_facts
@one_done_facts 20 күн бұрын
HI. you can send requirements.txt string , please!
@priyambordoloi771
@priyambordoloi771 3 жыл бұрын
Good job brother. I will always appreciate the tasks that you do.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @Priyam!
@naratilife
@naratilife 2 жыл бұрын
Excellent Presentation. Just loved it.
@micheletufano6848
@micheletufano6848 Жыл бұрын
Amazing work! Thank you so much!
@nicolasabosch
@nicolasabosch 10 ай бұрын
Great tutorial, i wish your channel have more visibility
@creathyang9413
@creathyang9413 2 жыл бұрын
Excellent vid man, thanks
@CalebSchantzChristFollower
@CalebSchantzChristFollower 3 жыл бұрын
Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.
@eddysaoudi253
@eddysaoudi253 3 жыл бұрын
Exactly.
@friedafrikadelle9483
@friedafrikadelle9483 3 жыл бұрын
Yes!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!
@CalebSchantzChristFollower
@CalebSchantzChristFollower 3 жыл бұрын
No hurry, you are already putting out content at a crazy pace! Take that break!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.
@leonelp9593
@leonelp9593 2 жыл бұрын
Such a cool content ! Thanks for sharing this
@amilakelum2670
@amilakelum2670 Жыл бұрын
This video help me in creating my final year project thanks lot ❤
@danieladama8105
@danieladama8105 3 жыл бұрын
Just what I needed. Thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESS! So glad to hear Daniel!
@one1896
@one1896 3 жыл бұрын
Only you have the best python vidos on KZbin. Greetings from Russia)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @ONE! What's happening from Sydney!?
@vishalm954
@vishalm954 3 жыл бұрын
Amazing stuff! Getting to learn a lot:)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @Vishal 🙏!
@jonathonvandyke6328
@jonathonvandyke6328 2 жыл бұрын
Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Nothing around it yet but will probably do something soon @Jonathon!
@shai8559
@shai8559 2 жыл бұрын
really amazing content. im currently working on my final cs project and this video (and some others) were tremendous help for me. amazing job man!
@harshdasila6680
@harshdasila6680 2 жыл бұрын
have anyone actually implemented this code Please let me know Very urgent !!
@shai8559
@shai8559 2 жыл бұрын
@@harshdasila6680 i did. What you need?
@harshdasila6680
@harshdasila6680 2 жыл бұрын
@@shai8559 i am getting error
@shai8559
@shai8559 2 жыл бұрын
@@harshdasila6680 you can type the error and ill see if i can help
@winniepooh2533
@winniepooh2533 3 жыл бұрын
Hey Man...! You are really cool!!!! I love this project, I'm your new subscribers!!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSS! Welcome to the fam!
@shwetapatil1726
@shwetapatil1726 2 жыл бұрын
Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?
@joinushugabear5847
@joinushugabear5847 2 жыл бұрын
Hi @Nicholas Renotte thank you for this nice tutorial. I was wondering how you could give the face detection data a bit more weight? So that I can do a classification that relies more on if i for instance smile or not? Or is that a training thing mostly? I still want the body language to count, but give more weight to the face in the model. Hope that makes sense? Cheers
@shahdsg4527
@shahdsg4527 2 жыл бұрын
Thank you so much!!!!! Please can i do same steps for sign language recognition instead of using mediapipe+LSTM ???
@victormustin2547
@victormustin2547 3 жыл бұрын
I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yah, agreed! Working on a bunch of stuff in that space rn @Victor!
@victormustin2547
@victormustin2547 3 жыл бұрын
@@NicholasRenotte Amazing ! I’ll be there to see it as soon as it comes out !
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@victormustin2547 yesss! Thanks a bunch for checking out the vids so far as well!
@lamsongianm
@lamsongianm 2 жыл бұрын
Awesome content!!
@01bit
@01bit 3 жыл бұрын
Excellent video!!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @01bit!
@jmacron4652
@jmacron4652 2 жыл бұрын
Great tutorial....Can you do a tutorial where you can save body and facial motion to BVH or FBX files to use with a 3D Character..
@danielkristioutomo1344
@danielkristioutomo1344 2 жыл бұрын
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou
@faraazmohammed3693
@faraazmohammed3693 2 жыл бұрын
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Check this out! kzbin.info/www/bejne/mqCnhpyepc9pqNE
@AiPhile
@AiPhile 3 жыл бұрын
Awesome 👍 work appreciated ♥️
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a ton @AiPhile!
@yousseffarhan8901
@yousseffarhan8901 3 жыл бұрын
محتوى ممتع ومفيد، شكرا جزيلا لك 🙏🏼 تستحق المدح والتشجيع
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thank you so much @Youssef! So glad you enjoyed it!
@tedbryantesoro
@tedbryantesoro 2 жыл бұрын
hello thank you for this tutorial i was wondering if you can use a group of still image as a dataset instead of manually recording pose
@JohnGalanakis
@JohnGalanakis 3 жыл бұрын
I love your videos and your work
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a bunch @John!
@olatundeolukoya1788
@olatundeolukoya1788 6 ай бұрын
2 years but the video still Lit
@shudarshankongkham198
@shudarshankongkham198 2 жыл бұрын
how do we put the threshold on the prediction? also, thank you for all the effort you put into each modules.
@jeffreylin2488
@jeffreylin2488 2 жыл бұрын
underrated channel
@coffeecoder9458
@coffeecoder9458 2 жыл бұрын
YOU ARE THE SH**!!! Props my man and thank you for making such great content!!
@fisiologicageral
@fisiologicageral 3 ай бұрын
Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.
@mayamayonnala1712
@mayamayonnala1712 2 жыл бұрын
Awesome content. Is it also possible to train the csv file with tensorflow instead of sklearn? Looking forward to watching your other videos!!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Sure can!
@user-jc1eg9ob2n
@user-jc1eg9ob2n Жыл бұрын
hi nick can you make a more detailed video on explaining the libraries you imported and how the code works in detail?
@shortcomedyclip
@shortcomedyclip 3 жыл бұрын
Thats Awesome! For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset? Thanks
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!
@wanjohichristopher8556
@wanjohichristopher8556 2 жыл бұрын
Hi Nicholas,i love the content you make.Much thanks for sharing. Can we deploy this??
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Sure can! Been messing around with Kivy for CV (could probs do that).
@stanley-elmagico
@stanley-elmagico 8 ай бұрын
Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?
@modyngs5985
@modyngs5985 2 жыл бұрын
Hey Nicholas, Thanks for this tutorial ... i was wondering if there is a solution for training a model with sentence instead of single word? lets say for training a sentence of ""HI, How are you doing?"" and then use it to recognize the sign language or for generation of sign language using animations. I dont want you to go through the whole process but my question is about teaching sentence(instead of single word) to the model using webcam and csv Thanks Best regards
@houstonkoh7614
@houstonkoh7614 2 жыл бұрын
thanks for the video I have a question: i was trying to export the coords but it didnt export to excel
@shivamsingh-vv9vm
@shivamsingh-vv9vm 3 жыл бұрын
Let's try something in 3D. That will look great. The AI gym trainer in 3D would be great!!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Agreed, on the R&D list as we speak!
@sagarsingh2601
@sagarsingh2601 3 жыл бұрын
Good morning sir hope you have a great day thanks for this one
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Anytime @Sagar Singh, what did you think of it?!
@sagarsingh2601
@sagarsingh2601 3 жыл бұрын
@Nicholas Renotte that is super awesome...😁
@KamalMahss
@KamalMahss Ай бұрын
first, i want to thank you about this big effort. second, can you make a video about fall detection using media pipe please this video will help me a lot
@one_done_facts
@one_done_facts 20 күн бұрын
HI. you can send requirements.txt string , please!
@KriGeta
@KriGeta 3 жыл бұрын
So awesome, is there any way to control a 3D model in blender using this body estimation technique? Like motion capture?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Haven't seen it in blender but I've seen it in Unity using the Barracuda framework!
@KriGeta
@KriGeta 3 жыл бұрын
@@NicholasRenotte may you pls tag me a tutorial?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@KriGeta don't have anything yet but will shoot it through once it's up!
@KriGeta
@KriGeta 3 жыл бұрын
@@NicholasRenotte that's great 😍
@kirtipandya4618
@kirtipandya4618 3 жыл бұрын
Awesome awesome work.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks a bunch @Kirti, so glad you enjoyed it!
@roboticsforunitedindia9421
@roboticsforunitedindia9421 2 жыл бұрын
Nice video sir
@user-um1kn5rr1q
@user-um1kn5rr1q 6 ай бұрын
Hi Nicholas! Depending on the position of the wrist, can you tell me the coordinates of the joint at that time??
@CreatingUtopia
@CreatingUtopia 4 ай бұрын
@Nicholas Renotte , please reply, instead of classifying body language, we can detect spoken words with lip movement right?? Using lips coordinates
@abcd-zw9oh
@abcd-zw9oh 2 жыл бұрын
Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Sure can! I actually did it in the past with a video of the Royals being interviewed.
@satishchandrasekaran3045
@satishchandrasekaran3045 2 жыл бұрын
@@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you. Could you please point me to the video where you use other videos/pictures to train the model?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
@@satishchandrasekaran3045 still a work in progress at this stage!
@soothingrelaxation8725
@soothingrelaxation8725 3 жыл бұрын
Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!
@soothingrelaxation8725
@soothingrelaxation8725 3 жыл бұрын
Heyy @@NicholasRenotte, yes if u can do that will be great! Thanks a lot for your help.
@nurulsyifa9035
@nurulsyifa9035 3 жыл бұрын
so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thank you so much @Nurul! You could particularly with the hand models! Could even pass to a RNN for action detection!
@yuriemond7340
@yuriemond7340 3 жыл бұрын
@@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@yuriemond7340 definitely, take a look at some of these action models: tfhub.dev/s?q=action
@finance315
@finance315 3 жыл бұрын
thats so cool! i have a question, how can we fix the flickering at then when it's running?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
It would need a more powerful GPU or machine. The lag is due to the FPS drag from the ml model.
@finance315
@finance315 3 жыл бұрын
@@NicholasRenotte i have fixed it!! now running at 10 to 12 FPS, thats still good. thank you so muchhhh
@user-ks2jf8tt9u
@user-ks2jf8tt9u Жыл бұрын
Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.
@sorochinsky
@sorochinsky 3 жыл бұрын
so... well, let's go!!)) It looks cool)
@sorochinsky
@sorochinsky 3 жыл бұрын
01:03:00 - Yes, we did, thank you)))
@sorochinsky
@sorochinsky 3 жыл бұрын
compared to the previous classification method, using image markup, this method looks more promising, but also more complex
@sorochinsky
@sorochinsky 3 жыл бұрын
Nick, information is top, in general, as always, this time I loaded it in full)) Considering that you put everything on the shelves. It will take a long time to digest = D
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
YESSSS! You checked it out! It's definitely a lot more sophisticated than the angle calculation method which is why I was so excited to put it out. It'll perform a lot better in complex scenarios and can have additional logic applied over the top of it to do rep counting, form correction etc.
@brucewayne9708
@brucewayne9708 3 жыл бұрын
hey can we use this to do real time sign launguage . If we can use this please do a video on it.Thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Bruce! Heya, yup, got something in mind!
@MsSonoFelice
@MsSonoFelice 3 жыл бұрын
Hi Nicholas !Thank you for nice work sharing. May i know the way to increase the fps for mediapipe . i have very low fps as 1 to 2 fps only. Kindly advice. thank you
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @MsSonoFelice, what type of machine are you running this on? Possibly try a different machine, something with a GPU perhaps?
@pierrehachey
@pierrehachey 2 жыл бұрын
Awesome videos on object detection and great teaching ability. Great video on sign language detection. I wonder if you can create or already have a video on this. Scenario: User takes phone and hovers over an object, like a credit card, where entire credit card must be captured within the defined outlined box. Once the full object is detected "within" the outline a success message appears notifying user that they are centered and can now take a picture. Do you have any videos like that? Kinda like google lens but entire object would have to be inside outline. Thanks!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Closest I'd have is the ANPR series kzbin.info/www/bejne/Zl6XoZKHnNeXmKc
@prtdesh25
@prtdesh25 2 жыл бұрын
Heyy!! Nice video actually I was looking for something like this but is this way generalized. Will this model work on different faces.
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Sure will, just gotta fine tune!
@firthmanee7735
@firthmanee7735 2 жыл бұрын
Thanks for the great video as always !!, May I ask a question If I want to count how long for the specific position what should I do , do you have any suggestion ? , Thanks in advance.
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Could look at counting the number of frames that position had the top score!
@firthmanee7735
@firthmanee7735 2 жыл бұрын
@@NicholasRenotte Thanks !!
@amalendhu8610
@amalendhu8610 3 жыл бұрын
Hey brother, I like your content, your presentation. And a request, can you build a project on a sentence generator when some words are only given.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Yup! Check this out: kzbin.info/www/bejne/mXncnoCqZriEpJo
@namangoyal8477
@namangoyal8477 2 жыл бұрын
Hey Nick, need a help. Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.
@deepshrivastava229
@deepshrivastava229 2 жыл бұрын
Great Tutorial, very professionally and amazingly done. Thanks a lot !!! just an issue in loading the model again after restarting the kernel. Have to train the model every time when I open my jupyter notebook(cuz when loading the model in this condition it is not making predictions even after saving in pickel). Is there any way that I can keep the model intact even after I close the notebook or I have to train it everytime I open my notebook ? Please guide. Is there any way wherein I can save it not using pickel but using h5 format. Please guide !!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Pickle should work fine, are you sure the model is being saved? h5 is normally reserved for keras/tf models.
@deepshrivastava229
@deepshrivastava229 2 жыл бұрын
@@NicholasRenotte Firstly, A Big Thanks for the reply !!!! You Are AWESOME❤️❤️. I am saving the the model with pickel and its working fine for when I am making detections for the first time (just after training), but as soon as I close the notebook and open it the next time and load the same model its not making the detections, and I have to train it everytime. Hence I am unable to save/load it (i.e pickel might not be working or maybe I am doing something wrong in the last part). Can I do it using joblib as well ? Please guide. Thank you.
@nguyenvu6371
@nguyenvu6371 3 жыл бұрын
Hello Nicholas. I'm new to your channel and I'm glad that I found you. I saw someone can find bounding box of the face using mediapipe's pose estimation. I don't know how he can do that. I think he can find the width of bounding box by calculating distance between left ear and right ear key points, the center of bounding box probably is nose key point. But I don't know how to find the height of bounding box. Hope you can help me out. Thanks so much.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Nguyen Vu, they might have been using this model instead: google.github.io/mediapipe/solutions/face_detection.html
@prodbyrish
@prodbyrish 2 жыл бұрын
This is so cool! Can I set this up to only detect poses I make with my hands?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Yup, there's mediapipe models that only detect hands as well. I've got a vid on the channel!
@prodbyrish
@prodbyrish 2 жыл бұрын
@@NicholasRenotte Got it! Il check it out!!
@ameerazam3269
@ameerazam3269 3 жыл бұрын
this one is amazing
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
It's pretty slick right? There's so much you can actually do with the workflow @Ameer!
@somyatomar6292
@somyatomar6292 2 жыл бұрын
Hi, this is an amazing project! I followed the method discussed here for exercise pose classification. It worked good. But now I have a doubt that's very different from pose classification. How can I rate a user's exercise pose accuracy given that I know the class of the pose?
@harshdasila6680
@harshdasila6680 2 жыл бұрын
have anyone actually implemented this code Please let me know Very urgent !!
@prateekxx
@prateekxx 2 жыл бұрын
55:47 that mic glitch made me spill coffee on myself
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Oh shit 🤣, didn't even know that was in there.
@TejrajParab
@TejrajParab 2 жыл бұрын
I want that pipeline video.
@yoman9446
@yoman9446 3 жыл бұрын
Awesome!
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Thanks so much @MONKey!
@anthonysoronnandi1459
@anthonysoronnandi1459 2 жыл бұрын
I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.
@rupendrakrishnaraavi4217
@rupendrakrishnaraavi4217 3 жыл бұрын
Hi Nicholas, first of all, it's really a great piece of work but here again, I have a scenario where I will train my model with different signs(Alphabetical blind signs) and I wanted all of them to come up in a phrase/sentence that may be in a new window any clue how to do that?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Heya @Rupendra, check this out: kzbin.info/www/bejne/i4G2ZmefbLCgaZI
@FindMultiBagger
@FindMultiBagger 3 жыл бұрын
Thanks lots for great approch and hardwork 🙏♥️ Question :- 1) does it work for multiple person in frame ?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Unfortunately no @Vinay, check out OpenPose for that!
@FindMultiBagger
@FindMultiBagger 3 жыл бұрын
@@NicholasRenotte Thanks Nick 🙏
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
@@FindMultiBagger anytime!
@mrrfrooty
@mrrfrooty Жыл бұрын
hey nicholas, I was trying to get this to work but i kept getting the error where I could not convert either "Happy" or "Sad" from string to float, I can't get around this. Do you know why?
@yuriemond7340
@yuriemond7340 3 жыл бұрын
Is there a way to know to which joint the x1, y1, or x2, y2 are associated to? Am I mistaken to say that x1 would be associated to the first value of the Pose Landmark Model which is the nose?
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Check this out @Yuri, it shows the index mapping: google.github.io/mediapipe/images/mobile/pose_tracking_full_body_landmarks.png
@user-yb3hq5bh3f
@user-yb3hq5bh3f 2 жыл бұрын
hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names "X does not have valid feature names, but". what's I make mistake? thanks.
@Greygasm
@Greygasm Жыл бұрын
Did you find a fix for this?
@mohamedabudalkrem6289
@mohamedabudalkrem6289 Жыл бұрын
wooow thanks for Avery think u real eng 🤩🤩🤩🤩
@tahminazebin6099
@tahminazebin6099 2 жыл бұрын
Can you please provide a code version for doing it on a recorded video instead of the live webcam?
@panzerfizz2334
@panzerfizz2334 3 жыл бұрын
I was wondering If it would be possible install the program/coding on to a camera or raspberry pie and have a real time over lay. idea for airsoft/paintball headset/molecule.
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Woah that would be sick, you probably could. Haven't tested it though yet. The doco mentions running it on Raspberry Pi and a Jetson about half way down: google.github.io/mediapipe/getting_started/install.html
@gavel8888
@gavel8888 2 жыл бұрын
Thank you so much. Great tutorial. There is only one problem. The hands landmarks do not record coordinates if I use one of the hands to turn off camera. basically, both hands should be in the view of videocamera from the start till the end to record coordinates. I cannot figure out how to stop recording automatically after certain time. Could you please help with this?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Try using a loop rather than a key, could use something like for x in range(3000) to record 3000 frames!
@gavel8888
@gavel8888 2 жыл бұрын
@@NicholasRenotte Thank you!
@asmakhoualdia2314
@asmakhoualdia2314 2 жыл бұрын
great tutorial I am to trying to run it but i get this error when i was trying to do the training ML classification model :This solver needs samples of at least 2 classes in the data, but the data contains only one class:'Wakanda Forever' I hope you can help me with that
@lakpatamang2866
@lakpatamang2866 2 жыл бұрын
My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?
@joshlenuelpontillas5202
@joshlenuelpontillas5202 2 жыл бұрын
Hi! What do I need to learn about if I want to detect motion instead of a pose? and compare my shooting motion(basketball) from the shooting motion of a pro? Thanks for the videos, I struck goldmine from your channel!
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Check this out: kzbin.info/www/bejne/mqCnhpyepc9pqNE
@jonathanvillanueva9538
@jonathanvillanueva9538 2 жыл бұрын
I need help with the training custom model. I get "no capture output live stream" ,when I try to read in the csv. I am not using jupyter notebook, I am using visual studio code for python.
@bhaktidhongade
@bhaktidhongade 3 ай бұрын
While rendering in the last part i.e. the detection, I am able to detect but I am also getting a warning. The warning is " X does not have valid feature names, but StandardScaler was fitted with feature names". Please can someone help me out with this...
@nadila3416
@nadila3416 2 жыл бұрын
hi! awesome video bro! what if we want to convert it into a desktop application or web application?
@NicholasRenotte
@NicholasRenotte 2 жыл бұрын
Could wrap it in Streamlit or Kivy!
@yasinyer381
@yasinyer381 3 жыл бұрын
you amaze me
@NicholasRenotte
@NicholasRenotte 3 жыл бұрын
Ohhh shucks 😅
How to Code a AI Trading bot (so you can make $$$)
35:09
Nicholas Renotte
Рет қаралды 503 М.
Face recognition in real-time | with Opencv and Python
28:19
Pysource
Рет қаралды 249 М.
The delivery rescued them
00:52
Mamasoboliha
Рет қаралды 10 МЛН
How to bring sweets anywhere 😋🍰🍫
00:32
TooTool
Рет қаралды 23 МЛН
🍕Пиццерия FNAF в реальной жизни #shorts
00:41
AI Learns to Do Deadlifts
17:06
Nicholas Renotte
Рет қаралды 36 М.
LangChain Crash Course: Build a AutoGPT app in 25 minutes!
27:28
Nicholas Renotte
Рет қаралды 412 М.
Using AI to Decode Animal Communication with Aza Raskin
49:36
I used LLaMA 2 70B to rebuild GPT Banker...and its AMAZING (LLM RAG)
11:08
Professional Preprocessing with Pipelines in Python
21:48
NeuralNine
Рет қаралды 57 М.
5 НЕЛЕГАЛЬНЫХ гаджетов, за которые вас посадят
0:59
Кибер Андерсон
Рет қаралды 1,5 МЛН
Самый топовый ПК без RGB подсветки
1:00
CompShop Shorts
Рет қаралды 106 М.
ВСЕ МОИ ТЕЛЕФОНЫ
14:31
DimaViper Live
Рет қаралды 49 М.
Выложил СВОЙ АЙФОН НА АВИТО #shorts
0:42
Дмитрий Левандовский
Рет қаралды 2 МЛН