ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing

ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification
Altium Designer: For Schematic and PCB designing
www.altium.com/yt/electronicl...
Altium 365:
www.altium.com/altium-365
Octopart, components search engine:
octopart.com/
download programming:
www.electroniclinic.com/esp32...
ESP32 Cam projects: related videos
Watch the same video in Hindi/Urdu
• ESP32 CAM with Python ...
ESP32 Cam and Arduino-based Car Parking Gate / Barrier control
• ESP32 CAM with Python ...
ESP32 Cam based Human Pose landmarks detection, security camera
• ESP32 Cam Python OpenC...
How to make IoT camera using ESP32 Cam and Telegram:
• IoT Camera using ESP32...
ESP32 Cam with ESP8266, google drive, and Google spreadsheet
• ESP32 CAM and ESP8266 ...
ESP32 CAM getting started video
• ESP32 Cam: ESP32 Camer...
ESP32 CAM DOOR LOCK CONTROL SYSTEM USING HUMAN RECOGNITION
• ESP32 Cam Face Recogni...
ESP32 CAM SEND IMAGES TO GOOGLE DRIVE
• ESP32 CAM Send Images ...
ESP32 CAM SMART IOT DOOR BELL
• ESP32 CAM Smart IoT Be...
ESP32 CAM SAVE IMAGES IN SD CARD
• ESP32 Cam save Image t...
Support me on Patreon and get access to hundreds of projects:
/ electroniclinic
Subscribe to my New KZbin Channel, if you want to watch my videos in Hindi/Urdu
/ @letsgetstartedd
Project Description:
********************
In this video, I am going to use ESP32 Camera module with Python OpenCV Yolo V3 for object detection and Identification. I am only using ESP32 Camera module for the live video streaming whereas for the image processing I am using Yolo V3.
I will test it on three different machines and you will be amazed with the end results. First I will test it using the Raspberry Pi 4 and it has 8GB RAM. Then I will test it on Core i3 Laptop. And finally, I will test it on my MSI Intel Core i7 with Nvidia Geforce 16GB GPU and 16GB RAM. I specially purchased this laptop for video editing and image processing.
Anyway, after performing initial tests then I will share with you the final code, which can be used for the detection and identification of specific objects. Let’s say you want to send an alert message when a specific object is detected.
In my case, I send an alert message when a bird and cat are detected both at the same time. While all the other objects are totally ignored.
We have a long list of the objects that we can detect. So, after watching this video you will be able to detect all these objects at the same time or you can select one or multiple objects of your choice and this way you can build amazing image processing based projects.
********************
Amazon Purchase links:
*****************
ESP32 Camera Module
amzn.to/45yPi9D
ESP32 CAM W-BT Board
amzn.to/3N24vbY
MSI Intel Core i7 Laptop check this out.
amzn.to/42ayHpL
Other must-have Tools and Components:
ESP32 WiFi + Bluetooth Module (My recommendation), more IO pins, improved speed, and supports a Lipo Battery:
amzn.to/3v40DkE
Arduino Uno, Nano, Mega, Micro "All types of Arduino Boards":
amzn.to/3fk5OTi
Top Arduino Sensors:
amzn.to/3vZbnfM
Super Starter kit for Beginners
amzn.to/3cq56C5
Top Oscilloscopes
amzn.to/3ctF3d8
Variable Supply:
amzn.to/2PEAqE7
Digital Multimeter:
amzn.to/2QGRPg1
Top Soldering iron kits: "best"
amzn.to/39nqDtb
Top Portable drill machines:
amzn.to/3suQMh7
Jumper Wires:
amzn.to/2NYPEDA
3D printers:
amzn.to/3ruG1dt
CNC Machines:
amzn.to/3cuZWVv
DISCLAIMER: This video and description contain affiliate links, which means that if you click on one of the product links, I will receive a small commission. This helps support the channel and allows me to continue to make videos like this. Thank you for your support!
****************
For more Projects and tutorials visit my Websites
Electronic Clinic:
www.electroniclinic.com/
Programming Digest:
programmingdigest.com/
Follow me on Instagram:
/ electroniclinic
Follow my Facebook Page Electronic Clinic:
web. profile.php?...
Follow my Facebook Group, Arduino Projects:
/ 190031841821771
Email:
[e-mail]
About the Electronic Clinic:
Electronic Clinic helps the students and other professionals to learn electronics, designing, and programming. Electronic Clinic has tutorials on Arduino, Arduino Nano, Raspberry PI, image processing, gsm based projects, Bluetooth based projects, esp8266 projects, Nodemcu projects, robotics, desktop application designing and programming, PLC, SCADA, RC Planes, Electronics, Power Generation, HMI, and much more. Check my Playlists.
#esp32cam #yolov3 #opencvpython

[@ElectroniClinic]

Watch my Latest Video on ESP32 Cam, Python, OpenCV, & Mediapipe based Diy Security Camera using Human Pose Landmarks kzbin.info/www/bejne/poalqnyVatiUiNU

[@ackj9766]

what is you esp32 board version camear ip didnt appear

[@jerroldleung8065]

hello, I have a problem with detection. The Detection window pops up but stays black. There is a live transmission window, this works well.

[@muhammadsalem9924]

Thank you, professor Excellent work

[@shivaraghav2899]

Mind blowing.... Super project

[@benj5279]

You really help me a lot with your videos i hope i can support you somehow ❤️

[@ElectroniClinic]

you can support me and my channel by subscribing, or liking the videos, and comments. And by sharing videos with your friends. Today, i will upload a new video about car tracking and gate/barrier control system. I hope you will like the idea.

[@muhammadhamza6536]

amazing really helpful

[@vedmaheshkale5943]

your cat is cute!!!!!!!!! 🐈

[@unik8985]

Hi, I've done everything right and have the live camera working but whenever I try to run the object detection code it gives me an error where: outputNames = [layernames[i[0]-1] for i in net.getUnconnectedOutLayers()] ~^^^ IndexError: invalid index to scalar variable. and I can't seem to fix it

[@wdew1927]

Very nice subject ! During compiling a message "cannot find webserver.h". My board version is 2.0.10 Do you have a solution for this ?

[@user-fq6yi5fu3f]

ERROR: Could not find a version that satisfies the requirement open-cv-python--4.5.3.56 (from versions: none) ERROR: No matching distribution found for open-cv-python--4.5.3.56 in cmd 2nd step installing open cv

[@sam-el]

I want to ask. Can you help me with a guide to create object detection using de1-soc

[@CharlesMashava]

I watch your videos.I find them very helpful for my own going project. However i am running the an application with same weights but its supper slow on detecting and sending information to the esp32. How can i optimize it to be fast??

[@glennimmanuel9338]

maybe you can try to use freeRTOS to manage the tasks

[@Radar131]

Want request may you make video about helmet and plate number detection ?

[@user-cc5cj2ty7y]

What should be the specification of camera for image detection or image processing into camera and then send only a small amount of data such as number of people passed through it etc to the network ?? Please help...🙂

[@bberil4834]

Thank you for the video. I want to do the exact same project but I will use the ESP32 as a soft access point. How should I modify the code?

[@aneshk425]

You got any solution bro?..even am looking for the same thing

[@user-zm7qi7et3r]

why did you do the image processing and objec detection on Raspberry Pi or Laptop, can't it be done on the ESP32?

[@sanakabanerjee4462]

esp32 has very less ram and is only good for capturing image, it can no way run such a heavy model

[@PraveenKumar-vz4dy]

8:10 we can't do image processing in esp32 cam (not enough computational power ) is this what u r trying to say ?

[@deeptanshugupta4241]

Is it possible to do this without connecting it to pc

[@parthimahi]

6:41 for its coming for me "camera fails"what should I do plse anyone suggest me

[@chideraagbasiere7868]

Where did the "Cat and Bird Detection" file come from @3:39 ?

[@user-ds3zg5xs7i]

how do i incorporate the same for yolo v8 model?

[@Shykidss]

Does it work with Yolo nas

[@orphaeel]

i have this problem... cv2.error: OpenCV(4.5.3) C:\Users unneradmin\AppData\Local\Temp\pip-req-build-sn_xpupm\opencv\modules\dnn\src\darknet\darknet_io.cpp:900: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' anyone have the solution for this problem???

[@manishuike3830]

can you make one for nut and bolt identifying

[@nagababumarthi1942]

Pls make esp32 cam based pick and place robot

[@user-fy3bh8ie2v]

Hi, I want to make something similar, but instead of object detection, I want to make face detection system using esp32cam which will be used for storing student attendance, can you please help or provide some reference related to this.

[@ElectroniClinic]

for this you will need to train faces. I am working on a similar project. Its object the identification of other objects not available in the coco.names list.

[@muhammadsalem9924]

Please tell me what are the appropriate computer specifications for deep learning and machine learning ? Please answer

[@harshwardhansingh9915]

Any computer with a GPU will work fine. But if you don't have that, you only need an internet connection. There are online tools like Google Collab that will provide you with an online jupyter notebook free of charge, you can use it for learning machine learning

[@didzi6728]

Hey. When I try to run the code in Python IDLE I get this error: "Failed to open the IP camera stream". While if I copy and past the camera's url in the web browser it works fine! Any ideas on how to fix it?

[@dhivyabharathy3032]

Me too

[@dhivyabharathy3032]

Do you fix it?

[@didzi6728]

@@dhivyabharathy3032 Not really, I switched to Raspi cameras

[@haven-hw2wl]

Hi sir your project is awesome, but when i try all of your instructions im having a problem with coco.names even if it's in the same folder but always displaying error that no coco.names found 😢

[@aymanmrwan2410]

Yes me too

[@haven-hw2wl]

@@aymanmrwan2410 bro i already did it, just use different format not notepad

[@kris8167]

@@haven-hw2wl Then I would like to ask what format you use, thank you.

[@vikasreddy4864]

Does object detection works for similar objects ? Does object detection works for identification of safflower stigma from saffron stigma?

[@Shykidss]

You can train custom dataset to the model

[@joaogouveia4497]

im trying to do the same thing the only diference is that im using an esp32s3 camera that creates a webserver for the video but when i try to access the webserver ip my opencv crashes. Do you know what could have caused this?

[@kevinchang0527]

Been running into similar problem. Do you see your IP in serial monitor? I had it when I tried it some time ago, and now I can't get my IP built

[@palindrome3212]

i have this error in line 71 saying: outputNames = [layernames[i[0] - 1] for i in net.getUnconnectedOutLayers()] IndexError: invalid index to scalar variable. Can you help me with the error?

[@BuddhiniJayakody]

did you fix the issue? I also get the same issue

[@auburngold4958]

Fixed the issue, just remove the [0] and run the program. This only works on windows

[@attacker21]

@@auburngold4958 thanks a lot

[@juantellez2176]

would this work with a pretraining yolov8?

[@user-ds3zg5xs7i]

did you try it out?

[@benj5279]

Can this work if laptop and esp32 are connected to different wifi?

[@manojshyaam6683]

Yes it does

[@user-ul2em8lv3v]

does this process can be run on raspberrypie without a computer after starting the process? i want make this for blind people which they can carry with them?

[@ElectroniClinic]

Ya you can use use raspberry pi

[@janarthanandayalan]

Hi sir, is there a way we can give our very own data to train the camera?

[@ElectroniClinic]

Very soon I will make a video about this.

[@digitronix532]

If my camera senses "Car" , any one of gpio should turn on in ESP32CAM . Help me

[@ElectroniClinic]

I have done it. Check playlist or the related projects list in the description.

[@waleedhussain4409]

can you please give the code for alert as an email or for arduino using gsm that you tell in last part of video it would e very helpul if you give code for it

[@manojshyaam6683]

Search for SMTP protocol for ESP 32 Best wishes

[@benj5279]

What do you use to run the python code?

[@benj5279]

Nvm i figured it out

[@juantellez2176]

I havent figured out what did u use to run python?

[@Jarniwan]

you should have at least tell us if the middle part was a sponsor segment. that was awful.

[@Mmorpg347]

When I open the serial monitor it shows me to write a message how can I fix this

[@parthimahi]

Press reset button

[@rockstarsk4023]

where is the main program file??

[@sontruongpham6883]

Your guide is very helpful. But I got this error in line 30 of esp32cam.cpp file while compile the esp32camera test code: error: 'camera_sensor_info_t' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'esp_camera_sensor_get_info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); Could you help me? Thanks.

[@sontruongpham6883]

Turn out the problem is I have the old arduino esp32 version which is 1.0.6. When upgrade to 2.0.x its run normally.

[@albertobesozzi5825]

I've got the same problem but my arduino is already updated to 2.1.1

[@huanle4109]

The serial monitor just show "CAMERA OK ", it did not show "......" line. How can i fix it ?

[@anhviettran160]

Check lại tên wf và mk đúng chưa. Nếu đúng thì nó sẽ hiện ip của wf

[@jaimeabug9090]

Bro I have same issue. Have you fix you?

[@tyronetyrone2652]

How to use IP CAM instead of ESP32CMA

[@ElectroniClinic]

I will cover this in my upcoming videos.

[@CsabaDzsurnik]

Hello! It's awesome! But I get the following error on my PC: File "C:\Users\PC\Desktop\esp32\ ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing\esp32CamTest-PC.py", line 19, in net = cv2.dnn.readNetFromDarknet(modelConfig,modelWeights) cv2.error: OpenCV(4.8.0) D:\a\opencv-python\opencv-python\opencv\modules\dnn\src\darknet\darknet_io.cpp:902: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' could you help me please?

[@AkuDapi]

same case

[@orphaeel]

have you found the solution???

[@CsabaDzsurnik]

@@orphaeel unfortunately not, but I found another tutorial that works on the same principle and is flawless.

[@orphaeel]

@@CsabaDzsurnik with same model and config??? Anyways can you give me the link... really need it for my final project... TIA

[@orphaeel]

@@CsabaDzsurnik can you tell me that tutorial, please???

[@eidgames8761]

Failed to open the IP camera stream Process finished with exit code 0

[@parthimahi]

You solved this problem man! I also getting this

[@dhivyabharathy3032]

​@@parthimahi Did you solve this?

[@parthimahi]

@@dhivyabharathy3032 yes I solved

[@dhivyabharathy3032]

@@parthimahi how ?

[@parthimahi]

@@dhivyabharathy3032 where are you facing the problem?

[@panduaksoro8845]

where is the alert?

[@ElectroniClinic]

When it detects a cat and bird at the same time.

[@panduaksoro8845]

@@ElectroniClinic so the alert just like log in python app?