ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing

Рет қаралды 94,521

Жыл бұрын

ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification
Altium Designer: For Schematic and PCB designing
www.altium.com/yt/electronicl...
Altium 365:
www.altium.com/altium-365
Octopart, components search engine:
octopart.com/
download programming:
www.electroniclinic.com/esp32...
ESP32 Cam projects: related videos
Watch the same video in Hindi/Urdu
• ESP32 CAM with Python ...
ESP32 Cam and Arduino-based Car Parking Gate / Barrier control
• ESP32 CAM with Python ...
ESP32 Cam based Human Pose landmarks detection, security camera
• ESP32 Cam Python OpenC...
How to make IoT camera using ESP32 Cam and Telegram:
• IoT Camera using ESP32...
ESP32 Cam with ESP8266, google drive, and Google spreadsheet
• ESP32 CAM and ESP8266 ...
ESP32 CAM getting started video
• ESP32 Cam: ESP32 Camer...
ESP32 CAM DOOR LOCK CONTROL SYSTEM USING HUMAN RECOGNITION
• ESP32 Cam Face Recogni...
ESP32 CAM SEND IMAGES TO GOOGLE DRIVE
• ESP32 CAM Send Images ...
ESP32 CAM SMART IOT DOOR BELL
• ESP32 CAM Smart IoT Be...
ESP32 CAM SAVE IMAGES IN SD CARD
• ESP32 Cam save Image t...
Support me on Patreon and get access to hundreds of projects:
/ electroniclinic
Subscribe to my New KZfaq Channel, if you want to watch my videos in Hindi/Urdu
/ @letsgetstartedd
Project Description:
********************
In this video, I am going to use ESP32 Camera module with Python OpenCV Yolo V3 for object detection and Identification. I am only using ESP32 Camera module for the live video streaming whereas for the image processing I am using Yolo V3.
I will test it on three different machines and you will be amazed with the end results. First I will test it using the Raspberry Pi 4 and it has 8GB RAM. Then I will test it on Core i3 Laptop. And finally, I will test it on my MSI Intel Core i7 with Nvidia Geforce 16GB GPU and 16GB RAM. I specially purchased this laptop for video editing and image processing.
Anyway, after performing initial tests then I will share with you the final code, which can be used for the detection and identification of specific objects. Let’s say you want to send an alert message when a specific object is detected.
In my case, I send an alert message when a bird and cat are detected both at the same time. While all the other objects are totally ignored.
We have a long list of the objects that we can detect. So, after watching this video you will be able to detect all these objects at the same time or you can select one or multiple objects of your choice and this way you can build amazing image processing based projects.
********************
Amazon Purchase links:
*****************
ESP32 Camera Module
amzn.to/45yPi9D
ESP32 CAM W-BT Board
amzn.to/3N24vbY
MSI Intel Core i7 Laptop check this out.
amzn.to/42ayHpL
Other must-have Tools and Components:
ESP32 WiFi + Bluetooth Module (My recommendation), more IO pins, improved speed, and supports a Lipo Battery:
amzn.to/3v40DkE
Arduino Uno, Nano, Mega, Micro "All types of Arduino Boards":
amzn.to/3fk5OTi
Top Arduino Sensors:
amzn.to/3vZbnfM
Super Starter kit for Beginners
amzn.to/3cq56C5
Top Oscilloscopes
amzn.to/3ctF3d8
Variable Supply:
amzn.to/2PEAqE7
Digital Multimeter:
amzn.to/2QGRPg1
Top Soldering iron kits: "best"
amzn.to/39nqDtb
Top Portable drill machines:
amzn.to/3suQMh7
Jumper Wires:
amzn.to/2NYPEDA
3D printers:
amzn.to/3ruG1dt
CNC Machines:
amzn.to/3cuZWVv
DISCLAIMER: This video and description contain affiliate links, which means that if you click on one of the product links, I will receive a small commission. This helps support the channel and allows me to continue to make videos like this. Thank you for your support!
****************
For more Projects and tutorials visit my Websites
Electronic Clinic:
www.electroniclinic.com/
Programming Digest:
programmingdigest.com/
Follow me on Instagram:
/ electroniclinic
Follow my Facebook Page Electronic Clinic:
web. profile.php?...
Follow my Facebook Group, Arduino Projects:
/ 190031841821771
Email:
stu_engineering@yahoo.com
About the Electronic Clinic:
Electronic Clinic helps the students and other professionals to learn electronics, designing, and programming. Electronic Clinic has tutorials on Arduino, Arduino Nano, Raspberry PI, image processing, gsm based projects, Bluetooth based projects, esp8266 projects, Nodemcu projects, robotics, desktop application designing and programming, PLC, SCADA, RC Planes, Electronics, Power Generation, HMI, and much more. Check my Playlists.
#esp32cam #yolov3 #opencvpython

Пікірлер: 106

@ElectroniClinic 9 ай бұрын

Watch my Latest Video on ESP32 Cam, Python, OpenCV, & Mediapipe based Diy Security Camera using Human Pose Landmarks kzfaq.info/get/bejne/prtyrKyQmtnFgqc.html

@ackj9766 8 ай бұрын

what is you esp32 board version camear ip didnt appear

@jerroldleung8065 4 ай бұрын

hello, I have a problem with detection. The Detection window pops up but stays black. There is a live transmission window, this works well.

@shivaraghav2899 Жыл бұрын

Mind blowing.... Super project

@muhammadsalem9924 10 ай бұрын

Thank you, professor Excellent work

@benj5279 Жыл бұрын

You really help me a lot with your videos i hope i can support you somehow ❤️

@ElectroniClinic Жыл бұрын

you can support me and my channel by subscribing, or liking the videos, and comments. And by sharing videos with your friends. Today, i will upload a new video about car tracking and gate/barrier control system. I hope you will like the idea.

@vedmaheshkale5943 6 ай бұрын

your cat is cute!!!!!!!!! 🐈

@muhammadhamza6536 3 ай бұрын

amazing really helpful

@wdew1927 11 ай бұрын

Very nice subject ! During compiling a message "cannot find webserver.h". My board version is 2.0.10 Do you have a solution for this ?

@sam-el 11 ай бұрын

I want to ask. Can you help me with a guide to create object detection using de1-soc

@Radar131 4 ай бұрын

Want request may you make video about helmet and plate number detection ?

@deeptanshugupta4241 4 ай бұрын

Is it possible to do this without connecting it to pc

@user-fq6yi5fu3f 9 ай бұрын

ERROR: Could not find a version that satisfies the requirement open-cv-python--4.5.3.56 (from versions: none) ERROR: No matching distribution found for open-cv-python--4.5.3.56 in cmd 2nd step installing open cv

@Shykidss 8 ай бұрын

Does it work with Yolo nas

@manishuike3830 9 ай бұрын

can you make one for nut and bolt identifying

@CharlesMashava 9 ай бұрын

I watch your videos.I find them very helpful for my own going project. However i am running the an application with same weights but its supper slow on detecting and sending information to the esp32. How can i optimize it to be fast??

@glennimmanuel9338 6 ай бұрын

maybe you can try to use freeRTOS to manage the tasks

@user-ds3zg5xs7i 3 ай бұрын

how do i incorporate the same for yolo v8 model?

@parthimahi 4 ай бұрын

6:41 for its coming for me "camera fails"what should I do plse anyone suggest me

@bberil4834 7 ай бұрын

Thank you for the video. I want to do the exact same project but I will use the ESP32 as a soft access point. How should I modify the code?

@aneshk425 4 ай бұрын

You got any solution bro?..even am looking for the same thing

@chideraagbasiere7868 3 ай бұрын

Where did the "Cat and Bird Detection" file come from @3:39 ?

@nagababumarthi1942 5 ай бұрын

Pls make esp32 cam based pick and place robot

@vuthanhbinh9632 23 күн бұрын

Is there a way to improve the FPS of Espcam?

@orphaeel 6 ай бұрын

i have this problem... cv2.error: OpenCV(4.5.3) C:\Users unneradmin\AppData\Local\Temp\pip-req-build-sn_xpupm\opencv\modules\dnn\src\darknet\darknet_io.cpp:900: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' anyone have the solution for this problem???

@user-zm7qi7et3r 6 ай бұрын

why did you do the image processing and objec detection on Raspberry Pi or Laptop, can't it be done on the ESP32?

@sanakabanerjee4462 3 ай бұрын

esp32 has very less ram and is only good for capturing image, it can no way run such a heavy model

@unik8985 3 ай бұрын

Hi, I've done everything right and have the live camera working but whenever I try to run the object detection code it gives me an error where: outputNames = [layernames[i[0]-1] for i in net.getUnconnectedOutLayers()] ~^^^ IndexError: invalid index to scalar variable. and I can't seem to fix it

@jacobguttman4617 2 күн бұрын

Try to get rid of the [0], it worked for me, just [layernames[i-1].....also comment : for i in indices: # i = i[0]

@user-fy3bh8ie2v 9 ай бұрын

Hi, I want to make something similar, but instead of object detection, I want to make face detection system using esp32cam which will be used for storing student attendance, can you please help or provide some reference related to this.

@ElectroniClinic 9 ай бұрын

for this you will need to train faces. I am working on a similar project. Its object the identification of other objects not available in the coco.names list.

@vikasreddy4864 9 ай бұрын

Does object detection works for similar objects ? Does object detection works for identification of safflower stigma from saffron stigma?

@Shykidss 8 ай бұрын

You can train custom dataset to the model

@haven-hw2wl 9 ай бұрын

Hi sir your project is awesome, but when i try all of your instructions im having a problem with coco.names even if it's in the same folder but always displaying error that no coco.names found 😢

@aymanmrwan2410 9 ай бұрын

Yes me too

@haven-hw2wl 9 ай бұрын

@@aymanmrwan2410 bro i already did it, just use different format not notepad

@kris8167 8 ай бұрын

@@haven-hw2wl Then I would like to ask what format you use, thank you.

@muhammadsalem9924 10 ай бұрын

Please tell me what are the appropriate computer specifications for deep learning and machine learning ? Please answer

@harshwardhansingh9915 5 ай бұрын

Any computer with a GPU will work fine. But if you don't have that, you only need an internet connection. There are online tools like Google Collab that will provide you with an online jupyter notebook free of charge, you can use it for learning machine learning

@didzi6728 Жыл бұрын

Hey. When I try to run the code in Python IDLE I get this error: "Failed to open the IP camera stream". While if I copy and past the camera's url in the web browser it works fine! Any ideas on how to fix it?

@dhivyabharathy3032 2 ай бұрын

Me too

@dhivyabharathy3032 2 ай бұрын

Do you fix it?

@didzi6728 2 ай бұрын

@@dhivyabharathy3032 Not really, I switched to Raspi cameras

@joaogouveia4497 3 ай бұрын

im trying to do the same thing the only diference is that im using an esp32s3 camera that creates a webserver for the video but when i try to access the webserver ip my opencv crashes. Do you know what could have caused this?

@MonkeyNeuronActivation 2 ай бұрын

Been running into similar problem. Do you see your IP in serial monitor? I had it when I tried it some time ago, and now I can't get my IP built

@Jarniwan 9 ай бұрын

you should have at least tell us if the middle part was a sponsor segment. that was awful.

@benj5279 Жыл бұрын

Can this work if laptop and esp32 are connected to different wifi?

@manojshyaam6683 11 ай бұрын

Yes it does

@juantellez2176 8 ай бұрын

would this work with a pretraining yolov8?

@user-ds3zg5xs7i 3 ай бұрын

did you try it out?

@rockstarsk4023 7 ай бұрын

where is the main program file??

@user-ul2em8lv3v 9 ай бұрын

does this process can be run on raspberrypie without a computer after starting the process? i want make this for blind people which they can carry with them?

@ElectroniClinic 9 ай бұрын

Ya you can use use raspberry pi

@digitronix532 4 ай бұрын

If my camera senses "Car" , any one of gpio should turn on in ESP32CAM . Help me

@ElectroniClinic 4 ай бұрын

I have done it. Check playlist or the related projects list in the description.

@waleedhussain4409 Жыл бұрын

can you please give the code for alert as an email or for arduino using gsm that you tell in last part of video it would e very helpul if you give code for it

@manojshyaam6683 11 ай бұрын

Search for SMTP protocol for ESP 32 Best wishes

@janarthanandayalan 5 ай бұрын

Hi sir, is there a way we can give our very own data to train the camera?

@ElectroniClinic 5 ай бұрын

Very soon I will make a video about this.

@WackAnimations 14 күн бұрын

@@ElectroniClinichave you made it yet?

@avifavif3939 19 күн бұрын

I need your help, i have a project. The project is whe the detection image is succes the next step i want to make esp32cam give command to spray some plant? How to make the command?

@ElectroniClinic 18 күн бұрын

Use the if condition to turn ON/OFF a relay.

@avifavif3939 18 күн бұрын

@@ElectroniClinic can i get your contact to ask more?

@benj5279 Жыл бұрын

What do you use to run the python code?

@benj5279 Жыл бұрын

Nvm i figured it out

@juantellez2176 8 ай бұрын

I havent figured out what did u use to run python?

@Mmorpg347 5 ай бұрын

When I open the serial monitor it shows me to write a message how can I fix this

@parthimahi 5 ай бұрын

Press reset button

@palindrome3212 Жыл бұрын

i have this error in line 71 saying: outputNames = [layernames[i[0] - 1] for i in net.getUnconnectedOutLayers()] IndexError: invalid index to scalar variable. Can you help me with the error?

@BuddhiniJayakody Жыл бұрын

did you fix the issue? I also get the same issue

@auburngold4958 11 ай бұрын

Fixed the issue, just remove the [0] and run the program. This only works on windows

@attacker21 8 ай бұрын

@@auburngold4958 thanks a lot

@tyronetyrone2652 Жыл бұрын

How to use IP CAM instead of ESP32CMA

@ElectroniClinic Жыл бұрын

I will cover this in my upcoming videos.

@sontruongpham6883 Жыл бұрын

Your guide is very helpful. But I got this error in line 30 of esp32cam.cpp file while compile the esp32camera test code: error: 'camera_sensor_info_t' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'esp_camera_sensor_get_info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); Could you help me? Thanks.

@sontruongpham6883 Жыл бұрын

Turn out the problem is I have the old arduino esp32 version which is 1.0.6. When upgrade to 2.0.x its run normally.

@albertobesozzi5825 11 ай бұрын

I've got the same problem but my arduino is already updated to 2.1.1

@CsabaDzsurnik 11 ай бұрын

Hello! It's awesome! But I get the following error on my PC: File "C:\Users\PC\Desktop\esp32\ ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing\esp32CamTest-PC.py", line 19, in net = cv2.dnn.readNetFromDarknet(modelConfig,modelWeights) cv2.error: OpenCV(4.8.0) D:\a\opencv-python\opencv-python\opencv\modules\dnn\src\darknet\darknet_io.cpp:902: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' could you help me please?

@AkuDapi 9 ай бұрын

same case

@orphaeel 6 ай бұрын

have you found the solution???

@CsabaDzsurnik 6 ай бұрын

@@orphaeel unfortunately not, but I found another tutorial that works on the same principle and is flawless.

@orphaeel 6 ай бұрын

@@CsabaDzsurnik with same model and config??? Anyways can you give me the link... really need it for my final project... TIA

@orphaeel 6 ай бұрын

@@CsabaDzsurnik can you tell me that tutorial, please???

@huanle4109 3 ай бұрын

The serial monitor just show "CAMERA OK ", it did not show "......" line. How can i fix it ?

@anhviettran160 3 ай бұрын

Check lại tên wf và mk đúng chưa. Nếu đúng thì nó sẽ hiện ip của wf

@jaimeabug9090 3 ай бұрын

Bro I have same issue. Have you fix you?

@panduaksoro8845 10 ай бұрын

where is the alert?

@ElectroniClinic 10 ай бұрын

When it detects a cat and bird at the same time.

@panduaksoro8845 10 ай бұрын

@@ElectroniClinic so the alert just like log in python app?

@eidgames8761 9 ай бұрын

Failed to open the IP camera stream Process finished with exit code 0

@parthimahi 4 ай бұрын

You solved this problem man! I also getting this

@dhivyabharathy3032 2 ай бұрын

@@parthimahi Did you solve this?

@parthimahi 2 ай бұрын

@@dhivyabharathy3032 yes I solved

@dhivyabharathy3032 2 ай бұрын

@@parthimahi how ?

@parthimahi 2 ай бұрын

@@dhivyabharathy3032 where are you facing the problem?

@PraveenKumar-vz4dy 3 ай бұрын

8:10 we can't do image processing in esp32 cam (not enough computational power ) is this what u r trying to say ?

@urnoob5528 Ай бұрын

bro doesnt know that intel cpu has generations

@user-cc5cj2ty7y 2 ай бұрын

What should be the specification of camera for image detection or image processing into camera and then send only a small amount of data such as number of people passed through it etc to the network ?? Please help...🙂