How to do Object Detection using ESP32-CAM and Edge Impulse YOLO Model

Рет қаралды 45,699

Күн бұрын

Пікірлер: 85

@eloquentarduino5988 Ай бұрын

Glad to see your video made 10x my views in just 10 days T_T. That said, I'm happy that more people get to know my library

@Circuitdigest Ай бұрын

Hey thank you! your work is also amazing, great job!!!

@Circuitdigest Ай бұрын

I think its possible, not sure though

@tarun2145 24 күн бұрын

@@Circuitdigest hi sir, Which algorithm is this working on

@PriyankBolia Ай бұрын

Yours is the only Indian Tech Channel worth watching, all others make such basic videos, but your projects has some standard.

@financexplorer Ай бұрын

Thank you keep upgrading us

@duyhoang2615 Күн бұрын

Great project Sir. How many classifications that Esp-cam can store? Does your project have any restrictions?

@niveshshrestha7326 Ай бұрын

Gald to see Indian IT guy working also on hardware

@Tony770jr Ай бұрын

Nice video, but zoom in on the Arduino IDE text so it's easier to view on a mobile device. Thanks!

@Circuitdigest Ай бұрын

You can get all the necessary details on the project page linked in the video description.

@AVI-xo1kb Ай бұрын

Nice video 👍 gonna try it asap. Keep uploading informative videos like this.

@Circuitdigest Ай бұрын

Thank you, I will

@techfun8528 Сағат бұрын

Bro i just want to upload the code to the ESP-32 CAM through ESP 8266, so is there any other process need to be follow for that approach

@frankdearr2772 Ай бұрын

Great topic, thanks 👍

@gsk1986 7 күн бұрын

Awsome.. relevent tech

@jeremiahthompson82 Ай бұрын

Thanks. Very nice job

@chmadanmohansantosh6482 26 күн бұрын

very nice.. enjoyed

@ath_greek 20 күн бұрын

could you do a video with servos pan and tilt and esp32 cam (recognizing and tracking?)

@GergelyCsermely Ай бұрын

Thanks

@bennguyen1313 Ай бұрын

Can you do a video on how to debug an Edge/YOLO project using a JTAG debugger (ESP-Prog)?

@delfindaffa7953 Ай бұрын

For the ESP32 board, what version of the library is used?

@mr.emptygamingyt 29 күн бұрын

2.0.4

@rohitchaudhari5337 2 күн бұрын

Nice content. I follow all the same steps, but dont know why i am getting below error in verious line of codes. conv.cpp:1789:67: error: either all initializer clauses should be designated or none of them should be 1789 | .channels = input->dims->data[3], 1 | ^

@rohitchaudhari5337 2 күн бұрын

I resolved the above issue Just editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/ Disabling #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN 1 and set it to 0 will allow the project to compile ."

@ASRoBo Ай бұрын

Nice video❤ I want to on red led when onion is detected, green when potato is detected and yellow when tomato is detected, is it possible ? , if yes how can i do this ?

@Circuitdigest Ай бұрын

Yes you can activate a corresponding LED when a specific object is detected. You can check for the bb.label value and activate the LEDs accordingly.

@YigalBZ Ай бұрын

Excellent video. Thank you. Few questions: 1) do you know if the libraries included in VScode? 2) Any idea how far can such a detection work with this camera?

@Circuitdigest Ай бұрын

You can use the same library with VScode and Platform IO. the detection range would be very small since the ESP32 can only process image with lower resolution. if you increase the resolution the frame rate will be reduced drastically and the ESP32 may even crash with very high resolutions.

@muhammadNadeem-wp7vn Ай бұрын

Sir, this is my first time on this channel. Sir, I made a car detection project using Edge Impulse, but when I uploaded it to the ESP32-CAM, I encountered many initializer errors during compilation. Sir, please tell me why this happened when everything was auto-generated.

@Circuitdigest Ай бұрын

You will have to give a bit more context.

@DwiAhmadza Ай бұрын

Sir, can we use BLE 33 SENSE as programmer?

@nandhakishore8439 4 күн бұрын

sir i am using esp32 camera and the camera module they gave to code , the module have the same number of pin holes which the camera board have, i put the camera in the module and connected the module to program , but i am not getting any output nothin is getting printed in the serial moniter

@Circuitdigest 4 күн бұрын

Check the uart connection. tx pin should be connected to Rx of the uart converter and RX pin to the TX pin

@iot_enthusiast Ай бұрын

nicely done! quick clarification - @5:39 GPIO0 should be held High or Low ?

@Circuitdigest Ай бұрын

GPIO should be pulled to LOW.

@user-ls1mt4ly5c 5 күн бұрын

Either all initializer clauses should be designated or none of them should be data_dims_t filter _dims={.width=filter__width,.height=filter_height,0,0}; how to correct this error.pls guide me step by step because im the beginner of doing project this is my first project.pls help me sir..thanks in advance

@Circuitdigest 5 күн бұрын

Try editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/: and set #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN from 1 to 0

@dfastergaming3534 Ай бұрын

Building a High-Resolution POV Display using ESP3 I am making your this project in my third year Sir Can you provide me your PCB garba file in this (please sir help)🙏🙏🙏 One more question is I can use the ESP 32 inbuilt data transfer and charging pin it is work or not you can tell me 🙏🙏 👇👇👇 Building a High-Resolution POV Display using ESP32

@Circuitdigest Ай бұрын

Gerber file already on our website

@muthuselvimuthuselvi3364 8 күн бұрын

Either all initializer clauses should be designated or none of them should be data_dims_t filter _dims={.width=filter__width,.height=filter_height,0,0}; how to correct this error.

@Circuitdigest 8 күн бұрын

Try editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/: and set #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN from 1 to 0

@muthuselvimuthuselvi3364 7 күн бұрын

I didn't understand sir..I'm beginner of doing project..pls guide me step by step.. thanks in advance 🎉

@aimsinteractivepvtltd8147 Ай бұрын

Effect of ambient light on performance??

@Circuitdigest Ай бұрын

Since we are working with gray scale images lighting difference is tolerable. But if you want reliable results lighting should be maintained constant

@user-ek3kx5gn5c 22 күн бұрын

how to upgrade plan for edge impulse? I am not able to train the model for a large dataset

@Circuitdigest 22 күн бұрын

You will have to do that through the edge impulse website. The professional plan costs around 400$ per month.

@user-ls1mt4ly5c Күн бұрын

Fatal error: stdbool.h:no such file or directory 23 | # include Compilation terminated how to clear this error

@Circuitdigest Күн бұрын

Which version of ESP32 Arduino core are you using? Try using any 2.x.x.

@user-mb9tu3sh2d 17 күн бұрын

are you a malayali ?

@davidhouseago416 Ай бұрын

Can't upload camera code I get error 'Compilation error: 'ledcSetup' was not declared in this scope; did you mean 'ledc_stop'?

@Circuitdigest Ай бұрын

make sure to install Eloquent ESP32-CAM Library.

@SA-oj3bo Ай бұрын

Will the accuracy with esp32 be lower or only slower compared to a solution on RP or PC? Which Yolo model is used for this ESP32 application?

@Circuitdigest Ай бұрын

The frame rate and accuracy will definitely better on RP or PC. We selected ESP32 cam because its a low cost option

@SA-oj3bo Ай бұрын

@@Circuitdigest it is a great solution but I not understand why the same model would be less ac curate on an esp32, slower I agree, but less accurate? Sure?

@Circuitdigest Ай бұрын

@@SA-oj3bo During training the model we reduced the training cycle so as to reduce the code size and make it easy for esp32. ideally if you need better accuracy you should provide more training datasets and use high epoch but this is not feasible on a small processor like esp32. also we cannot use a better resolution camera with esp32

@PratikVyavahare-t4i 20 күн бұрын

Sir how much project cost goes

@Circuitdigest 20 күн бұрын

Hardware wis you will need an ESP32-Cam module, which will cost anywhere around 400-600 INR.

@TBS_d Ай бұрын

it says error compiling for ai thinker while uploading

@Circuitdigest Ай бұрын

You will have to be a bit more specific. what is the actual error?

@Only_for_Harbinger_hackathon Ай бұрын

hello sir, I absolutely loved your video. I have a query, pls help me look into it. Ater saving impulse, when raw features are to be generated, it is saying "Error: VipsJpeg: Invalid SOS parameters for sequential JPEG" please help sir, this is causing a major setback in my projject.

@Circuitdigest 29 күн бұрын

Either change your training images. Images taken with some phones may show this kind of error. Use the ESP32 CAM to take the training images.

@Only_for_Harbinger_hackathon 29 күн бұрын

@@CircuitdigestThankyou, I did find out that this is caused by samsung phones, as pics taken using samsung devices have some error data, resaving the image in another device or format will work.

@kittiyakuldee3102 19 күн бұрын

Hi, I tried to follow and uploaded it and it has a problem c:\Users\USER!\Documents\Arduino\libraries\test_inferencing\src\edge-impulse-sdk\tensorflow\lite\micro\kernels\depthwise_conv.cpp:1842:80: error: either all initializer clauses should be designated or none of them should be 1842 | data_dims_t filter_dims = {.width = filter_width, .height = filter_height, 0, 0}; | ^ exit status 1

@Circuitdigest 19 күн бұрын

Try editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/: and set #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN from 1 to 0

@samanthilakabanadara4788 Ай бұрын

How to get an output (when detect union.output high or low)

@mohammedrahmansherif849 Ай бұрын

check from which variable the detection is coming from, and use if condition to check the class. Finally, use digitalWrite() to perform HIGH & LOW operations. Thanks!

@Circuitdigest Ай бұрын

You can use the GPIO pins on ESP32CAM to get output based on what you detect

@jayson-o2v Ай бұрын

hi, may i know why when i uploaded the code it showed compilation error and also some In function 'TfLiteStatus tflite::{anonymous}::Prepare(TfLiteContext*, TfLiteNode*)': , either all initializer clauses should be designated or none of them should be 1789 | .channels = input->dims->data[3], 1

@Circuitdigest Ай бұрын

Make sure to follow steps exactly as in the article. If you still face the same issue try editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/: Disabling #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN 1 and set it to 0 will allow the project to compile .

@6901ben 11 күн бұрын

@@Circuitdigest this works. thanks, I had same issue

@kemaketseforkssebitiela3089 Ай бұрын

Hello everyone...is this a supervised learning

@mohammedrahmansherif849 Ай бұрын

yes

@Circuitdigest Ай бұрын

Yes this comes under supervised learning

@MohamedMusharafTEEE 19 күн бұрын

Bro after build the AI trained Model.the code is not Compiling it takes long time and they display "compilation terminated error". Please help me bro.to solve this problem.

@Circuitdigest 18 күн бұрын

Nobody can help you if you don't provide the exact error code.

@MohamedMusharafTEEE 18 күн бұрын

@@Circuitdigest c:\Users\Mohamed Mushraf\Documents\Arduino\libraries\Waste_Segregation_System-project-1_inferencing\src\edge-impulse-sdk\porting\espressif\ESP-NN\src\convolution\esp_nn_conv_s8_filter_aligned_input_padded_esp32s3.S:2: fatal error: opening dependency file C:\Users\Mohamed Mushraf\AppData\Local\Temp\arduino\sketches\D60EA5CD2FB35EF678691B1E576D39DC\libraries\Waste_Segregation_System-project-1_inferencing\edge-impulse-sdk\porting\espressif\ESP-NN\src\convolution\esp_nn_conv_s8_filter_aligned_input_padded_esp32s3.S.d: No such file or directory 2 | #if EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN && EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN_S3 compilation terminated. exit status 1 Compilation error: exit status 1

@Circuitdigest 14 күн бұрын

Why are you using ESP32 S3? which camera module are you using? For normal ESP32 camera module select the appropriate ESP32 board.

@gametube630 16 күн бұрын

Thank you for the video. I have a problem with the compiling of the code. c:\Users\start\Documents\Arduino\libraries\Antress-project-1_inferencing\src\edge-impulse-sdk\tensorflow\lite\micro\kernels\conv.cpp: In function 'void tflite::{anonymous}::EvalQuantizedPerChannel(TfLiteContext*, TfLiteNode*, const TfLiteConvParams&, const NodeData&, const TfLiteEvalTensor*, const TfLiteEvalTensor*, const TfLiteEvalTensor*, TfLiteEvalTensor Tka*)': c:\Users\start\Documents\Arduino\libraries\Antress-project-1_inferencing\src\edge-impulse-sdk\tensorflow\lite\micro\kernels\conv.cpp:1881:58: error: either all initializer clauses should be designated or none of them should be 1881 | .channels = input_depth, 1 | ^ c:\Users\start\Documents\Arduino\libraries\Antress-project-1_inferencing\src\edge-impulse-sdk\tensorflow\lite\micro\kernels\conv.cpp:1885:59: error: either all initializer clauses should be designated or none of them should be 1885 | .channels = output_depth, 1 | ^ exit status 1 Compilation error: exit status 1 It's a piece of the error. I used esp 32 cams + Arduino ide 2.3.2 + edge impulse os was shown in the video but it did not work. Also, I visited the web page and recreated all steps, but without success. Which could be a problem? Thank you for answer :)

@Circuitdigest 15 күн бұрын

What version of ESP32 Arduino core are you using? Make sure to follow steps exactly as in the article. If you still face the same issue try editing the file ei_classifier_config.h in exported Arduino library folder: /scr/edge-impulse-sdk/classifier/: Disabling #define EI_CLASSIFIER_TFLITE_ENABLE_ESP_NN 1 and set it to 0 will allow the project to compile .

@MuhammadRidho-qu9ey 18 күн бұрын

hello sir, is it not possible to have a bounding box or something similar? The point is to detect objects in real time with an ESP32 cam that has a bounding box or centeroid 😭😮‍💨