Target lock and tracking on FPV drone video | Autonomous Drone Object Tracking OpenCV Python

Рет қаралды 15,019

9 ай бұрын

Can my homemade object tracking code handle real FPV drone footage in real-time? Watch to find out. This is a test for a point-and-click homing system, allowing the guidance system move the drone to wherever it is needed..
[Warning: The test clips are videos that might be sensitive and objectionable to some users. Viewer discretion is advised.]
Want to see more like this? Click: / @timelapsecoder
SUBSCRIBE to see if a solo, independent amateur can replicate product features that big tech companies and the military-industrial complex take years to develop.
#drones
#objecttracking
#opencv
#computervision

Пікірлер: 70

@timelapsecoder 7 ай бұрын

Curious if I can convert these software projects into real homing drones? I'm getting there, but still saving for hardware and logistics. SUBSCRIBE to support me. Ask like-minded friends to subscribe also.

@GG-Platform 7 ай бұрын

yeap, if you live in Ukraine)

@user-ru6le7xz9w 5 ай бұрын

There are many teams in Ukraine that are interested in technology like this. We can provide you with the necessary equipment for testing and development, engineering resources that can physically implement this in iron. Ukraine needs this for its defense. If you are willing to discuss this topic in more detail, please let me know.

@artempogorelov7145 4 ай бұрын

How we can get connected ? It's looking very promissing. Please, ping me, it's would help us much.

@user-vd6dp3ph9b 4 ай бұрын

@artempogorelov7145 how can you be trusted? how do we know you are not russian ?

@timelapsecoder 4 ай бұрын

@@artempogorelov7145 Still needs a lot of work before becoming a real working software. Will keep on testing on more drone footage.

@sakshammishra8291 2 ай бұрын

I would like to develop a civilian use case for something based on this type of tracking. Sounds like an interesting concept with commercial potential

@timelapsecoder 2 ай бұрын

You can experiment with existing OpenCV trackers and some lightweight ML models for object detection. From there, you can sell drones that follow its owner, like DJI for example.

@fpvlive3346 8 ай бұрын

I see a different timing. did you speed up your video recording when the tracker activated?

@timelapsecoder 8 ай бұрын

Haven't look at this in a while but I have a timer sleep when the tracker is off so the video does not go by in a blink. So I am guessing my delay estimate (to approximate 30fps) is actually slower than the speed of the tracker processing logic, so the video looks slower when the tracker is off.

@omumbare8582 7 ай бұрын

hey can you share the code for the HUD only? i have rest of the things, just missing a good HUD

@SKM_KB Ай бұрын

You managed to program a drone with computer vision object tracking but are uncapable of drawing some green boxes on an image with opencv?

@user-fh5jo3ci7b 4 ай бұрын

1. did you develop the algorithm to track and shoot them down? Can you post the process of creating such a system, I'd love to learn. 2. Did you fly it by hand? Or is it an automated tracking flight?

@timelapsecoder 4 ай бұрын

1. just the algorithms to track. can't share, private research. can only share demo. 2. neither. these are pre-made videos. just testing the tracking on fuzzy videos. automated tracking flight can be easy or hard. if simple flight commands, easy. if rapid maneuvering, hard.

@easonzhao4941 Ай бұрын

Great job! Just wonder what initializations are done when you click on the target.

@timelapsecoder Ай бұрын

No initializations, other than maybe basic ones like approximate size of target, but even this is not that important. The algorithm has to immediately figure out what it needs. This is the 'magic sauce'. :) It does not work correctly all the time, so not so magic.

@PeterA650 5 ай бұрын

I'm actively teaching myself flight controller development from scratch. I have already developed a homing sensor for a certain application and it needs to get airborne. I can't find any other way to get it done other than designing it myself.

@timelapsecoder 5 ай бұрын

Nice. Writing PID flight control software would be a good learning project. But if you wish to avoid the trouble, would Ardupilot or similar open-source software help your situation?

@PeterA650 5 ай бұрын

@@timelapsecoder Ardupilot is designed mainly for GPS-guided waypoint navigation. There will be no GPS signal where my sensor will deploy.

@timelapsecoder 5 ай бұрын

@@PeterA650 Maybe you can find the core PID code from university labs working on indoor autonomous drones. They probably won't share their vision, path-finding and navigation algorithms, but maybe they already shared their PID.

@shakhawansalih5601 6 ай бұрын

Why not making laser guided systems ? can you do that like in rockets?

@timelapsecoder 6 ай бұрын

It should be doable in theory. Replace the camera tracker with a laser tracker, plus a lasing unit to mark targets. Beam riding is a little different.

@marchik1 6 ай бұрын

Do you have a model/discussion somewhere in github posted?

@timelapsecoder 6 ай бұрын

This is not ML-based so no models. The problem I am solving is to track anything, not just pre-trained objects.

@Vanchick87 6 ай бұрын

Hello. Tell me where to get this code? I want to experiment with this. Thank you

@SolitaryElite 5 ай бұрын

its private lol

@DmitryX 5 ай бұрын

@@SolitaryElitethis is a Ukrainian beggar

@mmaelectronics9322 4 ай бұрын

Great job my friend, can you share the code with me?

@MohammadIbrahim-tf8rd 9 ай бұрын

Great What is the tracking algorithm this time?

@timelapsecoder 9 ай бұрын

PF with some secret sauce! :)

@andreyl2705 9 ай бұрын

@@timelapsecoder can you recommend a good resource to read about it?

@timelapsecoder 9 ай бұрын

@andreyl2705 i think szeliski's computer vision book is considered very good. also forsyth's (haven't read both so don't know which one is better). i am recommending them because they are used as reference in cv classes. very math heavy though. if you just want cv concepts, i am sorry i do not know a good easy to digest resource. if you look for these online, you would also find many related links to cv lecture slides from the best cs schools. check them out and see which one is to your liking. you might understand the concept even if you gloss over the math. you can also study computational photography.

@andreyl2705 9 ай бұрын

@@timelapsecoder thank you sir, very comprehensive answer) Have a nice day.

@RobinHood-qg2xz 5 ай бұрын

hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh @@timelapsecoder

@WRDO 2 ай бұрын

Are you using goturn tracker 😊

@timelapsecoder 2 ай бұрын

no, i made my own private custom algorithm

@Dynamitry 7 ай бұрын

The next challenge is to learn a drone to precision bomb drop to a moving target and fly away to save itself.

@timelapsecoder 7 ай бұрын

Accurate free-fall physics can be hard. :) Better to have a motherdrone with mini-drones like this. The motherdrone has high-power processing capacity for target identification, selection and designation. The mini-drones would be like this, using disposable homing tech.

@devinbin 2 ай бұрын

Hello, where do you collect your materials from?

@timelapsecoder Ай бұрын

Hello, if you mean the video, same as where we find random things... the internet. :)

@withlovearoundtheworld4496 9 ай бұрын

But sometimes your tracker loss the track of the object and jump to other locations, in real world you will miss the target.

@timelapsecoder 9 ай бұрын

The tracking loss is often due to the static from transmission on these test videos. That is assuming the tracking calculation is remote. Transmission is subject to jamming. In real application, the drone will have very clear video that feds an onboard tracking system. It can still miss due to algorithm limits, but far fewer and smaller errors than the big jumps you see here. Also, I am still improving this system. :) Finally, small errors can be manually overridden. Military grade drones tend to have terminal manual adjustments to help correct final approach trajectory (see Lancet, Spike, etc.; the last second aim adjustments do not correlate with a vision system, so they must be human corrections).

@withlovearoundtheworld4496 9 ай бұрын

@@timelapsecoder also you need to handle some delays from the time you select the tracker position in the ground system and the time it update back to the drone, sometimes due to link delay it may place the tracker on the wrong position. The is solution for this problem be have buffer of frames in the memory of the drone and run from past till current time and place the tracker in the correct position.

@timelapsecoder 9 ай бұрын

@@withlovearoundtheworld4496 I am taking it further (not shown). Selecting a moving target is hard. But I can freeze the frame and select a non-moving target, then have the tracker catch up to the live frame. This of course requires a faster than FPS algorithm, which this does.

@garymyers6638 4 ай бұрын

I would like to speak with you. How may I contact you?

@phamnhuthai6847 Ай бұрын

I actually did this 12 years ago. The concept almost same with yours, But not self suicide drone.

@timelapsecoder Ай бұрын

People like to watch, and The Algorithm promotes, videos that are like this. If I track something harmless like a balloon, no one will click. Maybe I'll track a cat next.

@CJShadow82 3 ай бұрын

Є можливість поділитись кодом? Я займаюсь схожими задачами, але з ШІ моделями.

@maheshkumar_2017 4 ай бұрын

hey can we communicate?

@timelapsecoder 4 ай бұрын

only through here :)

@user-ib8se9ee2s 3 ай бұрын

Hello. Your work would be very useful to Ukraine. Would you be willing to share your code if contacted by the official representatives?

@timelapsecoder 3 ай бұрын

Working on developing this into maybe a hardware system instead of plain text code.

@sedatbahadir112 3 ай бұрын

If you are not a Russian citizen, we can do a joint project with you

@bigmoneymoneybags 17 күн бұрын

Cool project! I am wondering if you have any public code for the autonomous target tracking. Also, would it be better to run target tracking at a ground station and send the control information to the drone or can the tracking be done directly from the flight controller?

@timelapsecoder 17 күн бұрын

Thanks. Just private code. Ground station is great for better tracking computations, but video transmission might be poor sometimes.

@bigmoneymoneybags 17 күн бұрын

@@timelapsecoder Yeah the video transmission is the only issue im worried about. Thinking of using the Eachine ROTG02 so I can just use anything with a USB port for a video display.

@bigmoneymoneybags 17 күн бұрын

Well that and powering two small magnetic actuators but I might be able to use the extra esc pads or change some flight controller pads around.

@theSpicyHam 3 ай бұрын

you are ironman 0.1 lol

@timelapsecoder 3 ай бұрын

mk0.09

@timetimer6429 3 ай бұрын

Я уже написал программу, которая наводится по упреждающей метке, теперь буду стараться сделать такой дрон, для того, что бы внести свой вклад в победу над неонацизмом

@bromine_35 2 ай бұрын

This technology is of great importance to both sides This future was predicted long ago

@michaelzhehalo2330 3 ай бұрын

Its fake video

@timelapsecoder 3 ай бұрын

It's real, bro. trust me bro.

@michaelzhehalo2330 3 ай бұрын

you taking russian money to make fake videos@@timelapsecoder

@phamnhuthai6847 Ай бұрын

You’re not programmer, you won’t understand. Try to learn hello world app first

@michaelzhehalo2330 Ай бұрын

first video it's STERNENKO video(left up angle), he showed first using Target lock several days ago, before it all user controlled, including this one. It doesn't work like on video.@@phamnhuthai6847