Making a Drone Smarter With Motion Planning

  Рет қаралды 74,452

Nicholas Rehm

Nicholas Rehm

Күн бұрын

This fully autonomous drone has an onboard computer ‘brain’, camera ‘eyes’, and an algorithm that generates the fastest path around unknown obstacles as they’re detected mid-flight. Everything is computed onboard with no need for a radio connection to the ground, making it completely immune to jamming.
Patreon: / nicholasrehm
Check out my Cycloidal Rotor Drone: • Cycloidal Rotor Drone:...
Build your own VTOL F-35: • Making an INSANE Hover...
GPS-denied, vision-based autonomy is a very popular topic in robotics right now. Most importantly: once you know where you are, how do you most efficiently navigate around the environment without bumping into things? Variations of Dijkstra’s algorithm such as A* or D* Lite can be used to quickly and efficiently calculate the optimal path over ‘nodes’, or potential waypoints. This is the same general algorithm used in google maps to find the fastest route through traffic. Putting all of this together on a flying drone took a bit of specialized hardware, some help from Robot Operating System (ROS), and a whole lot of testing. Yes, there are pre-existing packages for pretty much every feature I implemented, but where's the fun in using someone else's code? If you learned something, I’d greatly appreciate a like on this video and maybe even a subscription to my channel for more projects like this in the future.
00:00 Intro
00:56 How Waypoint Autonomy Works
03:00 Hardware Overview
04:38 Position Control Demo
06:37 Motion Planning 101
07:23 Dijkstra’s algorithm, A*, and D* Lite
09:16 Obstacle Detection
09:47 Complete Demo
12:08 Conclusions
#Drone #MotionPlanning #Autonomy

Пікірлер: 240
@NicholasRehm
@NicholasRehm 2 жыл бұрын
On a scale of “horribly underwhelming” to “ehh it’s alright,” how did you like this project?
@spaceshuttle8332
@spaceshuttle8332 2 жыл бұрын
This is honestly amazing. Your projects are really inspiring! I’ve been working on a little flight controller using an Arduino Nano for a fixed wing configuration; nothing anywhere near close to what you have done, but your videos and tutorials have served as inspiration and guidance. Speaking of fixed wing, do you think this could be integrated into that type of configuration to do something like auto landing? I also noticed that you only have an IMU on the Teensy flight controller, but would it help the controller if you had, say something like a BMP 280 and an HMC5883 for both altitude and heading? (I could be wrong but didn’t see any other sensors in the footage). Thank you for sharing your projects! Not only are they amazing, they’re also inspiring. Keep them coming!
@whizadree
@whizadree 2 жыл бұрын
Wish you could do it without markers so be able to say oh it's a person, tree , truck ect, then test it on real world objects in motion
@NicholasRehm
@NicholasRehm 2 жыл бұрын
@@spaceshuttle8332 Thanks so much, and best of luck on your project! I love the idea of auto landing a plane…
@NicholasRehm
@NicholasRehm 2 жыл бұрын
@@whizadree Replacing my ‘cheaty’ April tag tracking with some sort of machine learning model would absolutely be the next step, and would be a straightforward drop-in replacement
@robelefrem9734
@robelefrem9734 2 жыл бұрын
I wonder how difficult it would be to package an obstacle avoidance and planning system like this to work directly with ardupilot. If it could somehow update mission nodes on the fly like this it could be used with multiple different platforms in an easy and accessible way to retrofit mission planning and optimization to your diy project. Not to mention to be able to take full advantage of the capabilities of ardupilot in addition. Awesome vid man
@iforce2d
@iforce2d 2 жыл бұрын
Great stuff! The forced 'long way around' test was awesome!!
@goobisoft4873
@goobisoft4873 2 жыл бұрын
I was thinking of u when watching this video where u havee been i hope everything is ok👍
@TomPittenger
@TomPittenger 2 жыл бұрын
Fun Fact: ArduPilot runs Dijkstra's algorithm and another path planner in realtime. It uses a variety of inputs like multiple lidar/sonars, pre-programmed polygons (like trees and buildings), or other dynamically moving aircraft such as ADSB and/or other drones on the same network.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Interesting, I knew they used dijkstra’s for planning around a pre-defined weirdly-shaped fence, but have not seen any of the capabilities for dynamic/injected obstacles. Will have to look into it more. Thanks!
@luisvale
@luisvale 2 жыл бұрын
@@NicholasRehm Back in 2018 dynamic planning of paths and avoiding dynamic obstacles was already used and shown. I remembered this demo @Tom Pittenger kzfaq.info/get/bejne/jK6Vd69pms-7lH0.html
@rishabhsingh5488
@rishabhsingh5488 2 жыл бұрын
Apart from Path Planning, (we call our Algorithm BendyRuler, that does dynamic obstacle avoidance), we also support 3-D obstacle avoidance in manual modes: kzfaq.info/get/bejne/Y5yAiqVml7CXmKM.html
@ITpanda
@ITpanda 2 жыл бұрын
Autopilot drone races would be an interesting competition, maybe you can host an event? Maybe of course that has constantly changing obstacles, with a flight ceiling that would disqualify those that flew above it more than a number of times (1-3). Would bring nerdy back into drone racing, well encouraging the improvement/evolution of flight controllers.
@epicdaniel508
@epicdaniel508 2 жыл бұрын
5:55 That's what Blue Origin said! Great video!
@TurpInTexas
@TurpInTexas 2 жыл бұрын
I was planning on doing something like this in my quest to build a smarter robotic mower, but you just blew my mind doing it with a drone! Lol!
@sang84119
@sang84119 2 жыл бұрын
This blew my mind, it's truly DIY legendary. I'm new with Drone,ROS,... I'm starting to learn this stuffs all of your projects inspired me a lot
@Paranalense
@Paranalense 2 жыл бұрын
Very well planned and executed, thanks for sharing. Greetings from Chile... ...and the Mythbusters poster in the end... Subscribed!
@muessliemix
@muessliemix 2 жыл бұрын
Amazing project and explanation! Keep the good work coming. 👍🏻 You earned yourself a new subscriber right there! 😉
@poporbit2432
@poporbit2432 2 жыл бұрын
Great development. Thanks for sharing.
@LuigiDaMonster
@LuigiDaMonster Жыл бұрын
This is all very interesting. I'm very grateful to have came across this channel. Please keep up the great work and content. Thanks for sharing. Thumbs up!! 👍
@n0t_UN_Owen
@n0t_UN_Owen 2 жыл бұрын
Engineers really love to mess with stuff that can be revolutionized during their free time
@williamgillespie4459
@williamgillespie4459 2 жыл бұрын
I caught a few of the Extremely subtle hints to subscribe, and did so. Thanks for the good content.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Glad my subliminal messaging worked lol
@gordon1201
@gordon1201 2 жыл бұрын
This is so cool. Very well explained
@Knutahh
@Knutahh 2 жыл бұрын
Damn dude. Really interesting and mindblowing stuff. Subscribed! :)
@lundebc
@lundebc 2 жыл бұрын
Very nice explanation on how it works. Just getting into this topic area and will go back through this video to get more details on your implementation. I want to do something similar to my r/c lawn-mower and considering ardurover, but this approach combined with path planning/obstacle avoidance would be a very good approach.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
I’d recommend a hybrid approach where you keep ardurover for basically everything, and supplement it with a companion computer to send it new waypoints/desired state data over mavlink in something like guided mode
@MrMaufera
@MrMaufera 2 жыл бұрын
Cyclo drone i loved
@antoninperbosc1532
@antoninperbosc1532 2 жыл бұрын
Great work !
@ThereAreNoHandlesLeft
@ThereAreNoHandlesLeft 2 жыл бұрын
This is so deeply nerdy and even with your excellent assistance remained over my head in a GREAT way. Being over my head gives me something to reach for. Great video, even more detail in the coding process would be cool. I love it.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Really appreciate it, I’ll try to find better ways in the future to make the coding bits less boring and include more of that
@ThereAreNoHandlesLeft
@ThereAreNoHandlesLeft 2 жыл бұрын
@@NicholasRehm You do you man. Don't worry about the algorithm or us. Make what makes you happy. We're happy to get to share it
@moisesaragon4008
@moisesaragon4008 2 жыл бұрын
you are a genius, greetings from spain
@yevhenmikhalov2258
@yevhenmikhalov2258 Жыл бұрын
that was amaising, thanks!
@JohnMatthew1
@JohnMatthew1 Жыл бұрын
WOW, keep up the great work!
@f_2476
@f_2476 2 жыл бұрын
Wow what a great video with simple explanations great work buddy you deserve millions subscribers, highly recommending your channel and I actually enjoying watching your clips with fruitful info's.. .. Thanks appreciated 👍👍👍
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Thanks so much for the kind words. You're exactly the type of person I try to make videos for
@moochasas
@moochasas 3 ай бұрын
That is an awesome project..... well done..
@robmulally
@robmulally 2 жыл бұрын
Great video, and here I was happy to have a quad running inav rth haha
@livinginthegardenhouse9755
@livinginthegardenhouse9755 2 жыл бұрын
This Channel will grow massively
@Blubb3rbub
@Blubb3rbub Жыл бұрын
Watching this made me remember the "Kalman filter" I heard about some time ago that allows to combine accelerator and GPS data to improve the accuracy of the "current position estimation". You could probably do something similar by having some of these tags placed at fixed known positions, so the drone can "realign" its position without relying on GPS data.
@NicholasRehm
@NicholasRehm Жыл бұрын
Yup, factory robots use these a lot in warehouses to correct for drift in the kalman state estimate, since the tags are always in known position
@ohitstarik
@ohitstarik 2 жыл бұрын
2:30 "the drone knows where it is at all times 🧐🧐"
@NicholasRehm
@NicholasRehm 2 жыл бұрын
By knowing where it isn’t
@AERR_FPV
@AERR_FPV 2 жыл бұрын
Love it
@davehayes8812
@davehayes8812 2 жыл бұрын
Brilliant.
@oliverer3
@oliverer3 Жыл бұрын
This is so cool! I've been trying to do stuff like this but I've yet to gather all the software-related knowledge to achieve things like this.
@TechMalaya
@TechMalaya 2 жыл бұрын
nice bro
@Jp_Robotics
@Jp_Robotics 2 жыл бұрын
Awesome ❣️🔥
@manjunathayr9348
@manjunathayr9348 2 жыл бұрын
It's pretty darn cool really really
@MeepMu
@MeepMu 2 жыл бұрын
Immensely complex and high risk :)
@ayuschmannov2461
@ayuschmannov2461 Жыл бұрын
Lovely lovely
@erolrecep
@erolrecep 2 жыл бұрын
It's an awesome project! Great job! Thanks for sharing with us.
@user-ur5ly3nb9i
@user-ur5ly3nb9i 2 жыл бұрын
Love you man ❤️😘
@dcslab
@dcslab Жыл бұрын
Amazing
@theK8pTn-G
@theK8pTn-G Жыл бұрын
Legendary effort! Very VERY cool! A great production! Remember watching Terminator as a kid? I think this was just as exciting. :D :D :D Bravo!!!!!!!! Well done!!!!!!
@wearemany73
@wearemany73 2 жыл бұрын
Make sure your collar’s straight the next time you do anything like this again. 😉 Great video with a clear explanation of technical data, sweet video. I’m eager to know where this goes. 😊
@zephyrandboreas
@zephyrandboreas 2 жыл бұрын
Not an engineer, but it is awesome and really well explained. I definitely learned something interesting 😀
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Glad to hear it!
@matthewallen3375
@matthewallen3375 Жыл бұрын
Its a good level of weeds for me. well done video.
@drewskiakg2719
@drewskiakg2719 Жыл бұрын
Wow! Great video. Are you using machine learning, computer vision to recognize an object or a person? You can make a legit drone home security system. All you need is a wireless landing pad haha. Can't wait for your other videos. Thank again!
@Aaron_b_c
@Aaron_b_c Жыл бұрын
I love that you set up a full desktop outside rather than just dinking around on a laptop.
@thomaslincoln401
@thomaslincoln401 Жыл бұрын
Eh it's alright! Just recently found this channel and going to give some of this stuff a try!
@iAkashPaul
@iAkashPaul Жыл бұрын
Andrew Barry (Boston Dynamics, MIT) had created Pushbroom Stereo like 7/8 years ago, now it should be quite feasible without 120FPS cameras or stereo pair since we have decent monocular depth estimation sorted!
@alienbeef0421
@alienbeef0421 11 ай бұрын
2:16 The missile knows where it is at all times
@yeshassudharshan8791
@yeshassudharshan8791 2 ай бұрын
Thank you for demonstrating yet again that engineers can do anything . Also could you point to resources and courses(if any) as to where to learn more about ROS, computer vision or basically how to make drones smart.
@NicholasRehm
@NicholasRehm 2 ай бұрын
This is the class I took, all lectures and course material is free and open source: pear.wpi.edu/teaching/rbe595/fall2023.html I even gave a guest lecture last semester :)
@chutidoni974
@chutidoni974 Жыл бұрын
Congratulation. 💫💫🔥🔥🔥🔥
@adekunleafolabi1040
@adekunleafolabi1040 2 жыл бұрын
This is exactly what my partner and I are working on for our final year project.
@__FJ__
@__FJ__ 2 жыл бұрын
Hi! That was entertaining and very interesting. Thank you for making this video. I should put this on my pretty dumb “robotic” lawn mower.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
I have definitely thought of doing an automated lawnmower, haha. Thanks for the comment
@PuceBaboon
@PuceBaboon 2 жыл бұрын
@@NicholasRehm Then you have to deal with the "negative" obstacles, too (I have a cliff-like drop off on two sides of my field). Time for a "It's the end of the world as we know it" algo. :-)
@LeRainbow
@LeRainbow Жыл бұрын
I find it insane how you made your own FC ... code and all.
@phpn99
@phpn99 2 ай бұрын
The NASA team that wrote the motion planning software for the autonomous Mars Rover, used the A* algorithm.
@8bithavok
@8bithavok Жыл бұрын
The drone knows where it is at all times. It knows this because it knows where it isn't. By subtracting where it is from where it isn't, or where it isn't from where it is, whichever is greater, it obtains a difference, or deviation. The guidance subsystem uses deviations to generate corrective commands to drive the drone from a position where it is to a position where it isn't and, arriving at a position where it wasn't, it now is. Consequently, the position where it is, is now the position that it wasn't, and it follows that the position that it was is now the position that it isn't. In the event that the position that it is in is not the position that it wasn't, the system has acquired a variation; the variation being the difference between where the drone is and where it isn't. If variation is considered to be a significant factor, it, too, may be corrected by the GPS. However, the drone must also know where it was. The drone guidance computer scenario works as follows: because a variation has modified some of the information the drone has obtained, it is not sure just where it is, however it is sure where it isn't, within reason, and it knows where it was. It now subtracts where it should be from where it wasn't, or vice versa. And by differentiating this from the algebraic sum of where it shouldn't be and where it was, it is able to obtain the deviation and its variation, which is called error.
@NicholasRehm
@NicholasRehm Жыл бұрын
AMEN
@Wulfle
@Wulfle Жыл бұрын
The drone knows where it is at all times. It knows this because it knows where it isn't.
@hubba002123
@hubba002123 4 ай бұрын
Very cool work. I've been thinking about doing something like this for fun/hobby. How are you controlling the quad from your computer? I've been trying to figure out this simple first step. Do you add wifi or something to your teensy? Or, are you broadcasting a signal directly to your quad receiver like your computer is a transmitter? The computer transmitting directly to the quad receiver is what I've been trying to figure out.
@kiphaynes
@kiphaynes 2 жыл бұрын
Nice job! I am working on something very similar. May I ask a couple of questions? Are you sending position setpoints, velocity setpoints, or acceleration setpoints? Or a combination thereof? Are you using a downward facing optical flow connected directly to the px4? Are you using the px4 EKF2 estimator? Are you generating a map of the space that is stored for later, maybe using something like rtab_map?
@NicholasRehm
@NicholasRehm 2 жыл бұрын
The quad is stabilized at desired angle setpoints using my opensource teensy-based flight controller dRehmFlight VTOL. The pi is sending angle setpoint commands based on position feedback from the realsense camera and a cascaded PID controller I wrote. The px4flow sensor you saw on the underside is unused for this project; I was experimenting with my own visual-inertial odometry implementation before just settling on the realsense camera for odometry. No px4 or other pre-existing packages were used for this project other than the apriltag tracker which was a ROS package I borrowed. Best of luck with your project!
@CBJamo
@CBJamo 2 жыл бұрын
Excellent project, I love seeing people using ros. You should give ros2 a try, the architecture is substantially more robust. On to the questions: What was the load like on the pi? Why two cameras? You mentioned moving away from the april tags to optical object detection. Have you considered using the depth data from the realsense instead of optical? What is the battery connector on post at the back for?
@NicholasRehm
@NicholasRehm 2 жыл бұрын
1. About 60% cpu load, mostly from the usb camera driver/AprilTag tracking 2. The realsense camera is super wide angle and relatively low resolution, so its hard to remove image distortion for tracking algorithms to use. So it ended up just being easier to throw on a cheap HD usb camera for the target tracking 3. I don't know what a more robust obstacle detection scheme would look like at the moment, but it definitely could leverage the realsense data! 4. This quad was initially built a while back for a competition which required a disarming key X inches away from the propellers. That connector just completes the connection between the ESCs and propulsion battery with a shorted XT-60 connector
@shahnejad313
@shahnejad313 Жыл бұрын
I just stumbled on this video. I am very impressed with your demonstration of DIY drone autonomous flight pattern. I am looking for similar drone navigation system without the use of GPS. I am planning to scan a cell tower using a cylenderical coordinate system using 4 ground targets as a mean to position the drone on a cylindrical grid and collect RF signals. The position accuracy could be in mm. How would you go about doing such a design? Please send your contact info. Thanks
@ChadKovac
@ChadKovac Жыл бұрын
I'm attracted to he idea of having a quad flying through my woods doing my patrol for me. ;)
@Larock-wu1uu
@Larock-wu1uu 2 жыл бұрын
Great video! thanks a lot for sharing this with us :-) Are you still using your custom flight software dRhemFlight? I am using it as well in a VTOL project. How do you plan to integrate with currently available path planning software? Will you for example implement a MAVLink communication or will you eventually switch to PX4 / Ardupilot? Your firmware is great to get started as it is intuitive, but I realized that it has some limitations when it comes to interfacing with some of the opensource software out there. Do you plan to switch firmware, do you re-implement your own path planning / ground station software or do you aim to make your firmware compatible with current software? What is your take on that? I find it very difficult to decide which direction to go. Reimplementing stuff is great if you want to learn how things work, on the other hand using available software as much as possible accelerates the development. Thanks a ton for your answer.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Yea, dRehmFlight for the inner loop stabilization but none of the autonomy. All of that was done on the pi in ROS and was also all custom. I think dRehmFlight is going to stay just about what it is in its current state so it can stay more of a teaching/learning tool and less of a competitor in the heavily developed autopilot market. The beauty of it in my opinion is just how fast you can splice in some simple code to get custom functionality, but of course the drawback is the lack of heavily developed features like autonomy or immediate compatibility with other systems
@marwinthedja5450
@marwinthedja5450 2 жыл бұрын
Graph theory? Subbed!
@NicholasRehm
@NicholasRehm 2 жыл бұрын
hell yea
@overloader7900
@overloader7900 5 ай бұрын
2:15 The missile always knows where it is...
@rigbyb
@rigbyb 21 күн бұрын
So fucking cool. Nice job
@Dustmadeout
@Dustmadeout Жыл бұрын
Hi Nicholas! Would be cool if you'd implement UWB navigation in one of your future indoor navigation projects. Check it out, it's a real radar, so you might like it.
@wingknots8516
@wingknots8516 Жыл бұрын
An important tech that should be utilised more often in custom designs when GPS lock is obstructed
@jdragon8184
@jdragon8184 Жыл бұрын
hey i just learned control system and state space , was wondering on how will i feed refernce path so that my mpc can make uav follow it
@moodberry
@moodberry Жыл бұрын
Good smarts shown in your project, but I have a basic question. Why are you using the optical sensor instead of, say, a front facing Lidar sensor, so that essentially you could maneuver in dark spaces. It looks like you could only fly this in daylight.
@boiboi505
@boiboi505 Жыл бұрын
The drone knows where it is at all times, by knowing where it isn't.
@bbqotpewi
@bbqotpewi 2 жыл бұрын
What are you doing in switzerland? (1:22) btw, very helpful video, I'm planning to do something similar soon
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Default SITL location haha
@STPromosMusic
@STPromosMusic 2 жыл бұрын
I beg you, build Justin Capra's YR-VVI, that should mean you no longer need a propeller, I'd love to see a thing like that fly, even if in model version. If there's one person who can do it, it's you. Although it won't stop me from trying it myself in the future with my basic RC planes and drones building experience XD
@bodybychiken
@bodybychiken 2 жыл бұрын
Is there any way to get a part list, or step by step guide?
@pshishiraithal6623
@pshishiraithal6623 2 ай бұрын
may I know where I can find the circuit schematics ,code etc for this project , it would be really helpful for me
@galileo1836
@galileo1836 10 ай бұрын
what are the applications that you are using the test your drones
@rickygoings4823
@rickygoings4823 4 ай бұрын
lol I love this guy
@RameshPatel-hu6lr
@RameshPatel-hu6lr 6 ай бұрын
Firstly I have love the hardwork for this video. Do you have any blog or document on this. I'm collage student & I want to build exactly the same with ros2 and jetson. And thats my dream 😅. I need some guidence pls.
@NicholasRehm
@NicholasRehm 6 ай бұрын
If you shoot me an email I can send you a paper from this project
@bhavyachhabra1600
@bhavyachhabra1600 Жыл бұрын
Hi, great video! What softwares have you used in this video??
@NicholasRehm
@NicholasRehm Жыл бұрын
DRehmFlight and ROS
@fahrulrputra2589
@fahrulrputra2589 Жыл бұрын
Very nice video, but how much is the rate of both apriltag detector and dijkstra algorithm ? Considering it's very computational heavy
@NicholasRehm
@NicholasRehm Жыл бұрын
About 10 hz on both of them
@omarramadan5185
@omarramadan5185 Жыл бұрын
Amazing project and video! Very clear explanation on how you drone roughly works I do have a question though that you may have possibly answered throughout the video but it seems like I missed it. At 11:45, why did the drone backtrack and took the longer path to the right of the obstacles rather than going left from the left most obstacle? is it because we predefined the area at which nodes and edges can exist?
@NicholasRehm
@NicholasRehm Жыл бұрын
Correct, the grid overlay showed viable nodes/edges that it could plan over, which was just an arbitrary rectangle within my backyard (with margin so I wouldn’t hit the tree!)
@omarramadan5185
@omarramadan5185 Жыл бұрын
@@NicholasRehm ah yes that makes alot of sense! Thank you for the hasty reply
@SkivaksXD
@SkivaksXD Жыл бұрын
The drone knows where it is at all times. It knows this because it knows where it isn't. By subtracting where it is from where it isn't, or where it isn't from where it is (whichever is greater), it obtains a difference, or deviation. The guidance subsystem uses deviations to generate corrective commands to drive the drone from a position where it is to a position where it isn't, and arriving at a position where it wasn't, it now is. Consequently, the position where it is, is now the position that it wasn't, and it follows that the position that it was, is now the position that it isn't. In the event that the position that it is in is not the position that it wasn't, the system has acquired a variation, the variation being the difference between where the drone is, and where it wasn't. If variation is considered to be a significant factor, it too may be corrected by the GEA. However, the drone must also know where it was. The drone guidance computer scenario works as follows. Because a variation has modified some of the information the drone has obtained, it is not sure just where it is. However, it is sure where it isn't, within reason, and it knows where it was. It now subtracts where it should be from where it wasn't, or vice-versa, and by differentiating this from the algebraic sum of where it shouldn't be, and where it was, it is able to obtain the deviation and its variation, which is called error.
@dubber889
@dubber889 Жыл бұрын
Could you share the ROS source code for this ? what ros nodes and ros topics do you use. Because i'm reaserching the same area right now, it will be helpful if i know the references for what i'm doing now. Thank you
@flyingmonkey3822
@flyingmonkey3822 Жыл бұрын
I love it! Civ Div channel just did a video where he talks about bringing a DJI mavic with him into Ukraine, and how they use jammers and so their cheap drones just fall out of the sky so for the money he’d rather invest in better boots. But with the some hardware and some hacking on INav these cheap drones could just return to home instead.
@mugslschlaengli5928
@mugslschlaengli5928 2 жыл бұрын
My biggest hurdle: ROS. Tried getting into it on an NVidia Jetson board, and also had a Teensy 4 as my uart interface with my rover. Guess I have to give it another try some time. Did you come across any helpful starting resources for ROS?
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Starting from a raspberry pi image from ubiquity robotics with a clean install of ROS + dependencies was a lifesaver. Then going in and making your own “templates” for each node is really helpful to get an understanding of how data is handled by ROS. Once you get all the ROS topics into and out of each script, writing the code is the easy/fun part
@minerharry
@minerharry Жыл бұрын
Lmao “immensely complex and high risk”
@kwhp1507
@kwhp1507 2 жыл бұрын
Where are you from? I’ve got some motors and frames I can send you.
@Ry-jw8nk
@Ry-jw8nk 2 жыл бұрын
How does the drone know its starting and goal point? How are these nodes and transfer points defined in the implementation?
@NicholasRehm
@NicholasRehm 2 жыл бұрын
I tell it the start and goal point and it’ll fly to the start on takeoff, wait till I let everything start running, and it figures out how to get to the goal location. Manually defining the start and goal node location is part of the motion planning algorithm, kinda like asking google maps to plan a route for you
@subvsvid3616
@subvsvid3616 5 ай бұрын
What animation software is used in 00:56 How Waypoint Autonomy Works
@creased528
@creased528 2 жыл бұрын
Hi ! This is cool and all but can I ask a question? How does your companion computer, in this case, your Rpi, communicate with the Flight Controller of the drone.
@NicholasRehm
@NicholasRehm 2 жыл бұрын
Just a basic serial connection
@whoisamp620
@whoisamp620 2 жыл бұрын
this would be great for a lawnmower mod, please make one
@allyouneedtoknow8638
@allyouneedtoknow8638 4 ай бұрын
px4 has the local planner module to acheive the same thing
@NicholasRehm
@NicholasRehm 4 ай бұрын
somebody had to implement that, too
@darkonaire
@darkonaire Жыл бұрын
hi nick, I love watching your videos recently I am working on a DIY beginner drone...my PID is a hybrid code of Joop and yours. My drone takes off smoothly and hovers....but after a few commands...it wobbles....which PID loop gain should i adjust? I am controlling it via keyboard...i dont have the RF controller. Please advise..Thanks
@NicholasRehm
@NicholasRehm Жыл бұрын
It’s hard to tell not knowing the specific implementation… what state is your pid controlling? Rate, angle, velocity? I would start lowering p and increasing d
@darkonaire
@darkonaire Жыл бұрын
@@NicholasRehm it's a cascaded PID. Outside loop is angle, inner loop is rate...i will try experimenting on P and D gains as you suggested..many thanks.
@JinKee
@JinKee 5 ай бұрын
The missile knows where it is.
@STOLerant
@STOLerant Жыл бұрын
Could this be done using an off the shelf FC or is your custom solution required? I think this is a great video. I have been wanting a project like this but don't know the coding side well. Is it possible to feed object recognition and labeling into a beta flight or Inav OSD?
@NicholasRehm
@NicholasRehm Жыл бұрын
You'd need to do your additional computing on a companion computer and feed over control commands (same commands a pilot sends over the radio) to the flight controller. I don't know if betaflight supports this directly, but you could probably spoof it somehow
@STOLerant
@STOLerant Жыл бұрын
@@NicholasRehm newest generation of Raspberry Pi products are pretty capable and easy to get a hold of. INav would probably be a better platform but any F4 or above flight controller will yield impressive results on their own. Just a matter of making the two do the talky talks. I am not sure how to do that part lol.
@Aluttuh
@Aluttuh 2 жыл бұрын
anyone know if a fan forcing air down into a funnel will produce higher thrust or since it is an open system would the added pressure in the inside the funnel force air to flow the opposite way reducing rpm counter acting the concentration of air for more thrust? just now wondering why i have not seen such designs with drones and such.
@Aluttuh
@Aluttuh 2 жыл бұрын
and would you get more lift with more air movement or faster air movement at the same scale?
@yashsaini3410
@yashsaini3410 2 жыл бұрын
I have problem in f35 motor calibration please help
@samopal9740
@samopal9740 2 жыл бұрын
Great content! Did you use only existing packages to hook up Realseans with Px4? (Is there any guid on this?) Thanks!
@NicholasRehm
@NicholasRehm 2 жыл бұрын
No it’s all my own code
@samopal9740
@samopal9740 2 жыл бұрын
@@NicholasRehm Is it an open source code? Thanks!
@NicholasRehm
@NicholasRehm 2 жыл бұрын
@@samopal9740 the flight controller is but none of the autonomy
@farhanharoon6546
@farhanharoon6546 Жыл бұрын
Hey Nicholas! I'm working on Motion Planning for UAVs using Motion Capture and I really need your help! Can we have a discussion please??
@JoseRamos-su3ep
@JoseRamos-su3ep Жыл бұрын
Really like the platform you have there, do you files you can share for that?
@NicholasRehm
@NicholasRehm Жыл бұрын
If you shoot me an email I'll see what I can do
@JoseRamos-su3ep
@JoseRamos-su3ep Жыл бұрын
@@NicholasRehm will do!!!!
@JoseRamos-su3ep
@JoseRamos-su3ep Жыл бұрын
@@NicholasRehm I think I did it right, through KZfaq
@blinkingspirittheblu2088
@blinkingspirittheblu2088 Жыл бұрын
very beautiful but need faster hardware like nvidia jetson or orin...
Un-Folding a Quadcopter to Increase Efficiency - Part 1
10:57
Nicholas Rehm
Рет қаралды 544 М.
Open Source Motion Capture for Autonomous Drones
10:34
Joshua Bird
Рет қаралды 551 М.
Is it Cake or Fake ? 🍰
00:53
A4
Рет қаралды 15 МЛН
2000000❤️⚽️#shorts #thankyou
00:20
あしざるFC
Рет қаралды 12 МЛН
Как быстро замутить ЭлектроСамокат
00:59
ЖЕЛЕЗНЫЙ КОРОЛЬ
Рет қаралды 13 МЛН
Шокирующая Речь Выпускника 😳📽️@CarrolltonTexas
00:43
Глеб Рандалайнен
Рет қаралды 11 МЛН
Formation Flight Path Planning Algorithm
10:09
Peter Ryseck
Рет қаралды 6 М.
Teaching my custom AI drone to track humans
19:52
aka: Matchstic
Рет қаралды 25 М.
Ground Effect Vehicle Autonomous Vision-Based Tracking
11:27
Nicholas Rehm
Рет қаралды 49 М.
How Small Can an Autonomous, Long Range, HD UAV Be?
13:25
Think Flight
Рет қаралды 123 М.
Drones | How do they work?
10:13
Lesics
Рет қаралды 2,2 МЛН
Fixed-Wing vs. Multirotor Drone LiDAR
20:06
Indiana Drones
Рет қаралды 17 М.
DroneCase: The DIY Phone Case That FLIES
8:50
Nicholas Rehm
Рет қаралды 183 М.
Champion-level Drone Racing using Deep Reinforcement Learning (Nature, 2023)
4:51
UZH Robotics and Perception Group
Рет қаралды 231 М.
Урна с айфонами!
0:30
По ту сторону Гугла
Рет қаралды 3,7 МЛН
Выложил СВОЙ АЙФОН НА АВИТО #shorts
0:42
Дмитрий Левандовский
Рет қаралды 2 МЛН
iPhone 15 Pro vs Samsung s24🤣 #shorts
0:10
Tech Tonics
Рет қаралды 12 МЛН