No video

Four Kilometers Walk in Forest (an uncut real-time visual SLAM demo)

  Рет қаралды 20,054

matlabbe

matlabbe

Күн бұрын

RTAB-Map ( introlab.githu... ): an open source Simultaneous Localization And Mapping (SLAM) library
Stereo images recorded with a MYNT EYE S camera: www.mynteye.com/
00:00 Mapping
40:00 - Parameters
50:05 - Closing the large loop
52:40 - Closing the small loop
54:40 - Final loop closure
Google Map comparison with view similar to 57:16 - www.google.com...

Пікірлер: 38
@rafcins
@rafcins 4 жыл бұрын
RTAB-Map has been one of the greatest SLAM systems I have ever seen. This is amazing to watch!
@supernova6553
@supernova6553 3 жыл бұрын
what are some other better or equally as good that you've seen?
@yusufdurkaya5890
@yusufdurkaya5890 2 жыл бұрын
@@supernova6553 ORB-SLAM2 is much better in my opinion. Now ORB-SLAM3 is out but I wasn't able to check that out. OpenVSLAM is another great example of such systems.
@alexkunin7854
@alexkunin7854 Жыл бұрын
@@yusufdurkaya5890 better in what? ORB2/3 doesnt know to use odometry , occupancymap is not supported, no tools and unstable
@chriswang3744
@chriswang3744 4 жыл бұрын
Look who's back!!!
@PascalAchermann
@PascalAchermann 3 жыл бұрын
thank you so much for sharing the settings Mathieu!
@The_Trap
@The_Trap 4 жыл бұрын
Exceptionnel! Bravo Mathieu :-)
@JulianGalvezSerna
@JulianGalvezSerna 4 жыл бұрын
Awesome!, which PC did you use for it?
@MrDinhnam123
@MrDinhnam123 3 жыл бұрын
Great video, thanks for sharing, could you guess about the computational time when this running in realtime? Specifically, in the last of trajectory when the map size is very large.
@matlabbe
@matlabbe 3 жыл бұрын
Don't remember exactly what was the computational time at the end, but it was under 1 second, which was the real-time limit set (memory management was enabled). You can see at 50:11 that the first part of the map is retrived from long term memmory to working memory to extend the map. After mapping, just before 55:11, we can see the map in working memory at that time, then I clicked on action to show the global map.
@clifflin7149
@clifflin7149 3 жыл бұрын
Is it possible to relocalization well in the forest? as everywhere looks the same.
@matlabbe
@matlabbe 3 жыл бұрын
"well" it depends. You will increase loop closure detection success if you revisit the same area with the *same* point of view. The point of view is particularly important in forest, because even by moving 1 feet on the side, the visual features may appear very different because of the changing overlap of trees, branches and leaves. If it is a very windy day with a forest with a lot of leaves, it may increase this effect. Another challenge in this dataset was the lighting variation and shadows, only with SuperPoint I was able to detect the closure of the largest loop (50:05). A GPS was not used in this experiment, but it could have help to find loop closures.
@Tetsujinfr
@Tetsujinfr 3 жыл бұрын
Question: was it a sunny day or a cloudy day? Sunny with high varying contrasts would make the result more prone to tracking robustness issues no?
@matlabbe
@matlabbe 3 жыл бұрын
It was partly cloudy and a windy day (clouds were moving relatively fast). For visual odometry, done >10 Hz it was not really a problem. It is more the exposure change when switching from shadow to very sunny area (or vice-versa) that could cause odometry issues. For localization, it was indeed a problem, I tried many features and only SuperPoint was able to close the large loop. Look closely at the bottom left at 50:11, we can see the two images used for the loop closure. We can see one has shadows and sunlights (no clouds), while the other is completely in shadow (with clouds). The wind could also make odometry more difficult, as it would make the sunlights/shadows move on the ground when the trees are moving, thus making features used by odometry moving in the scene.
@user-yl7nc2rj8k
@user-yl7nc2rj8k 3 жыл бұрын
I have studied the instructions, installed the programs, but I do not understand what to do next. Sorry, I'm a little stupid ... Will you help me, please, write detailed instructions or a video on how I can run SLAM on my computer.
@matlabbe
@matlabbe 3 жыл бұрын
The easiest way is to downlaod the windows binaries with a supported camera, see github.com/introlab/rtabmap/releases
@crzyswayze
@crzyswayze 3 жыл бұрын
What camera would you suggest for this process? There are a large variety of options on the wiki but I am not sure which one will suit my purpose the best. I am interested in real time mapping of forest stands to generate dense point clouds for TLS - like processing to derive inventory metrics.
@matlabbe
@matlabbe 3 жыл бұрын
It depends how large is the area to cover. Lidar may be preferred for fast coverage, if you are interested only in geometry.
@joelharsten2408
@joelharsten2408 4 жыл бұрын
Impressive!!
@MarkRuvald
@MarkRuvald 2 жыл бұрын
How would you compare RTABmap with ORB-SLAM2?
@matlabbe
@matlabbe 2 жыл бұрын
You can check this paper for a comparison with standard datasets: introlab.3it.usherbrooke.ca/mediawiki-introlab/images/7/7a/Labbe18JFR_preprint.pdf
@pablodavidarandarodriguez163
@pablodavidarandarodriguez163 2 жыл бұрын
So, have you used any additional information apart from the pictures that the camera is obtaining? This is, do you fuse the information that you obtain from the camera images with any other sensor information (maybe GPS or so)
@matlabbe
@matlabbe 2 жыл бұрын
Only stereo images and IMU from the camera
@pablodavidarandarodriguez163
@pablodavidarandarodriguez163 2 жыл бұрын
@@matlabbe The same camera had both sensors? Was it your phone or a different device?
@matlabbe
@matlabbe 2 жыл бұрын
@@pablodavidarandarodriguez163 this was with a Mynteye camera
@user-yl7nc2rj8k
@user-yl7nc2rj8k 3 жыл бұрын
Where can I found this soft? It is realy important for me
@matlabbe
@matlabbe 3 жыл бұрын
See the link in the description
@user-yl7nc2rj8k
@user-yl7nc2rj8k 3 жыл бұрын
@@matlabbe I don" undesand how can I launch Slam...
@Dukingftw
@Dukingftw 4 жыл бұрын
this is not real time right. if i do real time, what are the equipment and how accurate is localisation
@matlabbe
@matlabbe 4 жыл бұрын
It depends what do you mean by real-time, here it means that images were processed in online fashion. I was seeing this on the laptop while walking. For the equipments used, the MYNT EYE S camera linked in the description and a XPS2019 laptop.
@UAVwaffle
@UAVwaffle 4 жыл бұрын
Wow
@seleldjdfmn221
@seleldjdfmn221 4 жыл бұрын
Great job. i wish this was longer! #great :o
@ARTAX_76
@ARTAX_76 3 жыл бұрын
Hi is possible have a demo code?
@matlabbe
@matlabbe 3 жыл бұрын
You can get windows binaries here: github.com/introlab/rtabmap/releases/tag/0.20.3. Check at 40:00 in the video for parameters used. The only difference is that you won't have access to SuperPoint features for loop closure detection with that release, but other default features should be ok if there is not too much illumination variance.
@MattWilkie-yk
@MattWilkie-yk 4 жыл бұрын
the github pages link in description is broken
@matlabbe
@matlabbe 3 жыл бұрын
Fixed!
@uuu12345-z
@uuu12345-z 2 жыл бұрын
What dataset did you use?
@matlabbe
@matlabbe 2 жыл бұрын
I recorded it next to where I live.
Outdoor stereo SLAM with RTAB-Map
10:45
matlabbe
Рет қаралды 110 М.
Does this sound illusion fool you?
24:55
Veritasium
Рет қаралды 868 М.
Mark Fisher : The Slow Cancellation Of The Future
46:15
pmilat
Рет қаралды 412 М.
LiDAR-SLAM on Self Racing Cars Dataset (Velodyne HDL-32)
7:08
Robot Mapping using Laser and Kinect-like Sensor
5:38
matlabbe
Рет қаралды 62 М.
Wide-Area Indoor and Outdoor Real-Time 3D SLAM
3:09
Erik Nelson
Рет қаралды 130 М.
New College SFM (source code available)
43:44
Hernan Badino
Рет қаралды 44 М.
RTAB-Map Tango 0.11.14 on Phab2Pro
4:35
matlabbe
Рет қаралды 20 М.
Open-source SLAM with Intel RealSense depth cameras
27:40
Intel RealSense
Рет қаралды 79 М.
Car Mapping with RTAB-Map on CAT Vehicle Simulator (CitySim)
18:25