Re: RTAB-Map with kinect v2

Posted by matlabbe on
URL: http://official-rtab-map-forum.206.s1.nabble.com/RTAB-Map-with-kinect-v2-tp6090p6091.html

Hi,

Currently, Google Tango pose estimation is one of the best visual odometry approach out there. You won't get as accurate motion estimation with RTAB-Map alone and a Kinect v2. Tango odometry is a visual-inertial odometry (VIO) approach and uses a large field-of-view camera (fisheye 180 deg, quite larger than Kinectv2) combined with IMU. So yes in this configuration RTAB-Map uses IMU indirectly from VIO approach of Tango, also depth is not actually used for odometry on RTABMap-Tango, only for creating the point clouds.

Crashes are unfortunate, if you are able to reproduce the bug with a repeatable sequence, open an issue on the github repo. Tell which version you are using (see About menu option). As the version on PlayStore cannot be updated anymore (the tango phones cannot be updated up to now required android API > 25 from PlayStore), you can also try the latest RTAB-Map Tango APK version that can be only installed from docker instructions here. Maybe it will crash less often.

7fps will affect the odometry, if you can get over 15 fps (best is 30 Hz), you will already see a significant improvement on odometry accuracy. On low FPS, the registration between RGB and depth image can be not very accurate (in particular on rotation), increasing odometry errors. To make Windows SDK v2 driver work, we should build RTAB-Map from source. However, on Windows it is not easy to rebuild RTAB-Map, I'll suggest to stick with libfreenect2 (results are similar).

cheers,
Mathieu