Hi,
It depends on the links between poses and landmarks. On optimization, the optimizer will use link's constraint to update the landmark poses. You may want to look at the difference between the link constraints and the resulting distance between the optimizedPoses.
Another way to debug: you could export the graph in g2o format for example, then try g2o app to optimize the graph. You can also change manually values in the file to see their effect on optimization.
#include <rtabmap/core/Graph.h>
// 0=Raw (*.txt), 1=RGBD-SLAM (*.txt), 2=KITTI (*.txt), 3=TORO (*.graph), 4=g2o (*.g2o)
rtabmap::graph::exportPoses("graph.g2o", 4, posesOut, linksOut);
cheers