Hi Judith,
If you can modify
https://github.com/JakobEngel/dso_ros to get the output pose in nav_msgs/Odometry format, you could feed it to rtabmap node instead of using rtabmap's odometry nodes.
However, looking at dso_ros, it seems a MONOCULAR odometry approach, meaning that the scale is unknown. It won't work with rtabmap is the scale is unknown. rtabmap requires stereo, VIO or RGB-D odometry approaches with scale known to work.
The only way to compare both approaches would be to record a rosbag or a dataset, then process it with each approaches separately, getting the trajectory for each approaches. Then, you would need to scale the trajectory of DSO to match the one of rtabmap to better compare them.
cheers,
Mathieu