A Combined Vision-Based Multiple Object Tracking and Visual Odometry System

Over the past year, we have built on our visual odometry algorithm (which I shared in an earlier post and made the source code public) to develop a multi-object tracking algorithm capable of tracking objects in the 3D world from the moving camera observer. An example of where this may be useful is for self-driving vehicles to detect moving objects (other cars) that are on a collision course.

We have written this research up in a research paper, which has been accepted this week into the IEEE Sensors Journal. It will take a few weeks for it to appear on IEEE Xplore. 

Mohamed Aladem, S. A. Rawashdeh, “A Combined Vision-Based Multiple Object Tracking and Visual Odometry System”, IEEE Sensors Journal. Accepted 8/2019. 

Below is a video demo. Credit to Mohamed Aladem, my Ph.D. student who is on track to graduate in mid-2020.