Simple online and realtime tracking people with new “soft-iou” metric

摘要

Online Multi-Object Tracking (MOT) has wide applications in time-critical video analysis scenarios, such as robot navigation1 and autonomous driving2. In tracking by-detection, a major challenge of online MOT is how to robustly associate noisy object detections on a new video frame with previously tracked objects. This paper aims to build technology that can track a movement of people via surveillance cameras that are located in stores, but not only (theoretically, the algorithm may be applicable to the location of the camera at any premises). The algorithm works with a variety of camera angles that allows. The main innovation of the paper is that algorithm SORT has been updated to consider the difference between datasets used on competitions and the real ones. The difference is that recognition is not perfect in data created by the program. People’s contours may be of different size (rectangles corresponding to the same man may differ twice) and some of them may be not recognized. The new metric of proximity called “soft-iou” has been introduced in SORT. We have achieved the accuracy of 95% for the daily number of visitors for one of jewelry retail chains. This level of accuracy allows applying the algorithm in different areas: not only retail stores, but also shopping centers, sports events, performances, traffic in public transport, etc.