RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework
<|reference_start|>RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework: 3D Multi-Object Tracking (MOT) obtains significant performance improvements with the rapid advancements in 3D object detection, particularly in cost-effective multi-camera setups. However, the prevalent end-to-end training approach for multi-camera trackers results in detector-specific models, limiting their versatility. Moreover, current generic trackers overlook the unique features of multi-camera detectors, i.e., the unreliability of motion observations and the feasibility of visual information. To address these challenges, we propose RockTrack, a 3D MOT method for multi-camera detectors. Following the Tracking-By-Detection framework, RockTrack is compatible with various off-the-shelf detectors. RockTrack incorporates a confidence-guided preprocessing module to extract reliable motion and image observations from distinct representation spaces from a single detector. These observations are then fused in an association module that leverages geometric and appearance cues to minimize mismatches. The resulting matches are propagated through a staged estimation process, forming the basis for heuristic noise modeling. Additionally, we introduce a novel appearance similarity metric for explicitly characterizing object affinities in multi-camera settings. RockTrack achieves state-of-the-art performance on the nuScenes vision-only tracking leaderboard with 59.1% AMOTA while demonstrating impressive computational efficiency.<|reference_end|>
@article{li2024rocktrack:,
    title={RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework},
    author={Xiaoyu Li, Peidong Li, Lijun Zhao, Dedong Liu, Jinghan Gao, Xian Wu,
  Yitao Wu, Dixiao Cui},
    journal={arXiv preprint arXiv:2409.11749},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.11749},
    primaryClass={cs.CV cs.RO}
}