Robust Collaborative Perception without External Localization and Clock Devices
<|reference_start|>Robust Collaborative Perception without External Localization and Clock Devices: A consistent spatial-temporal coordination across multiple agents is fundamental for collaborative perception, which seeks to improve perception abilities through information exchange among agents. To achieve this spatial-temporal alignment, traditional methods depend on external devices to provide localization and clock signals. However, hardware-generated signals could be vulnerable to noise and potentially malicious attack, jeopardizing the precision of spatial-temporal alignment. Rather than relying on external hardwares, this work proposes a novel approach: aligning by recognizing the inherent geometric patterns within the perceptual data of various agents. Following this spirit, we propose a robust collaborative perception system that operates independently of external localization and clock devices. The key module of our system,~\emph{FreeAlign}, constructs a salient object graph for each agent based on its detected boxes and uses a graph neural network to identify common subgraphs between agents, leading to accurate relative pose and time. We validate \emph{FreeAlign} on both real-world and simulated datasets. The results show that, the ~\emph{FreeAlign} empowered robust collaborative perception system perform comparably to systems relying on precise localization and clock devices.<|reference_end|>
@article{lei2024robust,
    title={Robust Collaborative Perception without External Localization and Clock
  Devices},
    author={Zixing Lei, Zhenyang Ni, Ruize Han, Shuo Tang, Dingju Wang, Chen Feng,
  Siheng Chen and Yanfeng Wang},
    journal={arXiv preprint arXiv:2405.02965},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.02965},
    primaryClass={cs.AI cs.RO}
}