Multi-Level Aggregation and Recursive Alignment Architecture for Efficient Parallel Inference Segmentation Network
<|reference_start|>Multi-Level Aggregation and Recursive Alignment Architecture for Efficient Parallel Inference Segmentation Network: Real-time semantic segmentation is a crucial research for real-world applications. However, many methods lay particular emphasis on reducing the computational complexity and model size, while largely sacrificing the accuracy. To tackle this problem, we propose a parallel inference network customized for semantic segmentation tasks to achieve a good trade-off between speed and accuracy. We employ a shallow backbone to ensure real-time speed, and propose three core components to compensate for the reduced model capacity to improve accuracy. Specifically, we first design a dual-pyramidal path architecture (Multi-level Feature Aggregation Module, MFAM) to aggregate multi-level features from the encoder to each scale, providing hierarchical clues for subsequent spatial alignment and corresponding in-network inference. Then, we build Recursive Alignment Module (RAM) by combining the flow-based alignment module with recursive upsampling architecture for accurate spatial alignment between multi-scale feature maps with half the computational complexity of the straightforward alignment method. Finally, we perform independent parallel inference on the aligned features to obtain multi-scale scores, and adaptively fuse them through an attention-based Adaptive Scores Fusion Module (ASFM) so that the final prediction can favor objects of multiple scales. Our framework shows a better balance between speed and accuracy than state-of-the-art real-time methods on Cityscapes and CamVid datasets. We also conducted systematic ablation studies to gain insight into our motivation and architectural design. Code is available at: https://github.com/Yanhua-Zhang/MFARANet.<|reference_end|>
@article{zhang2024multi-level,
    title={Multi-Level Aggregation and Recursive Alignment Architecture for
  Efficient Parallel Inference Segmentation Network},
    author={Yanhua Zhang, Ke Zhang, Jingyu Wang, Yulin Wu, Wuwei Wang},
    journal={arXiv preprint arXiv:2402.02286},
    year={2024},
    archivePrefix={arXiv},
    eprint={2402.02286},
    primaryClass={cs.CV cs.AI cs.LG}
}