A method for real-time cross-spectral object association and depth estimation is presented. The method includes synthesizing (1010), by a cross-spectral generative adversarial network (CS-GAN), visual images from different data streams obtained from a plurality of different types of sensors, applying (1020) a feature -preserving loss function resulting in real-time pairing of corresponding cross-spectral objects, and applying (1030) dual bottleneck residual layers with skip connections to accelerate real-time inference and to accelerate convergence during model training.
REAL-TIME CROSS-SPECTRAL OBJECT ASSOCIATION AND DEPTH ESTIMATION