Image Segmentation, U Mamba, Biomedical Imaging.
address some of its limitations. In a standard ReLU function, the output is 0 for any input less than 0 and equal to the input for any positive input. While ReLU has been widely adopted due to its simplicity and effectiveness in combating the vanishing gradient problem, it suffers from a drawback