Thank you so much. Upsampling worked. But I had one query regarding the performance. I created this arch to improve model’s performance drastically. I shared the results with you as well. As per what you told me that Upsampling may degrade performance. I tried your other method of increasing in_features , but I ran out of memory cause I already have 277 M parameters and increasing it by a factor of 32 just increases parameters so much. If you have any other way to handle this, I’d glad to learn . Thanks again !