Thanks @Xiaokang_Wang for your response. I was not able to figure out the issue with focal loss, but I was able to to get decent recent results with few architecture modifications. Do you have suggestions to trouble shoot the same?
Thanks
Anil