Hi,
Many operations could give you NaN in the backward even with non-NaN values in the forward. For example, sqrt at 0.
You will need to find where NaN appear in the backward to be sure.
If you’re using master, you can use anomaly detection 1.9k to get that information.