I would guess that in the pure NN case, having the output independent of the considered input, it is most likely a bug.
Though I agree that in a more general sense it makes sense to return zeros.
@apaszke may have a better explanation?