text: Yes! This automation paradox is well known in aviation, and has been the cause of crashes, like AF447. Keeping pilots in the loop is one way they've solved this, among other things like gradual degradation of systems, rather than abrupt failures.