The first time Handy got it through his thick skull that he might be a tiny bit in over his head was during his second duel of the tournament, when the earth pony in front of him got a lucky shot in with its rear hoof and knocked him down to one knee. He was fortunate that the blow was off, otherwise Handy likely would have lost all function in that leg for the foreseeable future.