The invention discloses an augmented reality gesture recognition method based on wide-angle cameras and depth cameras, and the method comprises the steps: obtaining a depth image in the range of a cone right in front of a sight line through the depth camera at the center of AR glasses, and obtaining a color image in the wide-angle range through the wide-angle cameras at the two sides of the glasses; recognizing 3D coordinates of hand joint points of the depth image within the cone range; predicting 3D coordinates of hand articulation points of the color image in a wide-angle range; and fusing the gesture recognition result in the vertebral body range and the gesture recognition result in the wide-angle range, and outputting a final recognition result. The problem that the gesture recognition range of a depth camera is small is solved, the color information recognition network is optimized through the depth information recognition network model parameters, and the problem that the gesture recognition precision of a wide-angle camera is not high is solved.
Augmented reality gesture recognition method based on wide-angle camera and depth camera