The invention discloses neural network-based facial analysis utilizing facial landmarks and associated confidence values. Systems and methods for determining features of a subject more accurately and more robustly from an image of the subject are provided. One or more machine learning models receive as input an image of the subject and output facial landmarks and associated confidence values. The confidence values represent the shielded degree of the face part of a main body corresponding to the marks, namely the uncertainty of each mark position. The marker points and their associated confidence values and/or associated information may then be input into another set of one or more machine learning models that may output any one or more facial analysis quantities, such as gaze direction, head posture, drowsiness state, cognitive load or distraction state of the subject.
Neural network-based facial analysis utilizing facial landmarks and associated confidence values