Biological motion perception is the act of perceiving the fluid unique motion of a biological agent. The phenomenon was first documented by Swedish perceptual psychologist, Gunnar Johansson, in 1973. There are many brain areas involved in this process, some similar to those used to perceive faces. While humans complete this process with ease, from a computational neuroscience perspective there is still much to be learned as to how this complex perceptual problem is solved. One tool which many research studies in this area use is a display stimuli called a point light walker. Point light walkers are coordinated moving dots that simulate biological motion in which each dot represents specific joints of a human performing an action.
Currently a large topic of research, many different models of biological motion/perception have been proposed. The following models have shown that both form and motion are important components of biological motion perception. However, to what extent each of the components play is contrasted upon the models.
Neuroanatomy.
Research in this area seeks to identify the specific brain regions or circuits responsible for processing the information which the visual system perceives in the world. And in this case, specifically recognizing motion created by biological agents.
Single Cell Recording.
The most precise research is done using single-cell recordings in the primate brain. This research has yielded areas important to motion perception in primates such as area MT (middle temporal visual area), also referred to as V5, and area MST (medial superior temporal area). These areas contain cells characterized as direction cells, expansion/contraction cells, and rotation cells, which react to certain classes of movement.
Neuroimaging.
Additionally, research on human participants is being conducted as well. While single-cell recording is not conducted on humans, this research uses neuroimaging methods such as fMRI, PET, EEG/ERP to collect information on what brain areas become active when executing biological motion perception tasks, such as viewing point light walker stimuli. Areas uncovered from this type of research are the dorsal visual pathway, extrastriate body area, fusiform gyrus, superior temporal sulcus, and premotor cortex. The dorsal visual pathway (sometimes referred to as the "where" pathway), as contrasted with the ventral visual pathway ("what" pathway), has been shown to play a significant role in the perception of motion cues. While the ventral pathway is more responsible for form cues.
Neuropsychological Damage.
Valuable information can also be learned from cases where a patient has suffered from some sort of neurological damage and consequently loses certain functionalities of neural processing. One patient with bilateral lesions that included the human homologue of area MT, lost their ability to see biological motion when the stimulus was embedded in noise, a task which the average observer is able to complete. Another study on stroke patients sustaining lesions to their superior temporal and premotor frontal areas showed deficits in their processing of biological motion stimuli, thereby implicating these areas as important to that perception process. A case study conducted on a patient with bilateral lesions involving the posterior visual pathways and effecting the lateral parietal-temporal-occipital cortex struggled with early motion tasks, and yet was able to perceive the biological motion of a point light walker, a higher-order task. This may be due to the fact that area V3B and area KO were still intact, suggesting their possible roles in biological motion perception.
Biological Motion Perception Models.
Background.
The relative roles of form cues compared to motion cues in the process of perceiving biological motion is unclear. Previous research has not untangled the circumstances under which local motion cues are needed or only additive. This model looks at how form-only cues can replicate psychophysical results of biological motion perception.
Model.
"Template Creation"
Same as below. See 2.2.2 Template Generation
"Stage 1"
The first stage compares stimulus images to the assumed library of upright human walker templates in memory. Each dot in a given stimulus frame is compared to the nearest limb location on a template and these combined, weighted distances are outputted by the function:
formula_1
where formula_2 gives the position of a particular stimulus dot and formula_3 represents the nearest limb position in the template. formula_4 represents the size of the receptor field to adjust for the size of the stimulus figure.
The best fitting template was then selected by a winner-takes-all mechanism and entered into a leaky integrator:
formula_5
where formula_6 and formula_7 are the weights for lateral excitation and inhibition, respectively, and the activities formula_8 provide the left/right decision for which direction the stimulus is facing.
"Stage 2"
The second stage attempts to use the temporal order of the stimulus frames to change the expectations of what frame would be coming next. The equation
formula_9
takes into account bottom-up input from stage 1 formula_10, the activities in decision stage 2 for the possible responses formula_11, and weights the difference between selected frame formula_12 and previous frame formula_13.
"Implications"
This model highlights the abilities of form-related cues to detect biological motion and orientation in a neurologically feasible model. The results of the Stage 1 model showed that all behavioral data could be replicated by using form information alone - global motion information was not necessary to detect figures and their orientation. This model shows the possibility of the use of form cues, but can be criticized for a lack of ecological validity. Humans do not detect biological figures in static environments and motion is an inherent aspect in upright figure recognition.
Action Recognition by Motion Detection in Posture Space (Theusner, Lussanet, and Lappe, 2014).
Overview.
Old models of biological motion perception are concerned with tracking joint and limb motion relative to one another over time. However, recent experiments in biological motion perception have suggested that motion information is unimportant for action recognition. This model shows how biological motion may be perceived from sequences of posture recognition, rather than from the direct perception of motion information. An experiment was conducted to test the validity of this model, in which subjects are presented moving point-light and stick-figure walking stimuli. Each frame of the walking stimulus is matched to a posture template, the progression of which is recorded on a 2D posture–time plot that implies motion recognition.
Posture Model.
"Template Generation"
Posture templates for stimulus matching were constructed with motion tracking data from nine people walking. 3D coordinates of the twelve major joints (feet, knees, hips, hands, elbows, and shoulders) were tracked and interpolated between to generate limb motion. Five sets of 2D projections were created: leftward, frontward, rightward, and the two 45° intermediate orientations. Finally, projections of the nine walkers were normalized for walking speed (1.39 seconds at 100 frames per cycle), height, and hip location in posture space. One of the nine walkers was chosen as the walking stimulus, and the remaining eight were kept as templates for matching.
"Template Matching"
Template matching is computed by simulating posture selective neurons as described by A neuron is excited by similarity to a static frame of the walker stimulus. For this experiment, 4,000 neurons were generated (8 walkers times 100 frames per cycle times 5 2D projections). A neuron's similarity to a frame of the stimulus is calculated as follows:
formula_14
where formula_15 describe a stimulus point and formula_16 describe the limb location at time formula_17; formula_18 describes the preferred posture; formula_19 describes a neuron's response to a stimulus of formula_20 points; and formula_4 describes limb width.
"Response Simulation"
The neuron most closely resembling the posture of the walking stimulus changes over time. The neural activation pattern can be graphed in a 2D plot, called a posture-time plot. Along the x axis, templates are sorted chronologically according to a forward walking pattern. Time progresses along the y axis with the beginning corresponding to the origin. The perception of forward walking motion is represented as a line with a positive slope from the origin, while backward walking is conversely represented as a line with a negative slope.
Motion Model.
"Motion Detection in Posture Space"
The posture-time plots used in this model follow the established space-time plots used for describing object motion. Space-time plots with time at the y axis and the spatial dimension at the x axis, define velocity of an object by the slope of the line. Information about an object's motion can be detected by spatio-temporal filters. In this biological motion model, motion is detected similarly but replaces the spatial dimension for posture space along the x axis, and body motion is detected by using posturo-temporal filters rather than spatio-temporal filters.
"Posturo-Temporal Filters"
Neural responses are first normalized as described by 
formula_22
where formula_23 describes the neural response; formula_24 describes the preferred posture at time formula_17; formula_26 describes the mean neural response over all neurons over formula_17; and formula_28 describes the normalized response. The filters are defined for forward and backward walking (formula_29 respectively). The response of the posturo-temporal filter is described
formula_30
where formula_31 is the response of the filter at time formula_32; and formula_33 describes the posture dimension. The response of the filter is normalized by
formula_34
where formula_20 describes the response of the neuron selecting body motion. Finally, body motion is calculated by
formula_36
where formula_37 describes body motion energy.
Critical Features for the Recognition of Biological Motion (Casille and Giese, 2005).
Statistical Analysis and Psychophysical Experiments.
The following model suggests that biological motion recognition could be accomplished through the extraction of a single critical feature: dominant local optic flow motion. These following assumptions were brought about from results of both statistical analysis and psychophysical experiments.
First, Principal component analysis was done on full body 2d walkers and point light walkers. The analysis found that dominant local optic flow features are very similar in both full body 2d stimuli and point light walkers (Figure 1). Since subjects can recognize biological motion upon viewing a point light walker, then the similarities between these two stimuli may highlight critical features needed for biological motion recognition.
Through psychophysical experiments, it was found that subjects could recognize biological motion using a CFS stimulus which contained opponent motion in the horizontal direction but randomly moving dots in the horizontal direction (Figure 2). Because of the movement of the dots, this stimulus could not be fit to a human skeleton model suggesting that biological motion recognition may not heavily rely on form as a critical feature. Also, the psychophysical experiments showed that subjects similarly recognize biological motion for both the CFS stimulus and SPS, a stimulus in which dots of the point light walker were reassigned to different positions within the human body shape for every nth frame thereby highlights the importance of form vs the motion (Fig.1.). The results of the following psychophysical experiments show that motion is a critical feature that could be used to recognize biological motion.
The following statistical analysis and psychophysical experiments highlight the importance of dominant local motion patterns in biological motion recognition. Furthermore, due to the ability of subjects to recognize biological motion given the CFS stimulus, it is postulated that horizontal opponent motion and coarse positional information is important for recognition of biological motion.
Model.
The following model contains detectors modeled from existing neurons that extracts motion features with increasing complexity. (Figure 4).
"Detectors of Local Motion"
These detectors detect different motion directions and are modeled from neurons in monkey V1/2 and area MT
The output of the local motion detectors are the following:
formula_38
where formula_39 is the position with preferred direction formula_40, formula_41 is the velocity, formula_42 is the direction, and formula_43 is the rectangular speed tuning function such that
formula_44 for formula_45 and formula_46 otherwise.
The direction-tuning of motion energy detectors are given by
formula_47
where formula_48 is a parameter that determines width of direction tuning function. (q=2 for simulation).
"Neural detectors for opponent motion selection"
The following neural detectors are used to detect horizontal and vertical opponent motion due by pooling together the output of previous local motion energy detectors into two adjacent subfields. Local motion detectors that have the same direction preference are combined into the same subfield. These detectors were modeled after neurons sensitive to opponent motion such as the ones in MT and medial superior temporal (MST). Also, KO/V3B has been associated with processing edges, moving objects, and opponent motion. Patients with damage to dorsal pathway areas but an intact KO/V3B, as seen in patient AF can still perceive biological motion.
The output for these detectors are the following:
formula_49
where formula_50 is the position the output is centered at, direction preferences formula_51 and formula_52, and formula_53 signify spatial positions of two subfields.
The final output of opponent motion detector is given as
formula_54
where output is the pooled responses of detectors of type formula_55 at formula_56 different spatial positions.
"Detectors of optic flow patterns"
Each detector looks at one frame of a training stimulus