A participant in a capture volume can speak through a microphone. The microphone can capture the speech and transmit it to a wearable computing device of the participant. The wearable computing device can process the speech to generate audio data. The wearable computing device can transmit the audio data to a simulator engine. The simulator engine can receive the audio data and processes the audio data to determine an attribute of the audio data (e.g., amplitude) at the location of a virtual character in a simulated virtual environment based on one or more attenuation factors. The attenuation factors can be calculated based on 3D motion data of the participant. Further, the simulator engine can drive an change in state of the virtual character in the simulated virtual environment based on the attribute of the audio data.
Communication in a sensory immersive motion capture simulation environment