Embodiments are described for improving and enhancing verbal and non-verbal communications during or in conjunction with game play. The system improves and enhances verbal and non-verbal communication by modifying avatars representing real-world players based on real-world reactions to gameplay events. The effect can take on many forms, such as video pixel patches that can be integrated into specific portions of an avatar. The video pixel patches are preferably applied in such a way that they integrate into the moving video frames, and therefore, the integration appears to be substantially done in real-time.
System and method for providing affective characteristics to computer generated avatar during gameplay