An output information generator 3 generates abstract output information 4 unrelated to the types of outputters 5a, 5b, and ... according to information from an input unit 1. Semantic interpreters 54a, 54b, and ... of the outputters 5a, 5b, and ... generate pieces of embodied output information 55a, 55b, and ... from the abstract output information 4 on the basis of monitor results from status monitors 51a, 51b, and ... which monitor the operating statuses of the corresponding outputters. Processing performers 56a, 56b, and ... perform processes corresponding to the pieces of embodied output information 55a, 55b, and ....
MULTIMODAL INFORMATION PROCESSING DEVICE