An image caption apparatus includes an encoder which encodes an input image; and a decoder which receives an output of the encoder. The decoder comprises a first long short-term memory (LSTM) configured to operate in cooperation with a second LSTM to respectively generate a first hidden vector and a second hidden vector, wherein the second hidden vector is used to generate a word for an output caption, a LSTM cell configured to be used for both the first LSTM and the second LSTM to generate the first hidden vector or the second hidden vector, wherein an personality embedding vector fed into the LSTM cell is employed to modulate an input signal of visual and language features of the internal gates of the LSTM cell, and a personality controller configured to decay the personality embedding vector at each word generation step before the personality embedding vector is fed into the LSTM cell.
IMAGE CAPTION APPARATUS