okay just solved it by:
removing the conversion Variable
        return map(lambda x: torch.cat(x, 0), samples)

so i push
self.memory.push((Variable(self.last_state), Variable(new_state),Variable(torch.LongTensor([int(self.last_action)])), Variable(torch.Tensor([self.last_reward])), self.hx, self.cx))