 In January 2004, Taralidis signed with Olympiacos, in which he remained until 2007.During that period, Olympiacos had a squad of renowned players in the same position as Taralidis (Karembeu, Yaya Toure, Ieroklis Stoltidis, Pantelis Kafes) so it was not easy for a young player to get equal opportunities for playing.On 18 February 2005 he made his first appearance with the club in the UEFA Europa League in a victory 1-0 against FC Sochaux.