 Velička joined Heart of Midlothian in the summer of 2006 in a loan deal and made his debut on 9 September 2006 in an SPL against St Mirren during a 1–0 defeat, coming on as a substitute for Neil McCann.On 15 October, Velička scored two goals in the Edinburgh derby against Hibernian, earning 10-man Hearts a draw.He also scored in the 1–1 draw with Dunfermline Athletic on 28 October.