The song was first published in 1719 in Watts ' collection ; The Psalms of David : Imitated in the language of the New Testament , and applied to the Christian state and worship .
The song appeared for the first time in Watt 's collection .