 While working as a carpenter, Holden published "The American Harmony" (1793), a book of sacred music, mostly original, arranged in three and four parts.Soon afterward followed "Union Harmony, or a Universal Collection of Sacred Music" (1793 & 1801) and "The Massachusetts Compiler" (1795).He wrote the last-named work with Hans Gram and Samuel Holyoke.