 Singer and guitarist Matt Skiba wrote "Hell Yes" in tribute to Anton LaVey, founder and High Priest of the Church of Satan.It was written shortly after Skiba moved to the San Francisco Bay Area where LaVey had once lived.In the liner notes for "Remains", Skiba commented that "I miss the Bay, and Doktor LaVey and The Black House on the hill that has since gone away."